Lead PySpark Engineer for Owings Mills, MD

Hi

My name is Rohit Chauhan, and I am a Staffing Specialist at Novia Infotech LLC. I am reaching out to you on an exciting job opportunity with one of our clients.

 

Title: Lead PySpark Engineer

Location: Owings Mills, MD

 

Job Summary:

We are seeking a highly experienced Lead PySpark Engineer to design, develop, and optimize large-scale data processing solutions. The ideal candidate will have strong expertise in PySpark and distributed data processing, along with the ability to lead technical initiatives and mentor team members in building scalable data pipelines and analytics platforms.

 

Key Responsibilities:

• Lead the design and development of scalable data pipelines using PySpark.
• Architect and implement high-performance distributed data processing solutions.
• Optimize PySpark jobs for performance, scalability, and reliability.
• Collaborate with data architects, data engineers, and business stakeholders to translate requirements into technical solutions.
• Perform data modeling, transformation, and integration of large structured and unstructured datasets.
• Ensure data quality, validation, and governance standards are met.
• Troubleshoot and resolve performance bottlenecks in big data environments.
• Provide technical leadership, conduct code reviews, and mentor junior engineers.
• Support deployment, monitoring, and maintenance of data processing systems.
• Document technical designs, best practices, and implementation strategies.

 

Essential Skills:

• Strong expertise in PySpark
• Experience leading data engineering projects
• Hands-on experience with distributed data processing
• Strong understanding of big data concepts

 

 

Rohit Chauhan IT Recruiter E: rohit.c@noviainfotech.com www.noviainfotech.com A: 4421 Avenida Ln, McKinney, TX, 75070

 

 

--
You received this message because you are subscribed to the Google Groups "NoviaJobs" group.
To unsubscribe from this group and stop receiving emails from it, send an email to noviajobs+unsubscribe@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/noviajobs/CAJ0-OE92PjXFV8D%2ByAC_qD%2B_XHjaGj%2Bu-NaU-4qNrn7M3ZWW%2BA%40mail.gmail.com.