Role: Senior Data Engineer (Python + AWS + PySpark Niche)
Location : Malvern, PA (Onsite)
Duration: 12+ months
Experience
Required: 10+ Years (Senior/Lead Level)
Core Competencies & Required Technical Skills:
Data & Cloud Stack:
- Python (Data processing, automation, APIs, ETL scripting)
- AWS Cloud Computing (S3, Lambda, IAM, EC2 basics)
- AWS Glue (Glue ETL, Glue Catalog, Glue Jobs, Crawlers)
- AWS Glue, AWS Glue, AWS Glue
- NoSQL Databases (MongoDB, DynamoDB, Cassandra, or similar)
- NoSQL, NoSQL, NoSQL
- Big Data Processing using PySpark
- PySpark, PySpark, PySpark
- ETL/ELT Pipeline Development on Cloud
- Experience with Distributed Data Systems
Programming & Frameworks:
- Core Java & Java 8+ (Basic understanding required)
- Core Java, Core Java, Core Java
- PySpark (Transformations, Actions, DataFrame, Optimization)
- PySpark, PySpark, Core Java, Python, AWS, NoSQL
Role & Responsibilities:
- Design, develop, and maintain scalable ETL pipelines using Python and AWS Glue.
- Implement data engineering solutions on AWS Cloud, ensuring high availability and optimized performance.
- Work with cloud data processing frameworks like PySpark to handle large-scale distributed datasets.
- Integrate and manage NoSQL database systems for unstructured and semi-structured data workloads.
- Collaborate with architects, developers, and cross-functional teams to deliver robust data solutions.
- Support data transformation, cleansing, validation, and pipeline automation.
- Participate in code and design reviews to ensure quality and adherence to best practices.
- Maintain data cataloging, metadata, and governance using AWS Glue Data Catalog.
- Troubleshoot and optimize Glue jobs, ensuring efficient execution and minimal latency.
- Demonstrate independent ownership and proactive problem-solving.
- Be a strong contributor to team success by delivering innovative, reliable, and optimized data solutions.
Nice to Have:
- Knowledge of AWS Glue migration strategies
- Exposure to real-time or streaming data systems
- Experience working in enterprise cloud data environments
Soft Skills:
- Strong communication and stakeholder collaboration
- Highly proactive, independent, and solution-oriented
- Analytical mindset with a focus on performance and automation
- Team player with creative problem-solving ability
Thanks & Regards
Bindiya Dhamija
Technical Recruiter
You received this message because you are subscribed to the Google Groups "NoviaJobs" group.
To unsubscribe from this group and stop receiving emails from it, send an email to noviajobs+unsubscribe@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/noviajobs/CABaWORkzaGYO-kj5Y1zJTid6H0nQcPeYfff%2BQv7OpHS8seOj%3DA%40mail.gmail.com.
No comments:
Post a Comment