Hi,
My name is Rohit Chauhan, and I am a Staffing Specialist at Novia Infotech LLC. I am reaching out to you on an exciting job opportunity with one of our clients.
Job Title: Senior AWS Tech Lead
Location:
Malvern, PA (Local Candidates Only)
Experience Required: 15+ Years
Job Summary
We are seeking an experienced Senior AWS Tech Lead with extensive expertise in Java, AWS, Python, PySpark, and Cloud Data Engineering to lead the design, development, and optimization of enterprise-scale data platforms. The ideal candidate will have strong experience building event-driven architectures, streaming data pipelines, and cloud-native data solutions using AWS technologies.
This role requires a hands-on technical leader who can architect scalable solutions, mentor engineering teams, establish best practices, and collaborate with business stakeholders to deliver secure, reliable, and high-performance data platforms.
Key Responsibilities
Cloud Architecture & Technical Leadership
- Design and architect scalable cloud-native data platforms using AWS services.
- Lead technical design discussions, architecture reviews, and solution implementation.
- Define engineering standards, best practices, and reusable frameworks.
- Mentor and guide development teams throughout the software development lifecycle.
- Collaborate with cross-functional teams to deliver enterprise data solutions.
AWS Cloud Development
- Design, develop, and maintain cloud-native applications using AWS services.
- Build event-driven architectures utilizing:
- Amazon Kinesis
- Amazon MSK (Kafka)
- AWS Lambda
- AWS Step Functions
- Amazon SNS
- Amazon SQS
- AWS Glue
- Amazon EMR
- Optimize cloud infrastructure for scalability, performance, and cost efficiency.
- Implement Infrastructure as Code (IaC) using Terraform or AWS CloudFormation.
Python & PySpark Development
- Develop scalable ETL and ELT pipelines using Python and PySpark.
- Design distributed data processing frameworks using Apache Spark.
- Optimize Spark jobs through partitioning, caching, and performance tuning.
- Build reusable Python libraries and automation frameworks.
- Develop batch and real-time data processing solutions.
Data Engineering
- Design and manage enterprise data lakes and cloud data warehouses.
- Develop high-performance data pipelines for analytics and reporting.
- Build streaming data solutions with:
- Stateful processing
- Checkpointing
- Schema evolution
- Idempotent processing
- Work with structured and semi-structured datasets.
- Ensure data quality, governance, and metadata management.
Database & Analytics
- Design data models for analytical workloads.
- Develop complex SQL queries and ETL processes.
- Work with:
- Amazon Redshift
- Amazon Athena
- AWS Glue Data Catalog
- Amazon DynamoDB
- Amazon S3
- Optimize database performance and query execution.
DevOps & Automation
- Develop CI/CD pipelines using Git-based workflows.
- Automate deployments and infrastructure provisioning.
- Implement workflow orchestration using:
- Apache Airflow
- AWS Step Functions
- Integrate monitoring, logging, and alerting solutions.
Monitoring & Security
- Implement monitoring using CloudWatch, Datadog, and related tools.
- Ensure application reliability and observability.
- Implement AWS security best practices including:
- IAM
- KMS Encryption
- VPC Networking
- Data Governance
- Compliance Standards
- Support disaster recovery and high availability architectures.
Collaboration
- Partner with Data Scientists, Business Analysts, Product Owners, and Engineering teams.
- Translate business requirements into scalable technical solutions.
- Participate in Agile ceremonies and release planning.
- Provide technical leadership across globally distributed teams.
Required Skills
- 15+ years of software development experience.
- Strong expertise in Java development.
- Advanced experience with Python and PySpark.
- Extensive hands-on experience with AWS Cloud services:
- Amazon S3
- AWS Lambda
- AWS Glue
- Amazon EMR
- Amazon Kinesis
- Amazon MSK (Kafka)
- AWS Step Functions
- Amazon SNS
- Amazon SQS
- Amazon Athena
- Amazon Redshift
- Amazon DynamoDB
- Strong experience designing event-driven architectures.
- Expertise building batch and streaming data pipelines.
- Strong SQL programming skills.
- Experience with Apache Spark optimization and distributed computing.
- Experience with workflow orchestration tools such as Apache Airflow or AWS Step Functions.
- Hands-on experience with Git, CI/CD, Terraform, and CloudFormation.
- Strong understanding of cloud networking, IAM, encryption, and security best practices.
- Experience with monitoring tools such as CloudWatch and Datadog.
- Excellent troubleshooting and performance tuning skills.
Preferred Qualifications
- Experience leading enterprise cloud transformation initiatives.
- Knowledge of Machine Learning data pipelines.
- Experience working with large-scale analytics platforms.
- Familiarity with Kafka ecosystem and real-time streaming architectures.
- AWS Certifications such as:
- AWS Certified Solutions Architect – Professional
- AWS Certified Data Engineer
- AWS Certified Developer – Associate
- AWS Certified DevOps Engineer
- Experience in Agile/Scrum environments.
|
Rohit Chauhan IT Recruiter A: 4421 Avenida Ln, McKinney, TX, 75070
|
You received this message because you are subscribed to the Google Groups "NoviaJobs" group.
To unsubscribe from this group and stop receiving emails from it, send an email to noviajobs+unsubscribe@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/noviajobs/CAJ0-OE_x9tr7j31qd-S9KBOkGPqsWMomtY82GLqz2-_MYTW0Ng%40mail.gmail.com.
No comments:
Post a Comment