Rate: $50
Job Title:
Data Engineer Azure
Databricks
Location: Denver, CO (Fully
Onsite Only)
Duration:
12+ Months
Experience Required:10+ Years
Job Summary
We are seeking an experienced Azure Databricks Data Engineer to serve as the onsite technical lead for enterprise data engineering initiatives. The ideal candidate will have strong expertise in Azure Databricks, PySpark, Delta Lake, and modern Lakehouse architectures, along with experience leading offshore development teams in hybrid delivery environments.
This role requires strong hands-on technical leadership, data engineering expertise, and the ability to coordinate onsite-offshore execution while ensuring delivery quality and alignment with enterprise standards.
Key Responsibilities
Technical Leadership & Delivery Management
- Act as the onsite technical lead for Azure Databricks data engineering initiatives
- Lead and coordinate offshore development teams by:
- Assigning work
- Reviewing deliverables
- Providing technical guidance and mentorship
- Conduct:
- Code reviews
- Design reviews
- Solution walkthroughs
- Ensure offshore development aligns with:
- Enterprise architecture
- Security standards
- Business requirements
- Identify:
- Technical risks
- Delivery gaps
- Platform improvement opportunities
- Collaborate effectively within hybrid onsite-offshore delivery models
Data Engineering & Platform Development
- Design, build, and orchestrate ETL/ELT pipelines using:
- Azure Databricks
- PySpark
- Spark SQL
- Implement:
- Batch ingestion pipelines
- Data transformation workflows
- Scalable distributed data processing solutions
- Architect and maintain:
- Lakehouse architectures
- Analytical data warehouse models
- Fact and dimension schemas using Delta Lake
- Ensure:
- Data quality
- Reliability
- Lineage
- Governance compliance
- Work with platform and security teams to implement:
- RBAC
- Data access controls
- Security best practices
CI/CD & DevOps
- Implement and support CI/CD pipelines using:
- Git for Databricks
- Version control and deployment best practices
- Support automated deployment and release management processes
Required Skills & Qualifications
- 8–10+ years of hands-on experience in Data Engineering
- Strong expertise in:
- Azure Databricks
- Delta Lake
- PySpark
- Spark SQL
- Advanced SQL proficiency with strong understanding of:
- Distributed data processing
- Data warehouse concepts
- ETL/ELT architecture
- Experience leading or mentoring data engineering teams
- Strong experience with:
- Code reviews
- Design validations
- Technical solution governance
- Good knowledge of:
- Data security
- RBAC
- Access management
- Experience working in:
- Hybrid onsite-offshore delivery models
Preferred / Nice-to-Have Skills
- Azure Synapse Analytics
- Microsoft Fabric
- Azure Data Factory
- PL/SQL
Key Skills
- Azure Databricks
- PySpark
- Delta Lake
- Azure Data Factory
- Spark SQL
- PL/SQL
- Data Engineering
- Lakehouse Architecture
Shrey Sharma
Sr. Technical Recruiter
LinkedIn:
https://www.linkedin.com/in/shrey-sharma-322992370/
Novia
Infotech, 4421 Avenida Ln, McKinney, TX, 75070, www.noviainfotech.com
You received this message because you are subscribed to the Google Groups "NoviaJobs" group.
To unsubscribe from this group and stop receiving emails from it, send an email to noviajobs+unsubscribe@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/noviajobs/CA%2BRQAPOQ50gbFFV0DDtRqosJ9GEbPn4-stVueuAOsxo1GFACdw%40mail.gmail.com.
No comments:
Post a Comment