Hi,
Hope you are doing well!!
I have an urgent requirement with one of my clients. Please find the job details below and forward me your updated resume along with your contact details at Jitendra.s@noviainfotech.com
Job Title: Senior Data Engineer – Databricks (Azure)
Location: Seattle, WA
Role Overview
We are looking for a Senior Data Engineer with strong hands-on experience in Azure Databricks to design, build, and optimize scalable data pipelines and cloud-based data platforms. This role requires deep expertise in data engineering, cloud data architecture, and collaboration with business and governance teams to deliver high-quality, reliable data solutions.
Key Responsibilities
Design, build, and deploy robust ETL/ELT pipelines to ingest data from multiple sources including databases, APIs, and structured/unstructured files.
Develop, optimize, and support data pipelines within a Cloud Data Platform, primarily using Azure Databricks.
Create and maintain data models that align with business requirements while remaining flexible for future growth.
Monitor, tune, and optimize Databricks cluster performance, ensuring cost-efficient scaling and optimal resource utilization.
Implement and manage Delta Lake for reliable, performant, and versioned data storage.
Automate CI/CD pipelines for data workflows using Azure DevOps.
Orchestrate and schedule workflows using Databricks Jobs and/or Azure Data Factory (ADF).
Collaborate with cross-functional teams to support data governance, metadata management, and security using Databricks Unity Catalog.
Ensure data quality, reliability, and consistency through validation, monitoring, and optimization techniques.
Effectively communicate technical concepts and solutions to non-technical stakeholders through clear documentation and discussions.
Required Skills & Qualifications
7+ years of experience in Data Engineering or a related field.
Strong programming skills in Python/PySpark, SQL, and/or Scala.
Hands-on experience with Azure Databricks Cloud Data Platform (Required).
Solid experience with workflow orchestration tools such as Databricks Jobs or Azure Data Factory pipelines (Required).
Strong understanding of cloud data architecture and services in Azure.
Deep knowledge of data storage and processing concepts, including:
Data Lakes
Relational Databases
NoSQL Datastores
Data Warehousing concepts
Experience building scalable, high-performance data transformation and integration pipelines.
Jitendra Singh
Sr.Technical Recruiter
You received this message because you are subscribed to the Google Groups "NoviaJobs" group.
To unsubscribe from this group and stop receiving emails from it, send an email to noviajobs+unsubscribe@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/noviajobs/CAMkiYD1d4gmKLVt3%2BQrj1jq5LMgWsrt7uVz76hP3KVdgveym-Q%40mail.gmail.com.
No comments:
Post a Comment