Looking for Azure Databricks Architect - Iselin, NJ (Hybrid/Local candidates only)

Hi Folks,

 

I am Mahesh Kumar, Senior Recruiter at Kodeva LLC. I saw your profile on LinkedIn, and looking for strong experience on Databricks, PySpark, Azure & SQL.

 

Job Description:

 

Job Title: Azure Databricks Architect

Location: Iselin, NJ (Hybrid/Local candidates only)

Employment Type: Long term Contract

 

Must have : Databricks , PySpark , Azure Cloud Services, SQL

 

Technical Skills:

• Strong expertise in Databricks (Delta Lake, Unity Catalog, Lakehouse Architecture, Table Triggers, Delta Live Pipelines, Databricks Runtime etc.)
• Proficiency in Azure Cloud Services.
• Solid Understanding of Spark and PySpark for big data processing.
• Experience in relational databases.
• Knowledge on Databricks Asset Bundles and GitLab.

 

Key Responsibilities:

• Data Pipeline Development:
• Build and maintain scalable ETL/ELT pipelines using Databricks.
• Leverage PySpark/Spark and SQL to transform and process large datasets.
• Integrate data from multiple sources including Azure Blob Storage, ADLS and other relational/non-relational systems.

Collaboration & Analysis:

• Work Closely with multiple teams to prepare data for dashboard and BI Tools.
• Collaborate with cross-functional teams to understand business requirements and deliver tailored data solutions.

Performance & Optimization:

• Optimize Databricks workloads for cost efficiency and performance.
• Monitor and troubleshoot data pipelines to ensure reliability and accuracy.

Governance & Security:

• Implement and manage data security, access controls and governance standards using Unity Catalog.
• Ensure compliance with organizational and regulatory data policies.

Deployment:

• Leverage Databricks Asset Bundles for seamless deployment of Databricks jobs, notebooks and configurations across environments.
• Manage version control for Databricks artifacts and collaborate with team to maintain development best practices.

 

Preferred Experience:

• Familiarity with Databricks Runtimes and advanced configurations.
• Knowledge of streaming frameworks like Spark Streaming.
• Experience in developing real-time data solutions.

 

Certifications:

• Azure Data Engineer Associate or Databricks certified Data Engineer Associate certification. (Optional)

 

 

Thanks & Regards,

 

Mahesh Kumar

Senior Recruiter

mahesh.kumar@kodeva.com |+1 - 571-989-6668

Kodeva LLC

Address: 20755 Williamsport Pl #320, Ashburn VA 20147

IT Consulting | Staffing Solutions |

USA | CANADA | INDIA