Azure Databricks Solution Architect for Tampa, FL

Hi,

My name is Rohit Chauhan, and I am a Staffing Specialist at Novia Infotech LLC. I am reaching out to you on an exciting job opportunity with one of our clients.

 

Job Title: Azure Databricks Solution Architect

Location: Tampa, FL

---

Job Summary

We are seeking an experienced Azure Databricks Solution Architect to lead the design, development, and implementation of enterprise-scale data engineering solutions on the Databricks Lakehouse Platform. The ideal candidate will possess deep expertise in Azure Databricks, Apache Spark, Delta Lake, MLflow, Python, SQL, and cloud-native architectures, with extensive experience designing scalable ETL/ELT pipelines, implementing data governance, and driving DevOps best practices in enterprise data platforms.

The successful candidate will collaborate with business stakeholders, data scientists, analysts, and engineering teams to deliver secure, scalable, and high-performance data solutions.

---

Key Responsibilities

• Architect and implement enterprise-scale data solutions using Azure Databricks.
• Design, develop, and optimize scalable ETL/ELT data pipelines for structured and unstructured datasets.
• Build high-performance distributed data processing solutions using Apache Spark.
• Design and manage Delta Lake architecture for reliable, scalable data storage.
• Develop and implement MLflow solutions for machine learning lifecycle management.
• Create efficient data models and enterprise data warehousing solutions.
• Collaborate with business stakeholders, data scientists, analysts, and engineering teams to gather requirements and deliver scalable solutions.
• Design and implement CI/CD pipelines for Databricks deployments.
• Automate infrastructure provisioning using Infrastructure as Code (IaC).
• Establish data governance, security, compliance, and data quality standards.
• Optimize platform performance, scalability, reliability, and cost efficiency.
• Provide technical leadership, architecture guidance, and mentorship to data engineering teams.
• Evaluate and integrate emerging technologies to improve enterprise data platforms.
• Work across cloud platforms including Azure, AWS, and Google Cloud Platform (GCP).
• Support production deployments, monitoring, troubleshooting, and performance tuning.

---

Required Technical Skills

Data Engineering

• Azure Databricks
• Apache Spark
• Delta Lake
• DBSQL
• MLflow
• Spark SQL
• Structured Streaming
• Batch Processing

Programming Languages

• Python
• SQL
• PySpark

Data Integration

• ETL Development
• ELT Development
• Data Pipeline Development
• Data Transformation
• Data Migration
• Data Ingestion

Data Architecture

• Data Modeling
• Data Warehousing
• Lakehouse Architecture
• Distributed Computing
• Enterprise Data Architecture

Cloud Platforms

• Microsoft Azure
• Azure Databricks
• Azure Data Lake Storage (ADLS)
• Azure Synapse Analytics
• AWS
• Google Cloud Platform (GCP)

DevOps & Automation

• CI/CD
• Azure DevOps
• Git
• GitHub
• Jenkins
• Infrastructure as Code (IaC)
• Terraform (Preferred)

Big Data Technologies

• Apache Spark
• Delta Lake
• Databricks Runtime
• Spark Clusters

Data Governance & Security

• Data Governance
• Data Security
• Data Compliance
• Role-Based Access Control (RBAC)
• Data Quality Management

Business Intelligence

• Power BI
• Azure Synapse Analytics

---

Required Qualifications

• Bachelor's degree in Computer Science, Information Technology, Engineering, Data Science, or a related field.
• 8–10 years of experience in Data Engineering, Data Architecture, or Solution Architecture.
• Minimum 8 years of hands-on experience with Azure Databricks.
• Strong expertise in Apache Spark, Delta Lake, MLflow, and DBSQL.
• Extensive experience building enterprise-scale ETL/ELT pipelines.
• Strong knowledge of distributed computing and large-scale data processing.
• Experience with Azure cloud services and cloud-native architectures.
• Expertise in Python, SQL, and PySpark programming.
• Experience implementing CI/CD pipelines for Databricks environments.
• Strong understanding of Infrastructure as Code (IaC) principles.
• Experience implementing enterprise data governance and security frameworks.
• Excellent problem-solving, analytical, and communication skills.
• Experience leading technical teams and mentoring engineers.
• Strong understanding of Agile/Scrum methodologies.

---

Preferred Qualifications

• Databricks Certified Data Engineer certification.
• Microsoft Certified: Azure Solutions Architect Expert.
• Experience with Azure Synapse Analytics.
• Knowledge of Power BI development and reporting.
• Experience working with AWS and Google Cloud Platform.
• Familiarity with machine learning platforms and MLOps.
• Experience with Terraform and cloud automation.

 

Rohit Chauhan IT Recruiter E: rohit.c@noviainfotech.com www.noviainfotech.com A: 4421 Avenida Ln, McKinney, TX, 75070

 

--
You received this message because you are subscribed to the Google Groups "NoviaJobs" group.
To unsubscribe from this group and stop receiving emails from it, send an email to noviajobs+unsubscribe@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/noviajobs/CAJ0-OE9%2BMq%2BcnStE-bTcV%2B19431QyVCbmHQya7LKV-oCYjZ0dQ%40mail.gmail.com.