Hiring for a Azure Data Engineer for Hamilton, NY or NJ (Locals Only - F2F Interview)

Hi,

(ONLY Local to NY, NJ - F2F Interview)

Job Title: Azure Data Engineer)

Location: Hamilton, NY (Locals Only - F2F Interview)
Duration: 12+ Months
Interview Requirement: In-Person (F2F) Interview Required
Candidate Requirement: Local candidates only

---

Job Summary:

We are seeking an experienced Data Architect / Azure Data Engineer with strong expertise in Microsoft Azure data platforms to design, build, and optimize scalable data solutions. The ideal candidate will lead data architecture initiatives, develop robust ETL/ELT pipelines, and ensure data availability, security, and performance for enterprise analytics use cases.

---

Key Responsibilities:

Data Ingestion & Integration

·         Collect and ingest data from on-premise systems, cloud sources, APIs, and streaming platforms.

·         Build scalable ingestion pipelines using Azure Data Factory (ADF), Azure Event Hub, or IoT Hub.

Data Transformation & Processing

·         Clean, normalize, and enrich data for analytics and reporting.

·         Implement complex business logic using ETL/ELT workflows in ADF or Databricks.

·         Perform large-scale data processing using Apache Spark on Azure Databricks.

Data Storage & Architecture

·         Design and maintain Azure Data Lake Storage (ADLS) and Azure Synapse Analytics data warehouses.

·         Implement star and snowflake schemas for analytical workloads.

·         Optimize data storage for performance and cost efficiency.

Monitoring & Optimization

·         Monitor pipelines and systems using Azure Monitor and Log Analytics.

·         Perform performance tuning for data pipelines, Spark jobs, and SQL queries.

·         Scale Azure resources dynamically to meet workload demands.

Security & Governance

·         Implement data governance policies, RBAC, encryption, and access controls.

·         Manage secrets and credentials using Azure Key Vault.

·         Ensure compliance with regulatory standards such as GDPR, HIPAA, etc.

Collaboration

·         Work closely with Data Scientists, BI Developers, and Solution Architects.

·         Ensure high data quality, reliability, and availability for analytics and reporting teams.

---

Required Skills & Qualifications:

Azure Cloud & Data Platform Expertise

·         Strong hands-on experience with:

o    Azure Data Factory (ADF)

o    Azure Synapse Analytics

o    Azure Databricks

o    Azure Data Lake Storage (ADLS)

o    Azure SQL Database

o    Azure Event Hub / IoT Hub

Programming & Scripting

·         Strong SQL (T-SQL) skills.

·         Proficiency in Python or Scala for Databricks development.

·         Experience with PowerShell for automation.

Data Architecture & Modeling

·         Experience designing data models for structured and unstructured data.

·         Strong understanding of dimensional modeling (star/snowflake schemas).

Additional Skills

·         Experience with big data processing and analytics.

·         Strong understanding of data governance, security, and compliance.

·         Excellent communication and collaboration skills.

---

--
You received this message because you are subscribed to the Google Groups "NoviaJobs" group.
To unsubscribe from this group and stop receiving emails from it, send an email to noviajobs+unsubscribe@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/noviajobs/CANVQszGBr0WLcrpeGDB35vFw77ymeQaJKiKCRzk%2Bi62cjgL4eg%40mail.gmail.com.