Hi,
LOCAL CANDIDATES ONLY - F2F
Job Title: Data
Architect – GMI XMX Engineering Ops
Location: San Jose, CA (ONSITE
– LOCAL CANDIDATES ONLY - F2F)
Duration:
12+ Months
Important Note: Candidate must have worked in a Data Architect role for at least 3 years.
Job Summary
We are seeking a highly skilled Data Engineer / Data Architect with strong hands-on expertise in Azure data technologies, Databricks, PySpark, ETL/ELT engineering, and large-scale data processing. The ideal candidate will have experience building and supporting enterprise-grade data platforms, workflow orchestration systems, and production-ready data pipelines.
This role requires a hands-on engineer who can work closely with business and analytics teams while also contributing to data architecture, governance, operational support, and scalable data platform development.
Only local San Jose / Bay Area candidates should be considered.
Required Experience
- 7+ years of Data Engineering experience
- Minimum 3 years of Data Architect experience
- Strong experience building production-grade enterprise data platforms
- Hands-on experience with structured and unstructured data processing
- Experience supporting operational production data environments
Must Have Technical Skills
Azure Data Engineering
Strong hands-on experience with:
- Azure Data Factory (ADF)
- Azure Databricks
- Azure Data Services
- Data pipeline orchestration
- Cloud-based ETL/ELT architectures
Big Data / Processing
Strong expertise in:
- PySpark
- Apache Spark
- Spark SQL
- Large-scale distributed data processing
- Structured and unstructured datasets
- Production-grade data workflows
SQL / Database Skills
Advanced-level experience with:
- SQL development
- Complex query optimization
- Data modeling
- Database fundamentals
- Data transformation logic
Workflow Orchestration
Strong experience with:
- Apache Airflow
- Astronomer
- Workflow scheduling
- Pipeline orchestration
- Monitoring and troubleshooting workflows
- Operational support
Data Governance / Quality
Experience with:
- Data quality validation
- Data lineage
- Governance frameworks
- Operational ownership
- Data monitoring and reconciliation
Production Support
Strong experience supporting:
- Production data pipelines
- Operational troubleshooting
- Root cause analysis
- Pipeline monitoring
- Performance optimization
Good to Have Skills
Experience with:
- Microsoft Fabric
- Snowflake
- dbt
- Delta Lake
- Kafka
- Azure Event Hub
- Streaming / real-time pipelines
- CI/CD for data pipelines
- Marketing analytics platforms
- Campaign / impressions / spend data environments
- GMI / XMX / MRP environments
Key Responsibilities
- Design, develop, and support enterprise-scale ETL/ELT data pipelines
- Build and optimize scalable data workflows using Azure and Databricks
- Process large-scale structured and unstructured datasets
- Develop PySpark / Spark SQL-based transformation frameworks
- Manage workflow orchestration using Airflow / Astronomer
- Monitor and troubleshoot production pipelines and operational issues
- Implement data quality validation and governance processes
- Collaborate directly with business, analytics, and engineering teams
- Support data architecture standards and platform scalability
- Participate in operational ownership and production support activities
Candidate Profile
- Hands-on engineer with architecture capabilities
- Strong communication and stakeholder collaboration skills
- Comfortable working directly with business and analytics teams
- Strong troubleshooting and analytical mindset
- Able to work in fast-paced onsite environments
Shrey Sharma
Sr. Technical Recruiter
LinkedIn: https://www.linkedin.com/in/shrey-sharma-322992370/
Novia
Infotech, 4421 Avenida Ln, McKinney, TX, 75070, www.noviainfotech.com
You received this message because you are subscribed to the Google Groups "NoviaJobs" group.
To unsubscribe from this group and stop receiving emails from it, send an email to noviajobs+unsubscribe@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/noviajobs/CA%2BRQAPNBrGExt-s%3D2QAnn6U1jF669o_NO7W7xs5RbmvnbXPU4g%40mail.gmail.com.
No comments:
Post a Comment