Hi,
ONLY LOCAL
TO CA OR NC OR TX
NO GC
Job Title: AI Engineer
Location: Cary NC / Westlake, CA / Carrollton, TX (Onsite)
Job Summary
We are seeking an experienced AI Engineer to design and deliver modern, scalable data platforms across cloud environments. This role will focus on end-to-end data architecture including ingestion, processing, storage, governance, and consumption, leveraging cloud-native technologies and best practices.
Key Responsibilities
Architecture & Design
- Design end-to-end cloud data architectures including:
- Data ingestion
- Processing
- Storage
- Governance
- Consumption layers
- Define modern data platform patterns:
- Lakehouse
- Data Mesh
- Real-time streaming architectures
- Select appropriate cloud services across AWS, Azure, or GCP
Data Engineering & Integration
- Architect batch and real-time data pipelines
- Enable scalable processing using:
- Spark / Databricks
- Kafka / Flink
- Cloud-native tools
- Define ETL/ELT frameworks and best practices
Cloud Platform & Infrastructure
- Build secure, scalable cloud data ecosystems
- Optimize performance, storage, and cost efficiency
- Implement Infrastructure as Code using:
- Terraform
- ARM
- CloudFormation
Data Governance & Security
- Implement:
- Data cataloging and lineage
- Data quality frameworks
- Metadata management
- Ensure security and compliance:
- IAM and role-based access
- Encryption
- Regulatory compliance (GDPR, HIPAA, SOC2, PCI-DSS)
Stakeholder Collaboration
- Translate business requirements into technical architecture solutions
- Partner with product, security, and platform teams
- Provide leadership in data strategy and modernization initiatives
Documentation & Best Practices
- Create architecture standards, reference models, and reusable frameworks
- Conduct design reviews and capacity planning
- Drive best practices across data engineering and cloud architecture
Required Skills & Qualifications
Core Skills
- 8–10 years of experience in data engineering/architecture
- 3+ years of experience in cloud-native data platforms
- Hands-on expertise in at least one cloud platform:
- AWS (S3, Redshift, Glue, EMR, Athena, Lake Formation)
- Azure (Synapse, Data Lake, ADF, Databricks)
- GCP (BigQuery, Dataflow, Dataproc)
Technical Skills
- Strong experience with:
- Distributed data processing (Spark, Databricks)
- Event streaming (Kafka, Kinesis, Pub/Sub)
- SQL / NoSQL database design
- Data modeling (Star Schema, Snowflake, Data Vault)
- Proficiency in:
- Python / PySpark
- SQL
Governance & Security
- Knowledge of data governance, metadata management, and compliance
- Experience implementing secure and compliant data architectures
Preferred Qualifications
- Cloud certifications:
- AWS Solutions Architect
- Azure Architect Expert
- GCP Professional Data Engineer
- Experience with BI tools:
- Power BI
- Tableau
- Looker
- Familiarity with ML/AI platforms:
- Azure ML
- AWS SageMaker
- GCP Vertex AI
- Experience in regulated industries (BFSI, Healthcare)
Key Highlights
- Work on modern cloud data platforms (Lakehouse, Data Mesh, Streaming)
- Strong focus on cloud-native architecture and enterprise data strategy
- Opportunity to lead large-scale data transformation initiatives
|
Arjun BHATT |
E: arjun.b@noviainfotech.com M: (972) 961 2004 Linkedin: linkedin.com/in/arjun-bhatt-3a86001b5 |
You received this message because you are subscribed to the Google Groups "NoviaJobs" group.
To unsubscribe from this group and stop receiving emails from it, send an email to noviajobs+unsubscribe@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/noviajobs/CANVQszEyoziBL7buLrDeWHccYAkCM4LECFO7XpaHqSqiVcKVfw%40mail.gmail.com.
No comments:
Post a Comment