NO H1B
MAX PAY IS 50$ on C2C
Title: Data Engineer
With Banking Experience
Location: NYC NY hybrid
Role Overview
We are looking for a highly skilled Data Engineer to join an Agile, SDLC-based delivery team. The role focuses on building scalable, reliable, and reusable data pipelines and delivering data as a product/service to support analytics and business needs.
Key Responsibilities
- Contribute as an individual contributor in an Agile SDLC environment.
- Design and implement end-to-end data engineering solutions aligned with data-as-a-product and data-as-a-service principles.
- Develop ETL pipelines from scratch using Python and big data technologies.
- Build, manage, and optimize Airflow DAGs for orchestration and scheduling.
- Develop and optimize Spark / PySpark jobs for large-scale data processing.
- Design and implement data models, schemas, and entity relationships.
- Write and optimize complex SQL queries across multiple RDBMS platforms.
- Develop and maintain stored procedures, triggers, and materialized views.
- Integrate data across systems using REST, SOAP, ETL, and SSIS.
- Develop dashboards and reports using BI tools.
- Write efficient, reusable, and maintainable code following best practices.
- Collaborate with cross-functional teams and continuously learn new cloud-based tools and applications.
Required Skills & Technical Expertise
- Programming & Frameworks
- Expert in Python
- Strong experience with PySpark / Apache Spark
- Hands-on experience with Node.js and JSON
- Proficiency in at least one object-oriented language: C, C++, or Java
- Data Engineering & Big Data
- Strong understanding of ETL, Big Data, and Data Warehousing
- Expertise in data modeling, data lakes, and master data management
- Experience delivering data as a product/service
- Workflow & Orchestration
- Expert-level experience with Apache Airflow (DAG development and management)
- Databases & SQL
- Deep knowledge of RDBMS concepts
- Advanced SQL expertise across SQL Server, Oracle, DB2
- Hands-on experience with stored procedures, triggers, and DML packages
- BI & Analytics
- Experience building reports and dashboards using Qlik, Tableau, or Power BI
- Strong understanding of data analytics concepts
- Integration & Tools
- Experience integrating systems via REST, SOAP, ETL, SSIS
- Willingness to learn and adapt to cloud-based business applications and tools
Skills Summary
- Apttio
- Big Data
- ETL / Data Warehousing
- MS SQL
- Oracle PL/SQL
- Stored Procedure Coding
- Python
- PySpark
- Node.js
- RDBMS
- Data Analytic
|
Arjun BHATT |
E: arjun.b@noviainfotech.com M: (972) 961
2004 Linkedin: linkedin.com/in/arjun-bhatt-3a86001b5 |
You received this message because you are subscribed to the Google Groups "NoviaJobs" group.
To unsubscribe from this group and stop receiving emails from it, send an email to noviajobs+unsubscribe@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/noviajobs/CANVQszH4y1E0mgAZuxZ0ttyp4i%3DVq1shFp6PyZyhZ7i9z%2B2dYQ%40mail.gmail.com.
No comments:
Post a Comment