Senior Data Migration Engineer
BengaluruFull-time5–9 yrsPosted 2 weeks ago
Senior engineering role at NTT Data in Bengaluru. Needs 5+ years.
About the role
The Senior Data Migration Engineer serves as a hands-on technical contributor and delivery anchor, responsible for designing and implementing Python-based extract/load pipelines, dbt-based transformations, and Airflow-based orchestration for a large-scale migration from Informatica PowerCenter to a modern data stack.
What you'll do
- Responsible for designing and implementing Python-based extract/load pipelines, dbt-based transformations
- Develop and maintain Python EL pipelines to land high-volume data, including billion-row tables, into the target warehouse using SQLAlchemy, cx_Oracle, pyodbc
- Design and develop dbt transformation models based on Informatica mapping logic, incorporating dbt best practices including model layering, macros
- Develop dbt-native tests as well as custom Python unit tests to validate transformation correctness and data quality
- Develop Airflow DAGs to orchestrate Python EL and dbt scripts end-to-end, producing output that is functionally equivalent to the source Informatica workflows
What you need
- Python
- SQL
- Git
- dbt
- Airflow
- Informatica
Good to have
- SQL Server
- VBA
- CI/CD
- Test automation
- Oracle Database
- Reconciliation