Data Engineer Senior Consultant

About the role

Data Engineer Senior Consultant at NTT Data. Assess complex Informatica workflows including sessions, mappings, and parameterizations and translate them into equivalent Python EL scripts and dbt transformation….

What you'll do

• Assess complex Informatica workflows including sessions, mappings, and parameterizations and translate them into equivalent Python EL scripts and dbt transformation…
• Develop and maintain Python EL pipelines to land high-volume data, including billion-row tables, into the target warehouse using SQLAlchemy, cx_Oracle, pyodbc
• Develop dbt-native tests as well as custom Python unit tests to validate transformation correctness and data quality
• Develop Airflow DAGs to orchestrate Python EL and dbt scripts end-to-end, producing output that is functionally equivalent to the source Informatica workflows
• Contribute to GitLab CI/CD pipeline for dbt and Airflow code, including lint gates, automated testing, and deployment to shared NAS

What you need

• Python
• dbt
• Informatica
• Airflow
• SQL Server
• VBA
• Any graduate

Good to have

• CI/CD
• Test automation
• Oracle Database
• Git
• Reconciliation