Data Engineer Senior Consultant

About the role

Data Engineer Senior Consultant at NTT DATA Services. Assess complex Informatica workflows including sessions, mappings, and parameterizations and translate them into equivalent Python EL scripts and dbt transformation….

What you'll do

• Assess complex Informatica workflows including sessions, mappings, and parameterizations and translate them into equivalent Python EL scripts and dbt transformation…
• Develop and maintain Python EL pipelines to land high-volume data, including billion-row tables, into the target warehouse using SQLAlchemy, cx_Oracle, pyodbc
• Develop dbt-native tests as well as custom Python unit tests to validate transformation correctness and data quality
• Develop Airflow DAGs to orchestrate Python EL and dbt scripts end-to-end, producing output that is functionally equivalent to the source Informatica workflows
• Contribute to GitLab CI/CD pipeline for dbt and Airflow code, including lint gates, automated testing, and deployment to shared NAS

What you need

• Python
• SQL
• dbt
• Informatica
• Airflow
• Oracle Database

Good to have

• SQL Server
• VBA
• CI/CD
• Test automation
• Git
• Reconciliation