Data Engineer Advisor
PuneFull-timeJunior levelPosted today
Data science role at NTT Data in Pune.
About the role
The role will support conversion, implementation, unit testing, data validation, defect fixing, deployment preparation, and technical documentation for migrated Snowflake workloads on Databricks. Support conversion and implementation of assigned data pipelines, jobs, scripts, and workload components in Databricks.
What you'll do
- Support conversion, implementation, unit testing, data validation, defect fixing, deployment preparation
- Support conversion and implementation of assigned data pipelines, jobs, scripts, and workload components in Databricks
- Perform data validation, reconciliation, and parity checks between Snowflake and Databricks outputs
- Execute unit-level and integration-level testing for migrated jobs, transformations, and data flows
- Investigate data mismatches, execution failures, dependency issues, and functional defects identified during validation cycles
What you need
- SQL
- Python
- Databricks
- Snowflake
- ETL
- Reconciliation
Good to have
- Unit testing
- Git