Data Engineer Advisor
HyderabadFull-time8–10 yrsPosted 2 weeks ago
Senior data science role at NTT DATA Services in Hyderabad. Needs 8–10 years.
About the role
A highly skilled 8 to 10 years of experience on SSIS. SQL Server, Azure Databricks, Pyspark, Hands-On Data Tech Lead to drive the modernization and scaling of our enterprise data platform to provide technical leadership while remaining deeply technical and actively writing code.
What you'll do
- Lead the migration of legacy SQL Server Integration Services (SSIS) packages to modern, cloud-native Azure Databricks / PySpark Lakehouse environments
- Architect end-to-end Modern Data Warehouse (MDW) and Medallion architecture systems (Bronze, Silver, Gold layers) within Azure
- Mentor and guide a team of data engineers, conducting stringent code reviews, enforcing design patterns, and establishing development standards
- Develop and optimize scalable, modular, high-performance batch and real-time ETL/ELT pipelines using PySpark on Azure Databricks cluster environments
- Implement Delta Lake features, managing transactions, schema evolution, and time-travel querying functionalities
What you need
- SQL
- ETL
- Python
- Databricks
- Spark
- Data warehousing
Good to have
- Azure Data Factory
- Data modelling
- Snowflake
- SSIS
- Azure
- SQL Server