Lead I - Azure Data Engineer FS
PuneFull-time6–10 yrsPosted 1 week ago
Senior data science role at UST in Pune. Needs 6–10 years and a B.Tech, B.E. or B.Sc.
About the role
We are seeking a skilled Azure Data Engineer with 5+ years of experience in designing, developing, and maintaining modern data pipelines and data integration solutions using Azure services. The ideal candidate should have strong expertise in Azure Data Factory (ADF), Azure Databricks, Azure Synapse, and Azure Data Lake Storage (ADLS).
What you'll do
- Develop metadata-driven and parameterized pipelines to improve reusability
- Implement data validation, error handling, and logging frameworks in ADF
- Optimize Spark jobs for performance and cost efficiency
- Implement ETL/ELT workflows with Delta Lake and Medallion (Bronze, Silver, Gold) architecture
- Develop data models in Azure Synapse Analytics / SQL Server for reporting and analytics
What you need
- SQL
- Python
- ETL
- Spark
- Azure
- Agile
Good to have
- Data modelling
- Snowflake
- Databricks
- Azure Data Factory
- SQL Server
- CI/CD