Data Platforms Senior Engineer – Databricks
BengaluruFull-time4–7 yrsPosted 1 week ago
Mid-level data science role at Waters Corporation in Bengaluru. Needs 4+ years and a B.Tech, B.E. or B.Sc.
About the role
The Senior Data Engineer (ETL) will lead the design and development of scalable ETL pipelines for Waters’ Enterprise Data Lakehouse. This role requires a strong technical foundation, hands-on experience with Azure databricks, Pyspark, SQL, Python & GITHUB alongwith a strong understanding of standard data engineering practices, and the ability to work cross-functionally with business and technical teams
What you'll do
- Design, develop, and maintain scalable data pipelines and ETL/ELT processes
- Develop and optimize data processing solutions using Databricks and Apache Spark
- Build data pipelines using PySpark, Python, and SQL
- Work with Databricks notebooks, workflows/jobs, clusters, and Delta Lake
- Implement incremental data processing and performance optimization techniques
What you need
- Databricks
- SQL
- Python
- ETL
- Spark
- Data warehousing
Good to have
- Azure Data Factory
- Data modelling
- Hadoop
- Kafka
- Git
- Azure