Lead I - Data Engineering

About the role

Lead the design and development of scalable data pipelines and data-processing solutions using Databricks and Apache Spark. Develop and optimize complex data transformations using PySpark/Python and SQL. Design efficient ETL/ELT workflows for high-volume datasets. Perform performance tuning and optimization of Spark jobs, SQL queries, and data pipelines.

What you'll do

• Lead the design and development of scalable data pipelines and data-processing solutions using Databricks and Apache Spark
• Develop and optimize complex data transformations using PySpark/Python and SQL
• Design efficient ETL/ELT workflows for high-volume datasets
• Perform performance tuning and optimization of Spark jobs, SQL queries, and data pipelines
• Provide technical leadership, design guidance, and hands-on support to the engineering team

What you need

• 5–7 years in data science & ai
• SQL
• Python
• Spark
• Databricks
• Data analysis
• ETL
• B.Tech or B.E. or B.Sc or BCA or M.Tech or MCA or M.Sc

Good to have

• AWS
• Data modelling
• Data warehousing
• CI/CD
• Azure
• Git