Technical Lead (Databricks)

About the role

As a Lead Data Engineer specializing in Databricks, you will be a key player in designing, developing, and optimizing our enterprise transportation client's next-generation data platform. You will lead a team of data engineers, providing technical guidance, mentorship, and ensuring the scalable, and high-performance data solutions.

What you'll do

• Lead the design, development, and implementation of scalable and reliable data pipelines using Databricks, Spark, and other relevant technologies
• Define and enforce data engineering best practices, coding standards, and architectural patterns
• Provide technical guidance and mentorship to junior and mid-level data engineers
• Conduct code reviews and ensure the quality, performance, and maintainability of data solutions
• Architect and implement data solutions on the Databricks platform, including Databricks Lakehouse, Delta Lake, and Unity Catalog

What you need

• 8–14 yrs of experience
• Databricks
• SQL
• Python
• Git
• AWS
• Spark
• M.Sc or B.Tech or B.E. or B.Sc or BCA or M.Tech or MCA

Good to have

• Java
• Kafka
• MLOps
• Machine learning
• Scala
• Data warehousing