Senior Software Engineer II - Data Engineering and Platform

About the role

We are seeking a highly skilled and experienced developer to join our team in the role of Senior Software Engineer II – Data Engineering & Platform. This pivotal role focuses on providing technical vision and leadership for a major business component, managing end-to-end processes that operate at a high scale, processing several petabytes of data daily.

What you'll do

• Architect and Implement Scalable Data Solutions: Design, develop, and deploy comprehensive data solutions encompassing ETL pipelines, data warehousing
• Lead Data Platform Strategy: Develop and execute the strategic vision for the data platform
• Collaborate Cross-Functionally: Work closely with product managers, engineering teams, data scientists
• Optimize Performance and Scalability: Identify and address performance bottlenecks within the data platform. Implement strategies to enhance system performance
• Oversee Data Governance and Quality: Implement and maintain data governance frameworks to ensure data quality, accuracy, consistency

What you need

• 5–9 yrs of experience
• Python
• Kafka
• ETL
• System design
• Terraform
• CI/CD
• B.Tech or B.E. or B.Sc or BCA or M.Tech or MCA or M.Sc

Good to have

• AWS
• Agile
• Databricks
• Spark
• Data visualisation
• Airflow