Senior Data Engineer

About the role

This hire will be responsible for expanding and optimizing our data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up.

What you'll do

• Create and maintain optimal data pipeline architecture
• Explore and assemble large, complex data sets that meet functional / non-functional business requirements
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery
• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Spark, EMR
• Work with stakeholders across different teams, including product managers

What you need

• 5–9 yrs of experience
• Machine learning
• SQL
• Python
• ETL
• Spark
• Kafka
• B.Tech or B.E. or B.Sc or BCA

Good to have

• MLOps
• Kubernetes
• Data modelling
• Elasticsearch
• Scala
• Java