Data Engineer

About the role

As a Data Engineer for our Data Science team, you will play a critical role in helping the team to enrich and maintain the central repository of datasets which is leveraged for carrying out advanced data analytics and machine learning techniques to extract actionable insights from financial and market data.

What you'll do

• Design, develop, and maintain efficient ETL processes for multi-scale data sets
• Implement and optimize data transformation and validation processes to ensure data accuracy and consistency
• Collaborate with cross-functional teams to understand data requirements and business logic
• Architect, build and maintain scalable and high-performance data pipelines
• Evaluate and implement new technologies to enhance data pipeline efficiency and reliability

What you need

• 4–7 yrs of experience
• SQL
• ETL
• Python
• Data modelling
• AWS
• Data warehousing
• B.Sc or B.Tech or B.E. or BCA or M.Tech or MCA or M.Sc

Good to have

• Hadoop
• Spark
• Kafka
• GCP
• Java
• Scala