Data Engineer

About the role

We seek a skilled Data Engineer to build and optimize our data infrastructure. As a key contributor, you will collaborate closely with cross-functional teams to design and implement robust data pipelines that efficiently extract, transform, and load data into our AWS-based data lake and data warehouse.

What you'll do

• Building and optimizing data pipelines, data warehouses, and data lakes on the AWS and Databricks platforms
• Managing and maintaining the AWS and Databricks environments
• Ensuring data integrity, accuracy, and consistency through rigorous quality checks and monitoring
• Maintain system uptime and optimal performance
• Working closely with cross-functional teams to understand business requirements and translate them into technical solutions

What you need

• 5–9 yrs of experience
• SQL
• AWS
• Python
• Databricks
• Spark
• Airflow
• B.Tech or B.E. or B.Sc or BCA

Good to have

• LLMs
• Data modelling
• ETL
• NoSQL
• CI/CD
• Unit testing