Senior Data Engineer

About the role

We are seeking an experienced Data Engineer with over 4 years of expertise in data engineering and a focus on leveraging GenAI solutions. The ideal candidate will have a strong background in Azure services, relational databases, and programming languages, including Python and PySpark. You will play a pivotal role in designing, building, and optimizing scalable data pipelines while integrating AI-driven solutions to enhance our data capabilities.

What you'll do

• Design and implement efficient ETL/ELT pipelines using Azure Data Factory (ADF) and Azure Databricks (ADB)
• Ensure high performance and scalability of data pipelines
• Work with relational databases to structure and query data efficiently
• Design, optimize, and maintain database schemas
• Write, debug, and optimize Python, PySpark, and SQL code to process large datasets

What you need

• 4–7 years in data science & ai
• Machine learning
• LLMs
• Azure
• CI/CD
• Python
• SQL
• B.Sc or B.Tech or B.E. or BCA

Good to have

• ETL
• Spark
• Azure Data Factory
• Databricks