Data Engineer II

About the role

Data Engineer II at LE030 ABC Fitness Solutions. Design, develop, and maintain efficient data pipelines to serve reports using cloud ETL/ELT tools such as Azure Data Factory, Apache Airflow, and Databricks.

What you'll do

• Design, develop, and maintain efficient data pipelines to serve reports using cloud ETL/ELT tools such as Azure Data Factory, Apache Airflow, and Databricks
• Design, implement, and manage data workflows, notebooks, and jobs, ensuring seamless data orchestration and integration across cloud platforms and Databricks
• Create and optimize SQL objects, including stored procedures, tables and views for great performance
• Implement data quality checks and validation processes to ensure accuracy, completeness, and consistency of data across different stages of the pipeline
• Monitor data pipelines and processes, troubleshooting issues, and implement solutions to prevent recurrence

What you need

• 2–5 yrs of experience
• SQL
• Python
• Databricks
• AWS
• Azure Data Factory
• Airflow
• B.Sc or B.Tech or B.E. or BCA

Good to have

• Data modelling
• Redshift
• Azure
• ETL
• Power BI
• Git