Data Engineer II
HyderabadFull-time2–5 yrsPosted 1 week ago
Closed
Mid-level data science role at LE030 ABC Fitness Solutions in Hyderabad. Needs 2+ years and a B.Sc, B.Tech or B.E..
About the role
Data Engineer II at LE030 ABC Fitness Solutions. Design, develop, and maintain efficient data pipelines to serve reports using cloud ETL/ELT tools such as Azure Data Factory, Apache Airflow, and Databricks.
What you'll do
- Design, develop, and maintain efficient data pipelines to serve reports using cloud ETL/ELT tools such as Azure Data Factory, Apache Airflow, and Databricks
- Design, implement, and manage data workflows, notebooks, and jobs, ensuring seamless data orchestration and integration across cloud platforms and Databricks
- Create and optimize SQL objects, including stored procedures, tables and views for great performance
- Implement data quality checks and validation processes to ensure accuracy, completeness, and consistency of data across different stages of the pipeline
- Monitor data pipelines and processes, troubleshooting issues, and implement solutions to prevent recurrence
What you need
- SQL
- Python
- Databricks
- AWS
- Azure Data Factory
- Airflow
Good to have
- Data modelling
- Redshift
- Azure
- ETL
- Power BI
- Git