Data/ETL Engineer
Bengaluru, Hyderabad, ChennaiFull-time3–6 yrsPosted 3 weeks ago
Mid-level data science role at Ascendion in Bengaluru, Hyderabad and 1 more city. Needs 3+ years.
About the role
This job involves design and develops data pipeline using Databricks, Pyspark to deliver CMS compliance initiatives. Job will involve extensive interfacing & co-ordination with other senior tech folks (across India & US) and complete development activities without any follow-ups required
What you'll do
- Understand the overall requirement & design of the Project engaged
- Work closely with tech leads in India & US to understand the existing data pipeline developed in Databricks,Pyspark & GCP
- Own development and enhancement work in the data pipeline (Databricks) and provide regular updates to leads
- Collaborate closely with product managers, data engineers, and stakeholders to translate business requirements into technical solution
- Experience designing and deploying data pipelines orchestration using Apache Airflow
What you need
- ETL
- Databricks
- Spark
- Kafka
- Airflow
- GCP