Senior Data Engineer
BengaluruFull-time7–13 yrsPosted over a month ago
Senior data science role at Ethos Life in Bengaluru. Needs 7+ years.
About the role
This is a software engineering role with a deep data background. You will design and operate distributed workflow systems on Temporal and Airflow, build internal platform applications (including config-driven UIs that let teams author and run their own ingestion and transformation jobs), and write Python libraries that other engineers across the company consume.
What you'll do
- Build and operate internal data platforms, services, and distributed workflow systems (Temporal, Airflow) that the rest of the company's data stack runs on
- Write and maintain internal Python libraries (including shared Airflow operators and frameworks) consumed by other engineering teams
- Build and operate Temporal-based workflow systems for long-running, reliable distributed data workflows
- Build internal data platform applications, including config-driven UIs that enable users to author and run their own ingestion and transformation jobs
- Own cost governance across Snowflake, dbt Cloud, Airflow, and Kafka and other data platform services, including monitoring, alerting, and optimization initiatives
What you need
- Python
- SQL
- Data warehousing
- Data modelling
- ETL
- Machine learning
Good to have
- MLOps
- CI/CD
- Data structures
- Airflow
- Snowflake
- Go