Senior Data Engineer

About the role

This is a software engineering role with a deep data background. You will design and operate distributed workflow systems on Temporal and Airflow, build internal platform applications (including config-driven UIs that let teams author and run their own ingestion and transformation jobs), and write Python libraries that other engineers across the company consume.

What you'll do

• Build and operate internal data platforms, services, and distributed workflow systems (Temporal, Airflow) that the rest of the company's data stack runs on
• Write and maintain internal Python libraries (including shared Airflow operators and frameworks) consumed by other engineering teams
• Build and operate Temporal-based workflow systems for long-running, reliable distributed data workflows
• Build internal data platform applications, including config-driven UIs that enable users to author and run their own ingestion and transformation jobs
• Own cost governance across Snowflake, dbt Cloud, Airflow, and Kafka and other data platform services, including monitoring, alerting, and optimization initiatives

What you need

• 7–13 yrs of experience
• Python
• SQL
• Data warehousing
• Data modelling
• ETL
• Machine learning
• Any graduate

Good to have

• MLOps
• CI/CD
• Data structures
• Airflow
• Snowflake
• Go