Senior Data Engineer

About the role

Senior Data Engineer at Metropolis. Collaborate with engineers, product managers, and data scientists to understand data needs, and develop end-to-end data pipelines, solutions, and foundational data sets.

What you'll do

• Collaborate with engineers, product managers, and data scientists to understand data needs, and develop end-to-end data pipelines, solutions, and foundational data sets
• Design and own the data architecture for large-scale projects, making informed decisions about design and operational trade-offs
• Build, launch, and optimize sophisticated data pipelines, data models, and visualizations that support diverse use cases across multiple products or domains
• Define and manage Service Level Agreements (SLAs) for all data sets within areas of ownership
• Implement data security models based on privacy requirements, ensure compliance with safeguards, address data quality issues, and evolve data governance processes

What you need

• 5–9 yrs of experience
• SQL
• ETL
• Python
• Snowflake
• Spark
• Data warehousing
• B.Sc or B.Tech or B.E. or BCA

Good to have

• Data modelling
• AWS
• dbt
• Airflow
• Git
• PostgreSQL