Senior Data Engineer (Databricks, MLOps, AWS)

About the role

As a Senior Data Engineer you will contribute to the mission by creating solutions that will directly support informed decision-making and innovation by providing clean, protected, quality and auditable data from various sources into fit for purpose data products. Design, develop, test, deploy and monitor data pipelines in Databricks on AWS from a wide variety of data sources.

What you'll do

• Contribute to the mission by creating solutions that will directly support informed decision-making and innovation by providing clean, protected
• Design, develop, test, deploy and monitor data pipelines in Databricks on AWS from a wide variety of data sources
• Design, develop, test, deploy and monitor scalable code with PySpark and SQL in Databricks
• Identify opportunities to improve internal process through code optimisation and automation
• Build data quality dashboards, lineage flows / and or monitoring tools to utilize the data pipeline

What you need

• 3–6 yrs of experience
• AWS
• Databricks
• MLOps
• SQL
• ETL
• Python
• Any graduate

Good to have

• CI/CD
• Git
• Spark