Data Engineer III - Data Engineering, Databricks, Model Serving, ML Ops, Data Architecture and modeling

About the role

You are responsible for developing, testing, and maintaining critical data pipelines and architectures across multiple technical areas within various business functions in support of the firm’s business objectives.

What you'll do

• Architects and maintains large-scale data pipelines using Apache Spark and related distributed computing frameworks
• Builds and optimizes both batch and streaming data workloads to support analytical and operational use cases
• Develops, optimizes, and productionizes notebooks, jobs, and workflows within the Databricks environment to support analytical and machine learning use cases
• Designs and implements data architecture and data modeling strategies, including dimensional models, lakehouse structures, and schema design that balance performance
• Writes and optimizes complex SQL queries for data transformation, validation, and performance tuning across large datasets

What you need

• 3–6 years in data science & ai
• MLOps
• Databricks
• Machine learning
• SQL
• Spark
• ETL
• Any graduate

Good to have

• Data modelling
• AWS
• Airflow
• Kafka
• CI/CD
• Test automation

What you get