Associate Director, Data Platforms — Technical Lead

About the role

Associate Director, Data Platforms — Technical Lead at S&P Global. Data Pipeline Transition and Platform Delivery.

What you'll do

• Data Pipeline Transition and Platform Delivery
• Partner with the core Databricks team to plan and execute the transition of existing data pipelines to the target data platform
• Drive the implementation of repeatable engineering patterns for ingestion, transformation, testing, deployment, and monitoring across onboarded datasets
• Ensure pipelines are designed and managed in a way that supports long-term platform consistency, reliability, observability, and ease of support
• Amazon S3 for durable data lake storage

What you need

• 9–13 yrs of experience
• SQL
• ETL
• AWS
• Databricks
• LLMs
• Spark
• Any graduate

Good to have

• IAM
• Test automation
• CI/CD
• Unity
• Reconciliation
• Incident response