Data Product Manager

About the role

Job SummaryWe are seeking a Senior Databricks Data Engineer with 6+ years of data engineering experience to design and scale our next-generation data platform.In this role, you will be the technical lead for our Databricks on AWS ecosystem.You will architect robust, cost-effective pipelines that ingest, process, and serve massive datasets to power our analytical and AI initiatives.You will work natively with AWS services, enforce strict governance, and ensure our infrastructure is optimized for…

What you'll do

• Design and scale production pipelines using PySpark, SQL, and Delta Live Tables (DLT) for both high-throughput batch and real-time streaming data
• Ingest diverse data streams by integrating Databricks with AWS messaging systems like Amazon Kinesis or Managed Streaming for Apache Kafka (MSK)
• Optimize Lakehouse storage layouts by leveraging Delta features such as Liquid Clustering, Z-Ordering, and data compaction
• Manage infrastructure security by configuring security roles and personas Optimize cloud spend by managing Databricks clusters
• Integrate security frameworks utilizing AWS Secrets Manager to securely handle pipeline credentials and API keys.DevOps & Engineering Excellence Azure DevOps via Git…

What you need

• 6–11 yrs of experience
• SQL
• AWS
• ETL
• Unit testing
• CI/CD
• IAM
• Any graduate

Good to have

• Databricks
• Spark
• Kafka
• Unity
• Azure
• Git