Process Manager

About the role

Design and develop end to end frameworks using patterns such as CDC, incremental processing, deduplication, SCD, and schema evolution. Design data models and processing frameworks that provide reliable, performant, and reusable datasets for analytics and downstream applications. Contribute to data governance, security, access control, and lineage using Databricks and Unity Catalog.

What you'll do

• Design and optimize high-volume batch and near-real-time data pipelines using PySpark, SQL, Python, Delta Lake, and Databricks workflows
• Design and develop end to end frameworks using patterns such as CDC, incremental processing, deduplication, SCD, and schema evolution
• Design data models and processing frameworks that provide reliable, performant, and reusable datasets for analytics and downstream applications
• Contribute to data governance, security, access control, and lineage using Databricks and Unity Catalog
• Drive engineering best practices including Git, code reviews, automated testing, CI/CD, documentation, and production support

What you need

• 3–6 years in operations
• SQL
• Databricks
• ETL
• LLMs
• Spark
• Machine learning
• Any graduate

Good to have

• Python
• Terraform
• Test automation
• CI/CD
• Data warehousing
• Unity