Senior Data Engineer

About the role

We are hiring a Senior Data Engineer to design, build, and optimize enterprise scale data platforms using Databricks, Python, and PySpark. This role focuses on developing high-performance batch and real-time data pipelines, implementing modern data engineering frameworks, and delivering reliable, governed data solutions that power analytics, reporting, and AI-driven applications across financial services ecosystems.

What you'll do

• Design, develop, and optimize large-scale batch and streaming data pipelines using Python, PySpark, Databricks, and cloud-native technologies
• Build and maintain scalable data processing workloads in Databricks with a strong focus on performance, reliability, cost optimization, and maintainability
• Develop robust dbt models using layered architecture, incremental processing, snapshots, macros, testing frameworks, and documentation standards
• Design and maintain Apache Airflow DAGs for workflow orchestration, operational monitoring, dependency management, retries, and observability
• Implement data governance, lineage, access controls, data quality validation, monitoring, and privacy standards across enterprise data platforms

What you need

• 7–12 yrs of experience
• Python
• SQL
• ETL
• Databricks
• Spark
• Data modelling
• B.Tech or B.E. or M.Tech

Good to have

• Terraform
• Capital markets
• AML
• Git
• Jenkins
• Docker