Senior Data Engineer
BengaluruFull-timeHybrid7–12 yrsPosted 2 months ago
Senior data science role at Wissen Technology in Bengaluru. Needs 7–12 years and a B.Tech, B.E. or M.Tech. Hybrid.
About the role
We are hiring a Senior Data Engineer to design, build, and optimize enterprise scale data platforms using Databricks, Python, and PySpark. This role focuses on developing high-performance batch and real-time data pipelines, implementing modern data engineering frameworks, and delivering reliable, governed data solutions that power analytics, reporting, and AI-driven applications across financial services ecosystems.
What you'll do
- Design, develop, and optimize large-scale batch and streaming data pipelines using Python, PySpark, Databricks, and cloud-native technologies
- Build and maintain scalable data processing workloads in Databricks with a strong focus on performance, reliability, cost optimization, and maintainability
- Develop robust dbt models using layered architecture, incremental processing, snapshots, macros, testing frameworks, and documentation standards
- Design and maintain Apache Airflow DAGs for workflow orchestration, operational monitoring, dependency management, retries, and observability
- Implement data governance, lineage, access controls, data quality validation, monitoring, and privacy standards across enterprise data platforms
What you need
- Python
- SQL
- ETL
- Databricks
- Spark
- Data modelling
Good to have
- Terraform
- Capital markets
- AML
- Git
- Jenkins
- Docker