Lead Data Engineer
BengaluruFull-timeHybrid6–8 yrsPosted open since jun 2025
Senior data science role at Arcana Analytics in Bengaluru. Needs 6–8 years. Hybrid.
About the role
As a Lead Data Engineer, you will take ownership of designing and delivering high-performance data platforms that enable analytics, AI/ML, and real-time insights across the organisation. You will mentor junior engineers, drive architectural decisions, and collaborate with stakeholders to align the data platform roadmap with business objectives.
What you'll do
- Lead the design and implementation of scalable and reliable data pipelines using Distributed Computing, Kafka, Airflow and Temporal
- Architect data solutions that support business analytics, and real-time processing
- Mentor and guide junior engineers, conducting code reviews and setting coding standards
- Collaborate with cross-functional teams to identify and solve data challenges
- Drive improvements in infrastructure, automation, and monitoring to enhance scalability and performance
What you need
- SQL
- Python
- Kafka
- AWS
- Spark
- GCP
Good to have
- CI/CD
- Scala
- Rust
- Kubernetes
- Docker
- Terraform