Lead Data Engineer - Kafka
BengaluruFull-time6–8 yrsPosted over a month ago
Senior data science role at Relanto in Bengaluru. Needs 6–8 years.
About the role
We are looking for a Lead Data Engineer with strong hands-on experience in real-time data streaming, event processing, CDC, data integration, and modern data engineering. The Lead Data Engineer will be responsible for designing, developing, and maintaining highperformance data pipelines using Apache Flink, Apache Kafka, Debezium, CDC, ClickHouse, and Apache Airflow.
What you'll do
- Design, develop, and maintain real-time data pipelines using Apache Flink and Apache Kafka
- Develop production-grade streaming applications for high-volume and low-latency workloads
- Implement data transformation, filtering, enrichment, aggregation, and event processing
- Build reliable event-processing pipelines with appropriate error handling and recovery mechanisms
- Consume and publish events across Kafka topics
What you need
- Kafka
- SQL
- ETL
- Airflow
- CI/CD
- Root cause analysis
Good to have
- Python
- AWS
- Terraform
- GCP
- REST APIs
- Kubernetes