Lead II - Data Engineering
Pune, ThiruvananthapuramFull-time7–9 yrsPosted 1 week ago
Senior data science role at UST in Pune and Thiruvananthapuram. Needs 7–9 years.
About the role
Responsibilities * Develop and maintain real-time data pipelines using Apache Kafka (MSK or Confluent) and AWS services. * Configure and manage Kafka connectors, ensuring seamless data flow and integration across systems. * Demonstrate a strong understanding of the Kafka ecosystem, including producers, consumers, brokers, topics, and schema registry. * Design and implement scalable ETL/ELT workflows to process large volumes of data efficiently. * Optimize data lake and data warehouse solutions…
What you need
- Python
- SQL
- AWS
- CI/CD
- Kafka
- ETL
Good to have
- Data warehousing
- Java
- Terraform