Big Data / PySpark Engineering Lead - Vice President
PuneFull-timeLead levelPosted over a month ago
Leadership data science role at Citi in Pune.
About the role
The Applications Development Technology Lead Analyst is a senior level position responsible for establishing and implementing new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to lead applications systems analysis and programming activities.
What you'll do
- Design and implement scalable, fault-tolerant batch and real-time data processing pipelines
- Develop robust data models and schema designs optimized for both performance and storage efficiency
- Evaluate and integrate emerging tools and frameworks (e.g., Spark, Flink, Kafka) into the existing stack
- Provide in-depth analysis with interpretive thinking to define issues and develop innovative solutions
What you need
- Spark
- Kafka