Java Spark developer
ChennaiFull-timeJunior levelPosted 1 week ago
Data science role at Citi in Chennai.
About the role
We are seeking an experienced and motivated Java Spark Developer to design, develop, and maintain high-performance, large-scale data processing pipelines and distributed applications. In this role, you will leverage Core Java and Apache Spark to build resilient batch and real-time streaming data architectures, optimize distributed data workloads, and collaborate with cross-functional teams including Data Scientists, Cloud Engineers, and Solution Architects.
What you'll do
- Leverage Core Java and Apache Spark to build resilient batch and real-time streaming data architectures, optimize distributed data workloads
- Design, implement, and maintain robust, scalable data ingestion and ETL/ELT pipelines using Apache Spark (Core, SQL
- Develop performant, low-latency microservices and distributed processing modules integrated with messaging platforms (e.g., Apache Kafka)
- Build and maintain interfaces to relational databases, distributed data lakes, and NoSQL stores (e.g., Hive, Cassandra, HBase, MongoDB, Delta Lake, Snowflake)
What you need
- Spark
- Java
- SQL
- ETL
- Kafka
- Snowflake
Good to have
- NoSQL
- MongoDB
- Scala
- Microservices
- Hive
- Cassandra