Data Engineer

Match Me Resume Match | Citi·Pune

Pay not stated2–5 yrsFull-time

Apply on Match Me Resume Match | Citi's site Track your applications and see your fit: start free

Read from the company's own careers page; you apply on their site.

How well do you fit this job?

Upload your resume to see each requirement checked against your profile, in under a minute.

Check my fit

Hard to read?

About the role

Citi is seeking a Applications Development Programmer Analyst 2 (C10) to join its Technology – Data Engineering function, focused on the PySpark / Spark-based Data Platform. In this role, you will design, develop, and maintain scalable data pipelines and analytical solutions, supporting large-scale data operations across enterprise systems.

What you'll do

Design, develop, test, and maintain PySpark and Apache Spark data pipelines for batch and streaming workloads
Manage and monitor Spark Streaming Jobs (running Sunday evening through Saturday afternoon) performing Eligibility and Data Quality (DQ) checks
Manage and monitor Spark Batch Jobs (running hourly or every 2 hours) that store audit, inbound, and outbound data into Hive tables (e.g., gfolyreg_managed.SWXPTT_audit)
Respond to ITRS Alerts and system monitoring events (e.g., job failures, kills, or jobs not triggered within 30 minutes of scheduled time)
Work with large-scale data sources across Oracle, Hadoop, Impala, and SAS Server