highlisted
Sign in

Senior Databricks Engineer, Apache Spark and AWS - Vice President

Match Me Resume Match | Citi·Pune

Pay not stated10–18 yrsFull-time
Apply on Match Me Resume Match | Citi's siteTrack your applications and see your fit: start free

Read from the company's own careers page; you apply on their site.

How well do you fit this job?

Upload your resume to see each requirement checked against your profile, in under a minute.

Check my fit
Hard to read?

About the role

We are looking for a highly skilled Senior Databricks Engineer to contribute to the engineering, modernization, and continuous evolution of data processing platform on Databricks on AWS. While supporting the transition from the legacy Cloudera Hadoop platform to Databricks on AWS, this role will continue to play a key part in enhancing performance, simplifying pipelines, and delivering new capabilities on the Databricks platform over the long term.

What you'll do

  • Platform Engineering & Modernization
  • Refactor and modernize existing Spark pipelines to Databricks native architectures
  • Eliminate legacy Hadoop dependencies and adopt cloud native AWS patterns
  • Enhance and extend existing processing logic using optimized Spark (JavaSpark / PySpark) on Databricks
  • Build and optimize solutions using Databricks features, including Delta Lake, Databricks Workflows for orchestration and Auto scaling and job clusters

What you need

  • 10–18 yrs of experience
  • AWS
  • Databricks
  • Spark
  • SQL
  • Data modelling
  • Hadoop
  • Any graduate

Similar jobs

AI / ML Engineer

Accenture·Pune

Can I apply
Open to any education · 5–9 yrs
Pay
Pay not stated
Source
From the company's careers page · yesterday
How to apply
On Accenture's site: account needed, ~10–15 min

Unit Manager - Digital Platforms and Consumer AI

Bajaj Finance·Pune

Can I apply
Needs B.Tech or B.E. or B.Sc · 2–3 yrs
Pay
Pay not stated
Source
From the company's careers page · yesterday
How to apply
On Bajaj Finance's site: short form, ~5 min