highlisted
Sign in

Data Engineer Advisor

NTT Data·Bengaluru

Pay not stated10–18 yrsFull-time
Apply on NTT Data's siteTrack your applications and see your fit: start free

Read from the company's own careers page; you apply on their site.

How well do you fit this job?

Upload your resume to see each requirement checked against your profile, in under a minute.

Check my fit
Hard to read?

About the role

The engineer will harden, extend and operate reusable migration frameworks developed during the POC, implement Spark/PySpark migration pipelines, integrate Cyber/tokenization services, implement migration controls and automated reconciliation, optimize Iceberg storage and troubleshoot PB-scale migration workloads.

What you'll do

  • Harden and extend a config-driven Python/PySpark migration framework capable of migrating thousands of Hadoop/Hive tables without table-specific code
  • Build reusable Hive metadata/schema discovery and migration-configuration components
  • Implement migration strategy selection including CTAS/bulk, partition-wise and chunk-wise processing based on table size, partition/file characteristics
  • Execute Hadoop/Hive → Apache Iceberg historical migrations at multi-TB/PB scale
  • Design migration patterns for small, medium, large and very-large tables

What you need

  • 10–18 years in data science & ai
  • Python
  • SQL
  • Spark
  • Hadoop
  • ETL
  • Airflow
  • Any graduate

Good to have

  • AWS
  • Reconciliation
  • CI/CD
  • PostgreSQL
  • Linux
  • Git

Similar jobs

Junior Data Scincetist

Siemens Healthineers·Bengaluru

Can I apply
Needs M.Sc or B.Tech or B.E. · 3–6 yrs
Pay
Pay not stated
Source
From the company's careers page · today
How to apply
On Siemens Healthineers' site: account needed, ~10–15 min
Early: posted 1 h ago on their own site

Data Scientist - Computer Vision

Philips·Bengaluru

Can I apply
Needs PhD · 7–10 yrs
Pay
Pay not stated
Source
From the company's careers page · today
How to apply
On Philips' site (Workday): account needed, ~10–15 min
Early: posted 1 h ago on their own site

Senior Software Engineer, AI Platform

Thomson Reuters·Bengaluru, Hyderabad (hybrid)

Can I apply
Open to any education · 5–9 yrs
Pay
Pay not stated
Source
From the company's careers page · today
How to apply
On Thomson Reuters' site (Workday): account needed, ~10–15 min
Early: posted 1 h ago on their own site

IN_Senior Associate_ Data Engineering __ GCC _ Advisory _Bangalore

PricewaterhouseCoopers Services·Bengaluru

Can I apply
Needs MBA or MCA or B.Tech · 5–8 yrs
Pay
Pay not stated
Source
From the company's careers page · today
How to apply
On PricewaterhouseCoopers Services' site (Workday): account needed, ~10–15 min
Early: posted 1 h ago on their own site