highlisted
Sign in

Data Engineer Advisor

NTT DATA Services·Bengaluru

Pay not stated10–18 yrsFull-time
Apply on NTT DATA Services' siteTrack your applications and see your fit: start free

Read from the company's own careers page; you apply on their site.

How well do you fit this job?

Upload your resume to see each requirement checked against your profile, in under a minute.

Check my fit
Hard to read?

About the role

The engineer will harden, extend and operate reusable migration frameworks developed during the POC, implement Spark/PySpark migration pipelines, integrate Cyber/tokenization services, implement migration controls and automated reconciliation, optimize Iceberg storage and troubleshoot PB-scale migration workloads.

What you'll do

  • Harden and extend a config-driven Python/PySpark migration framework capable of migrating thousands of Hadoop/Hive tables without table-specific code
  • Build reusable Hive metadata/schema discovery and migration-configuration components
  • Implement migration strategy selection including CTAS/bulk, partition-wise and chunk-wise processing based on table size, partition/file characteristics
  • Execute Hadoop/Hive → Apache Iceberg historical migrations at multi-TB/PB scale
  • Design migration patterns for small, medium, large and very-large tables

What you need

  • 10–18 years in data science & ai
  • SQL
  • Python
  • Spark
  • Hadoop
  • ETL
  • Airflow
  • Any graduate

Good to have

  • AWS
  • Reconciliation
  • CI/CD
  • Linux
  • PostgreSQL
  • Git

What you get

    Similar jobs

    Data Scientist - Computer Vision

    Philips·Bengaluru

    Can I apply
    Needs PhD · 7–10 yrs
    Pay
    Pay not stated
    Source
    From the company's careers page · today
    How to apply
    On Philips's site (Workday): account needed, ~10–15 min
    Early: posted 1 h ago on their own site

    Senior Software Engineer, AI Platform

    Thomson Reuters·Bengaluru, Hyderabad (hybrid)

    Can I apply
    Open to any education · 5–9 yrs
    Pay
    Pay not stated
    Source
    From the company's careers page · today
    How to apply
    On Thomson Reuters's site (Workday): account needed, ~10–15 min
    Early: posted 1 h ago on their own site

    IN_Senior Associate_ Data Engineering __ GCC _ Advisory _Bangalore

    PricewaterhouseCoopers Services·Bengaluru

    Can I apply
    Needs MBA or MCA or B.Tech · 5–8 yrs
    Pay
    Pay not stated
    Source
    From the company's careers page · today
    How to apply
    On PricewaterhouseCoopers Services's site (Workday): account needed, ~10–15 min
    Early: posted 1 h ago on their own site

    Principal Architect, AI Solutions

    Jones Lang LaSalle Building Operations·Bengaluru

    Can I apply
    Needs M.Sc or B.Tech or B.E. · 12–22 yrs
    Pay
    Pay not stated
    Source
    From the company's careers page · today
    How to apply
    On Jones Lang LaSalle Building Operations's site (Workday): account needed, ~10–15 min
    Early: posted 1 h ago on their own site