Senior AI Data Engineer
BengaluruFull-time6–11 yrsPosted over a month ago
Senior data science role at UKG in Bengaluru. Needs 6+ years and a B.Sc, B.Tech or B.E..
About the role
We are looking for a Lead Data Engineer to lead the design, development, and operation of reliable, scalable data platforms and products. This role combines hands-on engineering with technical leadership, guiding a team to deliver secure, well-governed data pipelines and curated datasets for analytics, reporting, and AI use cases.
What you'll do
- Lead the architecture and delivery of scalable batch and streaming data pipelines, data products, and lakehouse solutions across cloud environments
- Translate business, reporting, analytics, and AI requirements into technical designs, data models, interfaces, and delivery plans
- Design ingestion and transformation patterns for relational databases, APIs, event streams, files, and cloud storage, including structured and semi-structured data
- Build and review production-grade data solutions using Python, PySpark, SQL, Spark, and platforms such as GCP BigQuery, Azure Databricks, and Azure Data Lake
- Establish reusable engineering patterns for orchestration, modular transformations, metadata, schema evolution, incremental processing, and backfills
What you need
- SQL
- Python
- ETL
- LLMs
- Spark
- Data modelling
Good to have
- Databricks
- BigQuery
- Azure
- GCP
- CI/CD
- Reconciliation