FBS - Elasticsearch Data Engineer (Medallion Architecture)
RemoteFull-time5–9 yrsPosted 5 months ago
Senior data science role at Capgemini. Needs 5+ years and a B.Sc, B.Tech or B.E.. Remote.
About the role
This role is key in enabling high-quality, business-ready datasets by leveraging modern data engineering technologies and orchestration practices.
What you'll do
- Design, build, and manage end-to-end data pipelines across the medallion architecture—specifically the bronze, silver (base vault with DBT and orchestration tools
- Ingest and process raw data using Spark and Amazon EMR for scalable, distributed computation
- Develop and automate data transformations for the base vault using DBT (Data Build Tool) to standardize and model data efficiently
What you need
- Elasticsearch
- AWS
- Python
- ETL
- Data modelling
- dbt
Good to have
- Spark
- Airflow
- Spring Boot
- IAM
- Java
- Kubernetes