Data Engineers Expert
PuneFull-time6–10 yrsPosted 1 week ago
Senior data science role at KPIT Technologies in Pune. Needs 6–10 years.
About the role
We are looking for an experienced Data Engineer (5+ years) with strong hands‑on expertise in building high‑performance data pipelines for a heavy data analytics environment. The ideal candidate must excel in Spark (PySpark/Scala), complex SQL, data lake architectures, and data warehouse modeling.
What you'll do
- Data Pipeline & ETL/ELT Development
- Develop and optimize Spark (PySpark/Scala) pipelines
- Build scalable batch and near real‑time pipelines
- Apply Delta Lake optimization, partitioning, caching, and performance tuning
- Write complex aggregation logic (window functions, grouping sets, analytical functions)
What you need
- SQL
- Python
- Data warehousing
- ETL
- Spark
- Databricks
Good to have
- Airflow
- dbt
- CI/CD
- Snowflake
- AWS
- Data modelling