Software Engineering - Data, Lakehouse and AI Data Platform Engineer-Bangalore-Associate
BengaluruFull-time3–6 yrsPosted 5 days ago
Mid-level data science role at Goldman Sachs in Bengaluru. Needs 3+ years.
About the role
As a Data Engineer in the Lakehouse and AI Data Platform team, you will design, build, test and support data pipelines and curated datasets on the firm’s modern data platform. You will work across ingestion, transformation, modelling, optimisation and data quality, helping to deliver data products that are reliable, scalable and fit for purpose.
What you'll do
- Build, enhance and support batch and streaming data pipelines on the Lakehouse and AI data platform
- Refactor or modernise existing data flows where needed to improve reliability, performance and maintainability
- Where needed, build reusable tooling to improve delivery, consistency and operational support
- Ensure data pipelines are production-ready, well tested and operationally supportable
- Data Modelling and Curation
What you need
- SQL
- ETL
- Python
- Data modelling
- Spark
- Kafka
Good to have
- Snowflake
- Databricks
- Hadoop
- Reconciliation
- CI/CD
- Root cause analysis