Data Engineer Advisor
BengaluruFull-time3–6 yrsPosted 3 weeks ago
Mid-level data science role at NTT Data in Bengaluru. Needs 3+ years.
About the role
The Databricks Data Engineer will design, build, test, and maintain scalable data pipelines and data products within the Databricks Lakehouse platform. The role will focus on ingesting, transforming, governing, and optimising data while adhering to engineering best practices and platform standards.
What you'll do
- Build and maintain data pipelines within Databricks
- Understand the latesta Databricks data processing capabilities
- Develop ingestion frameworks for batch and streaming workloads
- Create reliable, scalable, and reusable data products
- Implement medallion architecture patterns
What you need
- SQL
- ETL
- Databricks
- AWS
- Spark
- Terraform
Good to have
- Machine learning
- Kafka
- CI/CD
- Git