Databricks - Technical Lead-Data Engg
HinjawadiFull-time2–3 yrsPosted 5 days ago
Junior data science role at Birlasoft in Hinjawadi. Needs 2–3 years.
About the role
Develop and maintain scalable data pipelines and build new Data Source integrations to support increasing data volume and complexity. Developing Modern Data Warehouse solutions using Azure Stack ( Azure Data Lake , Azure Databricks) and PySpark Develop batch processing and integration solutions and process Structured and Non-Structured Data
What you'll do
- Develop and maintain scalable data pipelines and build new Data Source integrations to support increasing data volume and complexity
- Developing Modern Data Warehouse solutions using Azure Stack ( Azure Data Lake , Azure Databricks) and PySpark
- Develop batch processing and integration solutions and process Structured and Non-Structured Data
- Collaborate and engage with BI & analytics and the business team
What you need
- Databricks
- SQL
- Spark
- ETL
- Data warehousing
- Azure