Databricks Data Specialist - R01569707
BengaluruFull-timeJunior levelPosted 2 months ago
Data science role at Brillio in Bengaluru. Needs an M.Sc, B.Tech or B.E..
About the role
We are seeking a highly skilled Databricks Engineer to design, develop, and optimize scalable data engineering and analytics solutions on the Databricks Lakehouse Platform . The ideal candidate will possess strong expertise in Databricks, PySpark, and SQL , with hands-on experience building batch and real-time data pipelines, implementing Lakehouse architectures, and ensuring data governance and performance optimization.
What you'll do
- Design, develop, and maintain end-to-end data pipelines using Databricks and PySpark
- Build and implement Lakehouse architectures utilizing Bronze, Silver, and Gold data layers
- Develop and manage Delta Lake solutions with ACID transactions, schema enforcement, and data reliability features
- Create, monitor, and optimize Delta Live Tables (DLT) pipelines
- Implement scalable and efficient data ingestion processes using Auto Loader
What you need
- Databricks
- SQL
- ETL
- AWS
- Spark
- Airflow
Good to have
- Kafka
- Power BI
- Azure
- Unity
- Data modelling
- Azure Data Factory