Senior Data Engineer
BengaluruFull-time6–10 yrsPosted 1 week ago
Senior data science role at NorthBay Solutions in Bengaluru. Needs 6–10 years and a B.Sc, B.Tech or B.E..
About the role
We are seeking an experienced Senior Data Engineer to design, develop, and manage modern data platforms, scalable data pipelines, and cloud-based analytics solutions. The ideal candidate will have strong hands-on expertise in Microsoft Azure Data Services, large-scale data processing, data warehousing, ETL/ELT frameworks, and cloud-native data architectures.
What you'll do
- Design, develop, and maintain scalable data platforms and data pipelines using Microsoft Azure services
- Build and optimize batch and real-time data ingestion frameworks for structured, semi-structured, and unstructured data sources
- Design and implement data lake, data warehouse, and lakehouse architectures to support analytics and reporting requirements
- Develop, manage, and optimize ETL/ELT pipelines using modern cloud-native data engineering practices
- Implement data transformation, cleansing, validation, and data quality frameworks to ensure data accuracy and consistency
What you need
- SQL
- ETL
- Data warehousing
- Machine learning
- Spark
- Azure Data Factory
Good to have
- Python
- Scala
- Java
- MLOps
- LLMs
- Databricks