Senior Data Engineer
MumbaiFull-time6–11 yrsPosted 5 days ago
Senior data science role at YG Research in Mumbai. Needs 6+ years.
About the role
As Senior Data Engineer, you will be an advanced-level professional responsible for the data pipelines, models and Fabric architecture that underpin the company's reporting and analytics. You will work autonomously on complex data engineering assignments, determine methods and procedures on new work, provide technical direction and mentoring to more junior engineers.
What you'll do
- Design and implement scalable data pipelines and ETL/ELT processes using Microsoft Fabric to deliver reliable, timely data for reporting
- Build and maintain data warehouse, data lake and lakehouse architectures within the Fabric ecosystem, implementing OneLake integration patterns
- Develop and optimise semantic models for performance and scalability, applying DAX and data-model best practices
- Determine methods and procedures on new data engineering assignments, evaluating complex and variable factors to select the right approach
- Leverage Fabric workloads (Data Factory, Synapse Data Engineering, Data Warehouse) and Spark notebooks for large-scale data processing
What you need
- SQL
- Python
- ETL
- Data warehousing
- Databricks
- Spark
Good to have
- Data modelling
- Azure Data Factory
- Power BI
- Azure
- DAX
- Data privacy