Azure Big Data Engineer | 4 to 8 Yrs | WFO | SOW 2024 2579
BengaluruFull-time5–9 yrsPosted 1 week ago
Senior data science role at PradeepIT Consulting Services in Bengaluru. Needs 5+ years.
About the role
Overall 4 to 8 years of experience with a minimum 4+ years of relevant professional work experience. ADF, ETL Pipelines, Unity Catalog, Azure SQL Database, SQL Coding, Azure SQL Database, Azure Data Lake. Utilizing Azure Data Factory to create and maintain ETL (Extract, Transform, Load) operations using ADF pipelines.
What you'll do
- Design, implement, and maintain data pipelines for data ingestion, processing, and transformation in Azure
- Work together with data analysts to understand the needs for data and create effective data workflows
- Use ADF pipelines to orchestrate the end to end data transformation including the execution of DataBricks notebooks
- Creating and managing Azure infrastructure across the landscape using Bicep
- Implementing data validation and cleansing procedures will ensure the quality, integrity, and dependability of the data
What you need
- Azure
- SQL
- ETL
- Databricks
- Spark
- CI/CD
Good to have
- Power BI
- Power Automate
- PowerShell
- Azure Data Factory
- Unity