Data Engineer (Databricks)

PradeepIT Consulting Services·Bengaluru

Pay not stated5–8 yrsFull-time

Apply on PradeepIT Consulting Services' site Track your applications and see your fit: start free

Read from the company's own careers page; you apply on their site.

How well do you fit this job?

Upload your resume to see each requirement checked against your profile, in under a minute.

Check my fit

Hard to read?

About the role

Control data processes and take corrective action when errors are identified. Corrective action may include executing a work around process and then identifying the cause and solution for data errors. You will lead projects that include other team members and participate in projects led by other team members.

What you'll do

Design and build data pipelines using Spark-SQL and PySpark in Azure Databricks
Design and build ETL pipelines using ADF
Build and maintain a Lakehouse architecture in ADLS / Databricks
Perform data preparation tasks including data cleaning, normalization, deduplication, type conversion etc
Work with DevOps team to deploy solutions in production environments