Databricks Data Engineer

About the role

We are looking for an experienced Data Engineer with strong hands-on expertise in Databricks, AWS, Python, PySpark, and SQL to design, develop, and maintain scalable data engineering solutions. The ideal candidate will have experience building robust data pipelines, processing large datasets, implementing data transformation workflows, and working with cloud-based data platforms.

What you'll do

• Design, develop, and maintain scalable data pipelines using Databricks, PySpark, Python, and SQL
• Build and optimize ETL/ELT workflows for ingesting, processing, transforming, and loading structured and semi-structured data
• Develop and maintain data processing solutions using Apache Spark and Databricks
• Integrate Databricks with AWS services to build secure, scalable, and cost-effective data platforms
• Work with AWS services such as Amazon S3 and other relevant data services for data storage, ingestion, and processing

What you need

• 5–20 yrs of experience
• Databricks
• SQL
• Python
• AWS
• ETL
• Spark
• Any graduate

Good to have

• IAM
• CI/CD
• Test automation
• Unity
• Git
• Data modelling