SME - Python

About the role

We are seeking a highly skilled Senior Data Engineer with expertise in Databricks, PySpark, Python, and Big Data technologies. The ideal candidate will have hands-on experience building scalable data platforms, developing high-performance data pipelines, and implementing modern data architectures using Databricks Lakehouse.

What you'll do

• Design, develop, and maintain scalable data pipelines and ETL/ELT solutions
• Build and optimize batch and streaming data processing solutions using PySpark and Databricks
• Implement and manage Medallion Architecture (Bronze, Silver, Gold layers) for data transformation and consumption
• Configure and manage Unity Catalog for centralized governance, access control, and data lineage
• Develop robust data engineering solutions using Python and Spark frameworks

What you need

• 1–3 years in software engineering
• Python
• AWS
• ETL
• Data warehousing
• GCP
• Databricks
• Any graduate

Good to have

• Spark
• Azure