Specialist Software Engineer - Python + Spark - (26000KL6)

About the role

Senior‑level Software Engineer with deep Databricks, AWS, and Python data platform expertise, capable of designing and leading enterprise‑scale AI‑enabled data solutions.

What you'll do

• Design, develop, and maintain scalable data engineering solutions using Databricks, PySpark, SQL, and Delta Lake
• Build and optimize batch and real-time data pipelines on AWS using services such as S3, Lambda, Glue, EMR, Redshift, and related cloud-native components
• Develop, implement, and support Delta Live Tables (DLT) pipelines for reliable, high-quality, and auditable data processing
• Work with Unity Catalog to implement data governance, access control, lineage, and security best practices
• Develop and optimize ETL/ELT pipelines with a focus on performance tuning, scalability, reliability, and cost efficiency

What you need

• 5–8 yrs of experience
• Python
• Spark
• SQL
• ETL
• AWS
• Databricks
• Any graduate

Good to have

• Redshift
• Terraform
• CI/CD
• Root cause analysis
• Jenkins
• Git