Specialist Software Engineer - Python + Spark - (26000KL6)
BengaluruFull-time5–8 yrsPosted 3 weeks ago
Senior data science role at Satincorp in Bengaluru. Needs 5–8 years.
About the role
Senior‑level Software Engineer with deep Databricks, AWS, and Python data platform expertise, capable of designing and leading enterprise‑scale AI‑enabled data solutions.
What you'll do
- Design, develop, and maintain scalable data engineering solutions using Databricks, PySpark, SQL, and Delta Lake
- Build and optimize batch and real-time data pipelines on AWS using services such as S3, Lambda, Glue, EMR, Redshift, and related cloud-native components
- Develop, implement, and support Delta Live Tables (DLT) pipelines for reliable, high-quality, and auditable data processing
- Work with Unity Catalog to implement data governance, access control, lineage, and security best practices
- Develop and optimize ETL/ELT pipelines with a focus on performance tuning, scalability, reliability, and cost efficiency
What you need
- Python
- Spark
- SQL
- ETL
- AWS
- Databricks
Good to have
- Redshift
- Terraform
- CI/CD
- Root cause analysis
- Jenkins
- Git