Technical Leader - Software
PuneFull-time6–8 yrsPosted 1 week ago
Senior software engineering role at Altimetrik in Pune. Needs 6–8 years.
About the role
Databricks Runtime & Cluster Management- Preferred
What you'll do
- Design and develop scalable batch and near-real-time ETL/ELT pipelines using Snowflake (AWS) and Apache Spark (PySpark, Spark SQL, Structured Streaming)
- Build structured streaming pipelines using Kafka and Spark Structured Streaming
- Design dimensional data models (Fact/Dimension, SCD Type 2)
- Orchestrate pipelines using Databricks Workflows / Apache Airflow
- Integrate CI/CD pipelines using Jenkins, Git, Bitbucket/GitHub for automated deployment across DEV/UAT/PROD
What you need
- Spark
- Jenkins
- Git
- AWS
- Kafka
- SQL
Good to have
- Data warehousing
- Databricks
- Snowflake
- CI/CD
- ETL
- Airflow