Lead Software Engineer - Data Ingestion
BengaluruFull-time2–5 yrsPosted 4 weeks ago
Mid-level software engineering role at Societe Generale in Bengaluru. Needs 2+ years.
About the role
We are looking for a Medior Data Ingestion Specialist to support development, operation, and maintenance of data ingestion platform orchestrated by Apache Airflow. The role focuses on onboarding and maintaining data integrations from multiple source systems, troubleshooting operational issues, and supporting release and governance processes
What you'll do
- Data Integration & Pipeline Development
- Configure and maintain data ingestion pipelines
- Develop and support Python-based ingestion components
- Troubleshoot data flow, connectivity, and integration issues
- Ingestion to Databricks, Databricks loader
What you need
- Python
- SQL
- Git
- Kafka
- ETL
- Airflow
Good to have
- Elasticsearch
- CI/CD
- JIRA
- Linux
- AWS
- PostgreSQL