Data Engineer
ThaneFull-time3–5 yrsPosted 2 weeks ago
Mid-level data science role at IDFC FIRST Bank in Thane. Needs 3–5 years and a B.Tech, B.E. or B.Sc.
About the role
The AWS DevOps Engineer will work closely with the Data Engineering and Analytics teams to set up and manage daily business-processing pipelines. The role is responsible for building and maintaining a highly available AWS cloud platform that enables deeper analysis and reporting for the Data and Analytics function.
What you'll do
- Build, manage and automate the AWS cloud platform to support scalable and highly available data-processing workloads
- Create and maintain end-to-end continuous integration and continuous delivery pipelines using Jenkins and other relevant tools
- Manage source code through Git and support controlled production deployments
- Work with Data Engineering and Analytics teams to set up, monitor and optimise daily business-processing pipelines
- Support infrastructure management, operational controls and audit requirements for the cloud platform
What you need
- Python
- AWS
- Shell scripting
- Jenkins
- Git
- ETL
Good to have
- Airflow