AWS Data and Integration Engineer
ChennaiFull-time3–7 yrsPosted 1 week ago
Mid-level software engineering role at Quantum Strides in Chennai. Needs 3+ years.
About the role
We are seeking a Data Engineer with strong AWS expertise to design, develop, and implement data pipelines and integrations for ingesting and processing data from various IWMS platforms into AWS RDS. This role requires expertise in building scalable, secure, and resilient data ingestion solutions using AWS-native services, along with the ability to create custom integration adapters using web services and serverless functions.
What you'll do
- Design and build data pipelines to extract, transform, and load (ETL) data from IWMS systems (e.g., TRIRIGA, ARCHIBUS, Planon) into AWS RDS
- Develop integration adapters using Web Services and custom functions leveraging Java or Python, as needed
- Utilize AWS services such as Lambda, Glue, Step Functions, S3, and others for data processing and orchestration
- Develop frameworks for batch and near real-time data ingestion, integrating with external and internal systems
- Implement industry best practices for data ingestion, auditing, error handling, Row-Level Security (RLS), and operational logging
What you need
- AWS
- Python
- Java
- SQL
- ERP
- ETL
Good to have
- Spark
- Hive