Data/ETL Engineer

About the role

The below mentioned is the illustrated job description, that we should refer to for a Data Engineer Profile, (highlighted are the key skills we need)- The ideal candidate will have expertise in Glue, Data Catalog, Athena, DynamoDB, Lambda, S3, RDS (PostgreSQL), ECS, SQS, SNS, CloudFront, and IAM roles.

What you'll do

• Develop, deploy, and manage scalable ETL/ELT pipelines using AWS Glue and PySpark
• Work with AWS Data Catalog for metadata management and data discovery
• Optimize query performance and data analysis workflows using AWS Athena
• Implement serverless data workflows using AWS Lambda for real-time and batch data processing
• Design and manage relational databases on AWS RDS (PostgreSQL) and non-relational databases on DynamoDB

What you need

• 6–11 yrs of experience
• ETL
• Python
• SQL
• AWS
• Spark
• Terraform
• Any graduate

Good to have

• DynamoDB
• PostgreSQL
• IAM
• Git
• CI/CD