Sr. Data Engineer
Gurugram, HyderabadFull-time8–10 yrs40 L–₹45 L a yearPosted 2 months ago
Senior data science role at Minfy Technologies in Gurugram and Hyderabad. Needs 8–10 years and a B.Sc, B.Tech or B.E.. Pays ₹40–45 LPA.
About the role
We are seeking a highly skilled and experienced Data Engineer to join our dynamic data and analytics team. The ideal candidate will have strong technical skills in AWS data services and will be responsible for designing, developing, and implementing robust, insightful, data-intensive solutions on AWS.
What you'll do
- Design, build, and maintain scalable batch and streaming data pipelines using AWS Glue, Amazon EMR, Amazon Kinesis, and AWS Lambda
- Model and optimise analytical data stores in Amazon Redshift and S3-based data lakes, including partitioning, file-format, and query-performance tuning
- Implement CDC and ingestion patterns from operational databases and SaaS sources using AWS DMS, Glue connectors, and Kinesis
- Orchestrate and monitor pipeline workflows using Amazon MWAA (Managed Workflows for Apache Airflow), AWS Step Functions, and Amazon EventBridge
- Own data cataloguing, lineage, and fine-grained access control via AWS Glue Data Catalog and AWS Lake Formation
What you need
- Python
- AWS
- Spark
- SQL
- ETL
- Redshift
Good to have
- DynamoDB
- Terraform
- CI/CD
- GCP
- Azure
- Airflow