Senior Data Engineer - AWS
HyderabadFull-time6–11 yrsPosted 3 months ago
Senior data science role at AuxoAI Engineering in Hyderabad. Needs 6+ years and an M.Sc, B.Tech or B.E..
About the role
Senior Data Engineer - AWS at AuxoAI Engineering. Design, develop, and maintain scalable data pipelines and ETL processes leveraging AWS services such as S3, Glue, EMR, Lambda, and Redshift.
What you'll do
- Design, develop, and maintain scalable data pipelines and ETL processes leveraging AWS services such as S3, Glue, EMR, Lambda, and Redshift
- Collaborate with data scientists and analysts to understand data requirements and implement solutions that support analytics and machine learning initiatives
- Optimize data storage and retrieval mechanisms to ensure performance, reliability, and cost-effectiveness
- Implement data governance and security best practices to ensure compliance and data integrity
- Troubleshoot and debug data pipeline issues, providing timely resolution and proactive monitoring
What you need
- AWS
- SQL
- ETL
- Python
- Redshift
- Data warehousing
Good to have
- Airflow
- Docker
- Kubernetes
- Machine learning
- NoSQL
- Java