Data Engineer II

About the role

The Amazon ShipTech Analytics organization is looking for a smart and ambitious individual to support the development of analytical tools and data processing solutions for the Amazon transportation business. This role will work within a multi-functional BI and data engineering team with a focus on AMXL (Amazon Extra Large) and other rapidly growing delivery programs where Amazon is innovating to find new ways to deliver to our customers.

What you'll do

• Build end-to-end data pipelines to ingest and transform data from different types of data sources and systems; from traditional ETL pipelines to event data streams
• Evaluate and implement various big-data technologies and solutions (e.g. Redshift, Hive/EMR, Spark, SNS, SQS, Kinesis) to optimize processing of extremely large datasets
• Write high performing and optimized SQL queries
• Execute research projects, and generate practical results and recommendations
• Design and implement automated data processing solutions and data quality controls

What you need

• 3–6 years in data science & ai
• SQL
• ETL
• Python
• Data modelling
• Spark
• Hadoop
• M.Sc or B.Tech or B.E. or B.Sc or BCA or M.Tech or MCA

Good to have

• AWS
• Statistics
• IAM
• Hive
• Warehouse operations
• Node.js