Lead Data Engineer

About the role

Lead Data Engineer at PayU India. Design infrastructure for data, especially for but not limited to consumption in machine learning applications.

What you'll do

• Design infrastructure for data, especially for but not limited to consumption in machine learning applications
• Define database architecture needed to combine and link data, and ensure integrity across different sources
• Ensure performance of data systems for machine learning to customer-facing web and mobile applications using cutting-edge open source frameworks
• Work with large, fast, complex data sets to solve difficult, non-routine analysis problems, applying advanced data handling techniques if needed
• Build data pipelines, includes implementing, testing, and maintaining infrastructural components related to the data engineering stack

What you need

• Machine learning
• SQL
• Python
• Pandas
• ETL
• Data modelling
• B.Tech or B.E. or M.Sc or PhD or B.Sc or BCA

Good to have

• Physics
• AWS
• Spark
• Kafka
• Snowflake
• Airflow