Lead Data Engineer
BengaluruFull-timeSenior levelPosted over a month ago
Senior data science role at PayU India in Bengaluru. Needs a B.Tech, B.E. or M.Sc.
About the role
Lead Data Engineer at PayU India. Design infrastructure for data, especially for but not limited to consumption in machine learning applications.
What you'll do
- Design infrastructure for data, especially for but not limited to consumption in machine learning applications
- Define database architecture needed to combine and link data, and ensure integrity across different sources
- Ensure performance of data systems for machine learning to customer-facing web and mobile applications using cutting-edge open source frameworks
- Work with large, fast, complex data sets to solve difficult, non-routine analysis problems, applying advanced data handling techniques if needed
- Build data pipelines, includes implementing, testing, and maintaining infrastructural components related to the data engineering stack
What you need
- Machine learning
- SQL
- Python
- Pandas
- ETL
- Data modelling
Good to have
- Physics
- AWS
- Spark
- Kafka
- Snowflake
- Airflow