Senior Data Engineer
BengaluruFull-time3–6 yrsPosted 1 week ago
Mid-level data science role at PayU India in Bengaluru. Needs 3+ years.
About the role
The team works on cutting-edge technologies and handles massive data volumes, ensuring seamless data flow from various sources to our data warehouse and analytics platforms. We play a crucial role in powering Machine Learning models across various use cases by building sophisticated feature engineering pipelines, deploying ML model infrastructure, and maintaining real-time feature generation systems.
What you'll do
- Partner closely with business stakeholders to understand and translate data warehouse requirements into technical solutions
- Provide comprehensive support for data warehouse initiatives including requirements gathering, solution design, and implementation
- Optimize data warehouse performance through query optimization, indexing strategies, and architectural improvements
- Design, develop, and maintain robust ETL/ELT pipelines using modern data engineering tools
- Implement real-time and batch data processing solutions to meet business requirements
What you need
- Machine learning
- SQL
- Data warehousing
- Python
- Spark
- Data modelling
Good to have
- AWS
- Redshift
- Airflow
- Hadoop
- ETL
- NoSQL