Data Engineer - Python, AI
PuneFull-timeJunior levelPosted 4 weeks ago
Data science role at Citi in Pune.
About the role
We are looking for a mid-level Python Developer with combined experience in Data Engineering and AI/NLP engineering. The candidate will build NLP pipelines using libraries such as Flair, BERT, and LLM frameworks, and will also work on large-scale data processing using PySpark, Pandas, and related data tools.
What you'll do
- Develop and optimize ETL/data processing jobs using PySpark, Pandas, PyArrow, and related libraries
- Build and maintain NLP pipelines using Flair, BERT, and LLM-based models
- Develop scalable ingestion and data transformation pipelines for AI and analytics use cases
- Build and maintain Flask-based APIs for model inference and service integrations
- Use regular expressions for text cleaning, parsing, and NLP preprocessing
What you need
- Python
- Pandas
- NLP
- LLMs
- Spark
- ETL
Good to have
- CI/CD
- Git