Staff Data Engineer (8-10 years' exp - Java/Python, Scala, Spark, Hadoop)
BengaluruFull-timeHybrid8–10 yrsPosted over a month ago
Senior data science role at Visa Consolidated Support Services (India) Private Limited - Tech Unit in Bengaluru. Needs 8–10 years and a B.Tech, B.E. or B.Sc. Hybrid.
About the role
Staff Data Engineers are expert problem-solvers and builders who design, implement, and improve software applications and systems. In this role, engineers spend a significant portion of their time coding, working hands-on with code, data, and modern tools—including AI-assisted development, cloud services, and automation frameworks—to deliver secure, scalable, and high-quality technology solutions that drive business outcomes in the fintech sector.
What you'll do
- Develop hybrid data pipelines that bridge legacy and modern ecosystems, enabling near real-time data access for analytics and AI applications
- Optimize existing SQL Server models (facts, dimensions, indexes, stored procedures) and design modern equivalents in Hadoop and Spark environments
- Build robust ETL/ELT frameworks to process transactional, behavioral, and unstructured data at scale
- Partner with the Agentic AI team to power RAG (Retrieval-Augmented Generation) pipelines, vector database integrations and LLM data provisioning
- Lead proof-of-concept (POC) initiatives to evaluate and integrate new data engineering technologies
What you need
- Python
- Spark
- Hadoop
- Java
- Scala
- SQL
Good to have
- Azure Data Factory
- Snowflake
- Docker
- Terraform
- Jenkins
- ETL