Staff Data Engineer (8-10 years' exp - Java/Python, Scala, Spark, Hadoop)

About the role

Staff Data Engineers are expert problem-solvers and builders who design, implement, and improve software applications and systems. In this role, engineers spend a significant portion of their time coding, working hands-on with code, data, and modern tools—including AI-assisted development, cloud services, and automation frameworks—to deliver secure, scalable, and high-quality technology solutions that drive business outcomes in the fintech sector.

What you'll do

• Develop hybrid data pipelines that bridge legacy and modern ecosystems, enabling near real-time data access for analytics and AI applications
• Optimize existing SQL Server models (facts, dimensions, indexes, stored procedures) and design modern equivalents in Hadoop and Spark environments
• Build robust ETL/ELT frameworks to process transactional, behavioral, and unstructured data at scale
• Partner with the Agentic AI team to power RAG (Retrieval-Augmented Generation) pipelines, vector database integrations and LLM data provisioning
• Lead proof-of-concept (POC) initiatives to evaluate and integrate new data engineering technologies

What you need

• 8–10 yrs of experience
• Python
• Spark
• Hadoop
• Java
• Scala
• SQL
• B.Tech or B.E. or B.Sc or BCA or M.Tech or MCA or M.Sc

Good to have

• Azure Data Factory
• Snowflake
• Docker
• Terraform
• Jenkins
• ETL