Sr. Data Engineer-Hadoop,Hive,Spark,Trino, Star Rocks, Clickhouse,Data engineering-3+yrs AI exposure
BengaluruFull-timeHybrid5–9 yrsPosted 1 week ago
Senior data science role at Visa Consolidated Support Services (India) Private Limited - Tech Unit in Bengaluru. Needs 5+ years and an MBA. Hybrid.
About the role
Sr. Data Engineers are responsible for collaborating with stakeholders, including product teams, business partners, and cybersecurity, to identify and clarify requirements for data-driven features and products. They independently understand the data ecosystem, security, privacy, and retention requirements necessary to support business and product features.
What you'll do
- Collaborate proactively with stakeholders to clarify requirements and identify key product stakeholders
- Translate functional requirements into architecture designs for one or more components, leveraging existing architecture design patterns
- Implement extensible, maintainable, and reusable code using appropriate coding patterns, guidelines, and best practices
- Provide end-to-end ownership of data products or data pipelines, including mitigation of technical debt and documentation of errors or unexpected bugs
- Identify and conduct required testing for moderately complex use cases, including unit testing, coding standards, and security scans
What you need
- Hadoop
- Spark
- Hive
- SQL
- Python
- Machine learning
Good to have
- ETL
- Java
- Git
- CI/CD
- LLMs
- Unit testing