Sr. Data Engineer-Hadoop,Hive,Spark,Trino, Star Rocks, Clickhouse,Data engineering-3+yrs AI exposure

About the role

Sr. Data Engineers are responsible for collaborating with stakeholders, including product teams, business partners, and cybersecurity, to identify and clarify requirements for data-driven features and products. They independently understand the data ecosystem, security, privacy, and retention requirements necessary to support business and product features.

What you'll do

• Collaborate proactively with stakeholders to clarify requirements and identify key product stakeholders
• Translate functional requirements into architecture designs for one or more components, leveraging existing architecture design patterns
• Implement extensible, maintainable, and reusable code using appropriate coding patterns, guidelines, and best practices
• Provide end-to-end ownership of data products or data pipelines, including mitigation of technical debt and documentation of errors or unexpected bugs
• Identify and conduct required testing for moderately complex use cases, including unit testing, coding standards, and security scans

What you need

• 5–9 yrs of experience
• Hadoop
• Spark
• Hive
• SQL
• Python
• Machine learning
• MBA

Good to have

• ETL
• Java
• Git
• CI/CD
• LLMs
• Unit testing