Senior PySpark Python Data Engineer - Assistant Vice President

About the role

The Technical Data Analyst is a senior-level position responsible for bridging the gap between complex business requirements and technical data solutions, leveraging advanced analytical and technical skills to develop data-driven solutions, with a focus on regulatory reporting and liquidity risk initiatives.

What you'll do

• Consult with business clients to determine system functional specifications and partner with multiple management teams and other units to meet organizational objectives
• Define, document, and validate detailed data requirements, data flows, and data lineage for new or enhanced systems and applications
• Provide technical input during the development and implementation phases, including formulating and defining systems scope, data objectives
• Design and develop robust data models (conceptual, logical, physical) to support reporting, analytics, and business processes
• Prepare and curate data for AI/ML model development, working closely with AI engineers to ensure data quality, feature engineering, and model validation

What you need

• 8–12 yrs of experience
• Python
• Spark
• Machine learning
• SQL
• Data modelling
• AWS
• Any graduate

Good to have

• R
• Data warehousing
• Snowflake
• Hadoop
• Kafka
• Databricks