Big Data / PySpark Engineering Lead - Vice President

About the role

The Applications Development Technology Lead Analyst is a senior level position responsible for establishing and implementing new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to lead applications systems analysis and programming activities.

What you'll do

• Design and implement scalable, fault-tolerant batch and real-time data processing pipelines
• Develop robust data models and schema designs optimized for both performance and storage efficiency
• Evaluate and integrate emerging tools and frameworks (e.g., Spark, Flink, Kafka) into the existing stack
• Provide in-depth analysis with interpretive thinking to define issues and develop innovative solutions

What you need

• Spark
• Kafka
• Any graduate