Pyspark Engineer

About the role

We are seeking an experienced and results-driven PySpark / Big Data Engineer to design, develop, and maintain large-scale batch and real-time data pipelines. In this role, you will be responsible for transforming complex raw data into actionable analytical data models, optimizing distributed computing workloads, and ensuring data integrity, scalability, and security across enterprise data platforms.

What you'll do

• Be responsible for transforming complex raw data into actionable analytical data models, optimizing distributed computing workloads, and ensuring data integrity
• Design and implement Lakehouse architectures using formats such as Delta Lake, Apache Iceberg, or Apache Hudi
• Build reusable frameworks and data ingestion libraries to standardize enterprise data processing

What you need

• Spark
• ETL