Data Engineer (ETL Specialist)

About the role

BOT VFX, a visual effects services company with global clients, is looking for a Data Engineer (ETL Specialist) as a full-time contract role. This is strictly an on location role in Chennai, India. In this role, you will be responsible for transforming petabytes of unstructured, legacy VFX data (including heavy video plates, multi-layered OpenEXR sequences, and proprietary DCC workfiles) into highly structured, sanitized, and compressed datasets.

What you'll do

• Lead the architecture, implementation, and automation of scalable ETL/ELT pipelines capable of moving and processing tens of terabytes of unstructured media data daily
• Implement automated "Purge & Keep" business rulesets to systematically clean directory trees, wiping intermediate render caches, temporary scratch files
• Build high-throughput processing pipelines to transcode, compress, and restructure massive image sequences (linear EXR
• Integrate and normalize lightweight metadata scrapings (camera telemetry, tracking curves, geometry tags) extracted from VFX workfiles (Silhouette
• Establish robust data quality assurance (QA) validation loops within the pipeline to catch corrupted frames, missing frame ranges

What you need

• ETL
• Python
• Computer vision
• Spark
• Shell scripting
• Bash

Good to have

• Docker
• Kubernetes
• Data structures