Senior Data Engineer

About the role

BTVK Advisory is a leading advisory firm whose specialized professionals guide clients through an ever-changing business world, helping them win now and anticipate tomorrow. BTVK Advisory, and its affiliated entities, have operations in North America, South America, Europe, Asia, and Australia.

What you'll do

• Design, build, and maintain robust, scalable ETL/ELT pipelines on Azure Databricks to ingest, transform
• Ingest structured, semi-structured, and unstructured data from a wide range of source systems using custom streaming pipelines (Spark Structured Streaming, Auto Loader)
• Build and manage Unity Catalog assets (catalogs, schemas, tables, and Volumes) and configure or mount external locations/Volumes for governed access to cloud storage…
• Design and implement audit, control, and operational-metadata tables that capture pipeline run history, data lineage, record counts, data-quality outcomes
• Define and apply data governance strategies across the lakehouse — including access control, data classification, PII handling, lineage, retention

What you need

• 5–8 years in data science & ai
• Machine learning
• SQL
• Databricks
• Spark
• AWS
• MLOps
• B.Tech or B.E. or B.Sc or BCA

Good to have

• Statistics
• Data modelling
• Snowflake
• Redshift
• BigQuery
• Azure