Data Engineer

About the role

This role is offered on a Contract-to-Hire basis , with an initial pre-defined contractual period. Upon successful completion of this period, the position is intended to transition to Burckhardt Compression’s permanent payroll . Develop and operate the Azure Databricks data platform and enterprise data lake for analytics, AI and production data products.

What you'll do

• Develop and operate the Azure Databricks data platform and enterprise data lake for analytics, AI and production data products
• Design, implement and optimize production-grade data pipelines and transformation workflows using Python, SQL, PySpark and, where required, Scala
• Translate business requirements into scalable ingestion, transformation, mapping and data-quality solutions
• Administer Databricks workspaces, Unity Catalog, identities, permissions, clusters, jobs and platform integrations
• Maintain the supporting Azure infrastructure, connectivity, security configuration and infrastructure-as-code deployments

What you need

• 5–8 years in data science & ai
• SQL
• Python
• Databricks
• Spark
• ETL
• MLOps
• B.Tech or B.E. or B.Sc or BCA or M.Tech or MCA or M.Sc

Good to have

• Azure
• Scala
• Terraform
• IoT
• CI/CD
• Power BI