Azure Data Integration Engineer

About the role

The role involves building and managing data pipelines, troubleshooting issues, and ensuring data accuracy across various platforms such as Azure Synapse Analytics, Azure Data Lake Gen2, and SQL environments. This position requires extensive SQL experience and a strong background in PySpark development.

What you'll do

• Work with Azure Synapse Pipelines and PySpark for data transformation and pipeline management
• Perform data integration and schema updates in Delta Lake environments, ensuring smooth data flow and accurate reporting
• Work with our Azure DevOps team on CI/CD processes for deployment of Infrastructure as Code (IaC) and Workspace artifacts
• Develop custom solutions for our customers defined by our Data Architect and assist in improving our data solution patterns over time
• Document ticket resolutions, testing protocols, and data validation processes

What you need

• 5–9 yrs of experience
• Azure
• SQL
• ETL
• Spark
• Databricks
• Terraform
• Any graduate

Good to have

• CI/CD
• Microsoft Dynamics
• Customer success
• JIRA