Azure Data Integration Engineer
RemoteFull-time5–9 yrsPosted 1 week ago
Senior data science role at ITC Worldwide. Needs 5+ years. Remote.
About the role
The role involves building and managing data pipelines, troubleshooting issues, and ensuring data accuracy across various platforms such as Azure Synapse Analytics, Azure Data Lake Gen2, and SQL environments. This position requires extensive SQL experience and a strong background in PySpark development.
What you'll do
- Work with Azure Synapse Pipelines and PySpark for data transformation and pipeline management
- Perform data integration and schema updates in Delta Lake environments, ensuring smooth data flow and accurate reporting
- Work with our Azure DevOps team on CI/CD processes for deployment of Infrastructure as Code (IaC) and Workspace artifacts
- Develop custom solutions for our customers defined by our Data Architect and assist in improving our data solution patterns over time
- Document ticket resolutions, testing protocols, and data validation processes
What you need
- Azure
- SQL
- ETL
- Spark
- Databricks
- Terraform
Good to have
- CI/CD
- Microsoft Dynamics
- Customer success
- JIRA