Software Engineer - Azure Databricks Job
HyderabadFull-time3–6 yrsPosted 4 weeks ago
Mid-level data science role at Yash Technologies in Hyderabad. Needs 3+ years and an M.Sc, B.Tech or B.E..
About the role
We are seeking an experienced Azure Databricks/ADF/AI Data Engineer with 3 to 6 years of hands-on experience in designing, developing, and maintaining scalable data and AI solutions on Microsoft Azure. The ideal candidate should possess strong expertise in data engineering, Azure cloud services, AI/ML integration, data pipelines, and modern analytics platforms to support business intelligence and AI-driven applications.
What you'll do
- Design, develop, and maintain scalable data pipelines using Azure services
- Build and optimize ETL/ELT workflows for structured and unstructured data
- Implement data ingestion solutions using Azure Data Factory, Azure Databricks, and Azure Synapse Analytics
- Develop and manage data lakes and data warehouse solutions on Azure
- Integrate AI and Machine Learning services such as Azure AI Services, Azure OpenAI, Azure Machine Learning, and Cognitive Services into enterprise applications
What you need
- Databricks
- Azure
- Machine learning
- SQL
- Python
- Azure Data Factory
Good to have
- LLMs
- Spark
- ETL
- Data warehousing
- Terraform
- CI/CD