Senior Data Engineer (Azure Databricks)

About the role

Talpro is seeking a Senior Data Engineer (Azure Databricks) for an internal position to be deployed at a client location. This is a 6-month contract-to-hire role – if you excel during the contract, there is potential to transition into a permanent position. You will be on Talpro’s payroll and work with the client’s team in Bangalore.

What you'll do

• This includes building both streaming and batch data processes to handle large-scale data in real time and in bulk
• Perform Spark performance tuning and optimization to ensure data pipelines are efficient and cost-effective
• Provide technical guidance on complex data problems (including handling geospatial data) using Spark DataFrames and other big data tools
• Integrate end-to-end data pipelines from source systems to target data repositories (data lakes/data warehouses), ensuring consistency, quality
• Evaluate various tools and technologies (e.g., Azure Data Factory, Azure Databricks features, etc.) against project requirements to recommend the best fit

What you need

• 6–8 years in data science & ai
• Databricks
• ETL
• Python
• Spark
• Azure
• Azure Data Factory
• Any graduate

Good to have

• Puppet
• Terraform
• Data warehousing
• Informatica
• Kafka
• CI/CD

What you get

• ₹1.5 L a year