Senior Data Engineer (Azure Databricks)
BengaluruContractHybrid6–8 yrs1.5 L a yearPosted 1 week ago
Senior data science contract role at Talproindia in Bengaluru. Needs 6–8 years. Hybrid; pays ₹1.5 LPA.
About the role
Talpro is seeking a Senior Data Engineer (Azure Databricks) for an internal position to be deployed at a client location. This is a 6-month contract-to-hire role – if you excel during the contract, there is potential to transition into a permanent position. You will be on Talpro’s payroll and work with the client’s team in Bangalore.
What you'll do
- This includes building both streaming and batch data processes to handle large-scale data in real time and in bulk
- Perform Spark performance tuning and optimization to ensure data pipelines are efficient and cost-effective
- Provide technical guidance on complex data problems (including handling geospatial data) using Spark DataFrames and other big data tools
- Integrate end-to-end data pipelines from source systems to target data repositories (data lakes/data warehouses), ensuring consistency, quality
- Evaluate various tools and technologies (e.g., Azure Data Factory, Azure Databricks features, etc.) against project requirements to recommend the best fit
What you need
- Databricks
- ETL
- Python
- Spark
- Azure
- Azure Data Factory
Good to have
- Puppet
- Terraform
- Data warehousing
- Informatica
- Kafka
- CI/CD