Databricks Data Engineer
HyderabadFull-time5–20 yrsPosted 3 months ago
Senior data science role at Syren Cloud Careers in Hyderabad. Needs 5+ years.
About the role
We are looking for an experienced Data Engineer with strong hands-on expertise in Databricks, AWS, Python, PySpark, and SQL to design, develop, and maintain scalable data engineering solutions. The ideal candidate will have experience building robust data pipelines, processing large datasets, implementing data transformation workflows, and working with cloud-based data platforms.
What you'll do
- Design, develop, and maintain scalable data pipelines using Databricks, PySpark, Python, and SQL
- Build and optimize ETL/ELT workflows for ingesting, processing, transforming, and loading structured and semi-structured data
- Develop and maintain data processing solutions using Apache Spark and Databricks
- Integrate Databricks with AWS services to build secure, scalable, and cost-effective data platforms
- Work with AWS services such as Amazon S3 and other relevant data services for data storage, ingestion, and processing
What you need
- Databricks
- SQL
- Python
- AWS
- ETL
- Spark
Good to have
- IAM
- CI/CD
- Test automation
- Unity
- Git
- Data modelling