IT_IT New Technologies_1 (100)

About the role

Design, develop, and maintain scalable data pipelines and systems. Work closely with data scientists and analysts to ensure data quality and availability. Implement data integration and transformation processes using PySpark and Python. Optimize and maintain SQL databases and queries. Collaborate with cross-functional teams to understand data requirements and deliver solutions.

What you'll do

• Design, develop, and maintain scalable data pipelines and systems
• Work closely with data scientists and analysts to ensure data quality and availability
• Implement data integration and transformation processes using PySpark and Python
• Optimize and maintain SQL databases and queries
• Collaborate with cross-functional teams to understand data requirements and deliver solutions

What you need

• 3–6 yrs of experience
• SQL
• Python
• ETL
• Spark
• B.Sc or B.Tech or B.E. or BCA

Good to have

• Databricks
• Azure
• AWS
• Data warehousing
• GCP