Cloud Engineer/ Support Engineer - Cloud

About the role

job involves creating data pipelines using a configurable framework (developed using Databricks / pyspark), which are used to load data from multiple sources to Google Cloud. It also involves extensive collaboration with other team members (India & USA) to follow a plan, execute workflows, ensure data load accuracy and debug in case of issues.

What you'll do

• Design, develop, and implement robust, high-performance data pipelines using
• Databricks/PySpark to meet diverse data integration requirements. Understand
• Data and its relation / significance from business perspective
• Leverage extensive SQL expertise for complex data manipulation, analysis, and
• Create custom scripts in python / pyspark

What you need

• 7–12 yrs of experience
• Spark
• ETL
• GCP
• SQL
• BigQuery
• Airflow
• Any graduate

Good to have

• Python
• Hadoop
• Hive
• dbt
• Databricks