Cloud Engineer/ Support Engineer - Cloud
Bengaluru, Chennai, HyderabadFull-time7–12 yrsPosted 3 weeks ago
Senior IT support role at Ascendion in Bengaluru, Chennai and 1 more city. Needs 7–12 years.
About the role
job involves creating data pipelines using a configurable framework (developed using Databricks / pyspark), which are used to load data from multiple sources to Google Cloud. It also involves extensive collaboration with other team members (India & USA) to follow a plan, execute workflows, ensure data load accuracy and debug in case of issues.
What you'll do
- Design, develop, and implement robust, high-performance data pipelines using
- Databricks/PySpark to meet diverse data integration requirements. Understand
- Data and its relation / significance from business perspective
- Leverage extensive SQL expertise for complex data manipulation, analysis, and
- Create custom scripts in python / pyspark
What you need
- Spark
- ETL
- GCP
- SQL
- BigQuery
- Airflow
Good to have
- Python
- Hadoop
- Hive
- dbt
- Databricks