GCP Platform Engineer (ID 1394)
RemoteFull-time4–5 yrsPosted over a month ago
Mid-level DevOps and cloud role at Marketscope. Needs 4–5 years. Remote.
About the role
Support production of GCP data pipelines and workflows across batch and streaming workloads. Troubleshoot failures, data latency, performance and configuration issues. Work with Cloud Spanner, BigQuery, Dataflow, Pub/Sub and related GCP services. Optimize existing pipelines to improve data refresh times and reliability.
What you'll do
- Support production of GCP data pipelines and workflows across batch and streaming workloads
- Troubleshoot failures, data latency, performance and configuration issues
- Work with Cloud Spanner, BigQuery, Dataflow, Pub/Sub and related GCP services
- Optimize existing pipelines to improve data refresh times and reliability
- Support platform/configuration upgrades and ensure environments remain compliant
What you need
- GCP
- Python
- BigQuery
- SQL
- IAM
- ETL
Good to have
- LLMs
- Tableau
- Looker