Lead Software Engineer - Cloudera Data Platform
BengaluruFull-time5–9 yrsPosted 4 weeks ago
Senior data science role at Societe Generale in Bengaluru. Needs 5+ years.
About the role
The Senior Cloudera, NiFi & Airflow Administrator is responsible for the administration, design, operation, reliability, security, and continuous improvement of enterprise data platform services. The role provides end-to-end administration of Cloudera Data Platform environments, Apache NiFi data-flow services, and Apache Airflow orchestration services across production and non-production environments.
What you'll do
- Operate and maintain enterprise data platforms
- Ensure secure, reliable, and stable operation, availability, performance, and resilience of Cloudera, Apache NiFi
- Design and evolve platform architecture
- Define and review high-availability concepts, disaster recovery arrangements, environment topology, service placement, integration patterns, configuration standards
- Provide senior-level troubleshooting and incident support
What you need
- Python
- SQL
- Airflow
- Hadoop
- Spark
- Kafka
Good to have
- Hive
- CI/CD
- Linux
- Root cause analysis
- REST APIs
- Terraform