Lead Software Engineer - Cloudera Data Platform - IT (Information Technology) - Bangalore, India
BengaluruFull-time5–9 yrsPosted 2 weeks ago
Senior data science role at Societe Generale in Bengaluru. Needs 5+ years.
About the role
ResponsibilitiesDATA PLATFORM TECHNOLOGY / JOB DESCRIPTIONSenior Cloudera Data Platform, NiFi & Airflow Administrator Senior / Expert Level | Enterprise Data Platform OperationsShort Overview The Senior Cloudera, NiFi & Airflow Administrator is responsible for the administration, design, operation, reliability, security, and continuous improvement of enterprise data platform services.
What you'll do
- Operate and maintain enterprise data platforms Ensure secure, reliable, and stable operation, availability, performance, and resilience of Cloudera, Apache NiFi
- Administer Cloudera Data Platform services and supporting components, including Cloudera Manager, HDFS, YARN, Hive, Impala, Spark, Ranger, Atlas, Knox, ZooKeeper
- Manage service configuration, role placement, parcels and runtime versions, host maintenance, commissioning and decommissioning, rolling restarts, health checks
- Monitor and troubleshoot cluster health, HDFS and Ozone capacity, replication, under-replicated data, YARN queues, workload contention, Hive Metastore
- Administer data-platform security, including Kerberos integration, Ranger policies, Knox access, TLS certificates, keytabs, service identities
What you need
- Python
- SQL
- Airflow
- Hadoop
- Spark
- Kafka
Good to have
- Hive
- CI/CD
- Linux
- Root cause analysis
- REST APIs
- Terraform