Lead Software Engineer - Cloudera Data Platform - IT (Information Technology) - Bangalore, India

About the role

ResponsibilitiesDATA PLATFORM TECHNOLOGY / JOB DESCRIPTIONSenior Cloudera Data Platform, NiFi & Airflow Administrator Senior / Expert Level | Enterprise Data Platform OperationsShort Overview The Senior Cloudera, NiFi & Airflow Administrator is responsible for the administration, design, operation, reliability, security, and continuous improvement of enterprise data platform services.

What you'll do

• Operate and maintain enterprise data platforms Ensure secure, reliable, and stable operation, availability, performance, and resilience of Cloudera, Apache NiFi
• Administer Cloudera Data Platform services and supporting components, including Cloudera Manager, HDFS, YARN, Hive, Impala, Spark, Ranger, Atlas, Knox, ZooKeeper
• Manage service configuration, role placement, parcels and runtime versions, host maintenance, commissioning and decommissioning, rolling restarts, health checks
• Monitor and troubleshoot cluster health, HDFS and Ozone capacity, replication, under-replicated data, YARN queues, workload contention, Hive Metastore
• Administer data-platform security, including Kerberos integration, Ranger policies, Knox access, TLS certificates, keytabs, service identities

What you need

• 5–9 years in data science & ai
• Python
• SQL
• Airflow
• Hadoop
• Spark
• Kafka
• Any graduate

Good to have

• Hive
• CI/CD
• Linux
• Root cause analysis
• REST APIs
• Terraform