Senior Big Data Administrator
ChennaiFull-time5–8 yrsPosted 3 weeks ago
Senior data science role at Larsen & Toubro in Chennai. Needs 5–8 years and a B.Tech or B.E..
About the role
We are seeking an experienced Senior Big Data Platform Administrator to manage and support ecosystem, Linux administration, distributed systems, and platform monitoring tools. This role involves ensuring platform performance, availability, scalability, and security across production and non-production environments.
What you'll do
- Administer and support Hadoop ecosystem components (HDFS, YARN) across Production
- Test, and Development environments
- Manage and maintain Apache Spark and Airflow infrastructure
- Monitor cluster health, troubleshoot performance issues, and optimize system performance
- Implement and maintain High Availability (HA), Disaster Recovery (DR), backup, and
What you need
- Python
- Hadoop
- Spark
- Airflow
- Linux
- Elasticsearch
Good to have
- CI/CD
- Prometheus
- Grafana
- Root cause analysis