Sr Data Engineer
HyderabadFull-timeSenior levelPosted over a month ago
Senior data science role at Amgen in Hyderabad.
About the role
Implement real-time and batch data processing solutions, integrating data from multiple sources into a unified, governed data fabric architecture. Optimize big data processing frameworks using Apache Spark, Hadoop, or similar distributed computing technologies to ensure high availability and cost efficiency.
What you'll do
- Implement real-time and batch data processing solutions, integrating data from multiple sources into a unified, governed data fabric architecture
- Work with metadata management and data lineage tracking tools to enable enterprise-wide data discovery and governance
- Ensure data security, compliance, and role-based access control (RBAC) across data environments
- Optimize query performance, indexing strategies, partitioning, and caching for large-scale data sets
What you need
- Spark
- Hadoop