Lead I - Data Engineering
Hyderabad, BengaluruFull-time5–7 yrsPosted 1 week ago
Senior data science role at UST in Hyderabad and Bengaluru. Needs 5–7 years and a B.Sc, B.Tech or B.E..
About the role
we have a opening for big data developer.
What you'll do
- Build and maintain batch and streaming data pipelines using Scala, Python, Spark, and PySpark
- Analyze, process, and transform large volumes of structured and unstructured data
- Develop and support distributed data processing frameworks and data ingestion platforms
- Integrate new data sources and tools into existing big data ecosystems. 6. Optimize performance of Spark, Hadoop, EMR, and distributed computing workloads
- Design and implement cloud-native APIs and microservices supporting data products and operational platforms
What you need
- Python
- AWS
- Spark
- Hadoop
- Data modelling
- Kafka
Good to have
- Airflow
- Machine learning
- DynamoDB
- LLMs
- Databricks
- Git