Lead I - Data Engineering

About the role

we have a opening for big data developer.

What you'll do

• Build and maintain batch and streaming data pipelines using Scala, Python, Spark, and PySpark
• Analyze, process, and transform large volumes of structured and unstructured data
• Develop and support distributed data processing frameworks and data ingestion platforms
• Integrate new data sources and tools into existing big data ecosystems. 6. Optimize performance of Spark, Hadoop, EMR, and distributed computing workloads
• Design and implement cloud-native APIs and microservices supporting data products and operational platforms

What you need

• 5–7 years in data science & ai
• Python
• AWS
• Spark
• Hadoop
• Data modelling
• Kafka
• B.Sc or B.Tech or B.E. or BCA

Good to have

• Airflow
• Machine learning
• DynamoDB
• LLMs
• Databricks
• Git