Apache Spark Technical Specialist - Scala, Python

About the role

Ingestion mechanism like Flume & Kafka. Data modelling – Dimensional modelling using RDBMS, NO-SQL and Big Data technologies. Big data – Hadoop eco-system, Distributions like Cloudera / Hortonworks, Pig and HIVE. Data processing frameworks – Scala/python/Spark. Data Platform administration for Hadoop, Elastic, Oracle.

What you'll do

• Develop and implement data processing applications using apache spark, scala, and python
• Design and maintain scalable data pipelines to process large volumes of data efficiently
• Perform data analysis and optimization to enhance the performance of data processing tasks
• Collaborate with cross functional teams to understand business requirements and translate them into technical solutions
• Troubleshoot and resolve issues related to data processing and data quality

What you need

• 1–3 years in data science & ai
• Python
• Spark
• Scala
• ETL
• SQL
• Hadoop
• Any graduate

Good to have

• Data modelling
• Informatica
• Kafka
• SQL Server
• NoSQL
• MongoDB