Software Engineer-Big Data
BengaluruFull-time2–3 yrsPosted 5 months ago
Junior data science role at Societe Generale in Bengaluru. Needs 2–3 years.
About the role
Software Engineer-Big Data at Societe Generale. Analyze, organize and process raw data using Bigdata technologies and Scala.
What you'll do
- Analyze, organize and process raw data using Bigdata technologies and Scala
- Perform data validation, cleaning and transformation using Big data technologies, Spark and Scala
- Ingest and manage data in HDFS/Hive and analyze data using Spark and produce meaningful insights for the business team
- Combine raw information from different sources, Explore ways to enhance data quality and reliability
- Develop code using Software Craftmanship best practices such as Continuous delivery and Clean coding principles
What you need
- SQL
- Spark
- Hadoop
- Scala
- Power BI
- Hive
Good to have
- Kafka
- Data visualisation
- Elasticsearch
- CI/CD
- Git
- Jenkins