Manager

About the role

This is high visibility, fast-paced key initiative will integrate data across internal and external sources, provide analytical insights, and integrate with the customer’s critical systems.

What you'll do

• Build Python and PySpark based applications based on data in both Relational (Oracle, SQL Server) and NoSQL database e.g. Redis, Valkey
• Build ingestion pipelines to load data into in-memory caching database
• Build data pipeline s to load and export data to/from the Master Data Management or Reference Data Management Platform using PySpark
• Hands on experience doing at least one MDM implementation using TIBCO, Informatica, GoldenSource or custom-built MDM/RDM platforms
• Optimize performance of the built Spark applications using configurations around Spark Context, Spark-SQL and Data Frame

What you need

• Python
• Pandas
• SQL
• Spark
• ETL
• Informatica

Good to have

• AWS
• Redis
• REST APIs
• Git
• Elasticsearch
• Oracle Database