Data Engineer - PySpark Job
BengaluruFull-time5–12 yrsPosted today
Senior data science role at Yash Technologies in Bengaluru. Needs 5+ years.
About the role
We are seeking a highly motivated and technically skilled Senior Data Engineer with strong expertise in data pipeline development and advanced data modelling to join our data team.
What you'll do
- Design, implement, and maintain scalable and reliable data pipelines using Palantir Foundry, AWS
- Some exposure to business analytics, financial forecasting, or a related domain would be preferable
- Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and translate them into technical solutions
- Build reusable data assets, integrate data from multiple sources, and ensure data quality, integrity, and security
- Develop and maintain transformation workflows, ontology models, and data governance frameworks within Foundry
What you need
- Spark
- SQL
- ETL
- AWS
- Python
- Snowflake
Good to have
- Data modelling
- GCP
- CI/CD
- Azure
- Git
- SAP