highlisted

Data Engineer - Chennai / Bengaluru

Fa Ertb Saasfaprod1·Chennai

Pay not statedJunior levelFull-time

Read from the company's own careers page; you apply on their site.

How well do you fit this job?

Upload your resume to see each requirement checked against your profile, in under a minute.

Check my fit
Hard to read?

About the role

Develop and maintain data pipelines, ELT processes, and workflow orchestration using Apache Airflow, Python, PySpark , Hive(Trino) and Snowflake to ensure the efficient and reliable delivery of data. Design and implement custom connectors to facilitate the ingestion of diverse data sources into our platform, including structured and unstructured data from various document formats .

What you'll do

  • Develop and maintain data pipelines, ELT processes, and workflow orchestration using Apache Airflow, Python, PySpark
  • Design and implement custom connectors to facilitate the ingestion of diverse data sources into our platform
  • Collaborate closely with cross-functional teams to gather requirements, understand data needs, and translate them into technical solutions
  • Design and implement data CI/CD pipelines to enable automated and efficient data integration, transformation, and deployment processes
  • Monitor and troubleshoot data pipelines, proactively identifying and resolving issues related to data ingestion, transformation, and loading

What you need

  • Python
  • SQL
  • Airflow
  • Spark
  • Snowflake
  • Hive
  • Any graduate

Good to have

  • ETL
  • CI/CD

Similar jobs

Data Engineer Pyspark

Match Me Resume Match | Citi·Chennai

Can I apply
Open to any education · 5–8 yrs
Pay
Pay not stated
Source
From the company's careers page · today
How to apply
On Match Me Resume Match | Citi's site: account needed, ~10–15 min
Early: posted 15 h ago on their own site
Can I apply
Needs B.Sc or B.Tech or B.E. · 2–5 yrs
Pay
Pay not stated
Source
From the company's careers page · today
How to apply
On NielsenIQ's site: short form, ~5 min
Early: posted 18 h ago on their own site

Senior Snowflake Data Engineer:

Wissen Technology·Chennai (hybrid)

Can I apply
Needs B.Tech or B.E. or M.Tech · 7–12 yrs
Pay
Pay not stated
Source
From the company's careers page · today
How to apply
On Wissen Technology's site: short form, ~5 min
Early: posted 19 h ago on their own site