Data Engineer II

About the role

Data Engineer II at Netomi. Architect and implement scalable, secure, and reliable data pipelines using modern data platforms (e.g., Spark, Databricks, Airflow, Snowflake , etc.).

What you'll do

• Architect and implement scalable, secure, and reliable data pipelines using modern data platforms (e.g., Spark, Databricks, Airflow, Snowflake , etc.)
• Develop ETL/ELT processes to ingest data from various structured and unstructured sources
• Perform Exploratory Data Analysis (EDA) to uncover trends, validate data integrity, and derive insights that inform data product development and business decisions
• Collaborate closely with data scientists, analysts, and software engineers to design data models that support high-quality analytics and real-time insights
• Write clean, maintainable code with comprehensive unit and integration tests to ensure reliability and stability in Python

What you need

• 4–7 yrs of experience
• SQL
• Python
• ETL
• Databricks
• Airflow
• Snowflake
• M.Sc or B.Tech or B.E. or B.Sc or BCA or M.Tech or MCA

Good to have

• Machine learning
• Prompt engineering
• LLMs
• CI/CD
• Data privacy
• Terraform