Senior Software Engineer, Data Engineering

About the role

Senior Software Engineer, Data Engineering at ValGenesis. Design, develop, and maintain data ingestion, transformation, and orchestration pipelines (batch and real-time).

What you'll do

• Design, develop, and maintain data ingestion, transformation, and orchestration pipelines (batch and real-time)
• Build and optimize data Lakehouse architectures using Azure Synapse, Delta Lake, or similar frameworks
• Integrate and manage structured and unstructured data sources (SQL/NoSQL, files, documents, IoT streams)
• Develop and operationalize ETL/ELT pipelines using Azure Data Factory, Databricks, or Apache Spark
• Collaborate with Data Scientists to prepare and serve ML-ready datasets for model training and inference

What you need

• 4–8 years in data science & ai
• Machine learning
• SQL
• ETL
• Python
• Databricks
• Azure Data Factory
• Any graduate

Good to have

• MLOps
• Data modelling
• LLMs
• Airflow
• dbt
• Kafka