Lead I - Data Engineering
BengaluruFull-time5–7 yrsPosted 1 week ago
Senior data science role at UST in Bengaluru. Needs 5–7 years and a B.Tech or B.E..
About the role
Carelon Global Solutions India is seeking a Software Engineer II with 5–8 years of data engineering experience to build and produce data flows powering advanced project solutions, owning ETL/ELT pipelines, DocumentDB/MongoDB operational stores, and AWS-based integrations linking Snowflake to agentic pricing workflows.
What you'll do
- Own end-to-end ingestion, transformation, and curation of OCR, embedding, and contract analysis outputs
- Design and implement the Claims ETL pipeline on AWS (EMR, Glue, Spark, Lambda, Step Functions), transforming Snowflake data into canonical JSON with idempotency
- Integrate normalized claims and pricing data into agentic pricing orchestration/services and persist priced outputs for audit and analytics
- Implement observability, data quality frameworks (Great Expectations, pytest), and enforce security (IAM, KMS, VPC, secrets)
- Partner with AI/ML and platform engineers on throughput, SLAs, and deployment on the ASAP.ai platform
What you need
- SQL
- Python
- ETL
- AWS
- Snowflake
- Spark
Good to have
- LLMs
- REST APIs
- GraphQL
- Flask
- Redis
- Airflow