SENIOR CONSULTANT
ChennaiFull-time10–18 yrsPosted 1 week ago
Closed
Leadership consulting role at Atos / Eviden in Chennai. Needs 10+ years.
About the role
Migrate existing Lambda/Dagster/dbt pipelines onto a Glue‑based, Redshift‑centric medallion architecture (S3 Bronze → Redshift Silver → Gold canonical model), embed data quality, lineage, security and CI/CD controls into every pipeline, and mentor engineers through domain‑by‑domain migration waves
What you'll do
- Inventory and baseline current Lambda functions, Dagster pipelines, dbt models, MySQL ODS flows and Kafka feeds, document lineage, schedules, SLAs and failure paths
- Design and build Glue‑based ingestion, transformation, and cataloguing patterns (Glue jobs, Glue Catalog, Crawlers) with Lambda/Step Functions/Event Bridge orchestration
- Implement S3 Bronze landing with lifecycle/archive policies, Redshift Silver conformance and Gold canonical data products (Customer, Loan, Collections, Risk)
- Build automated data‑quality gates, reconciliation checks, and source‑to‑report lineage
- Implement IAM, AWS‑native encryption, Secrets Manager and Gold‑layer RBAC/least‑privilege access
What you need
- SQL
- Stakeholder management
- AWS
- dbt
- Redshift
- CI/CD
Good to have
- Terraform
- IFRS
- Data privacy
- Machine learning
- Tableau
- IAM