Senior Consultant

About the role

Migrate existing Lambda/Dagster/dbt pipelines onto a Glue‑based, Redshift‑centric medallion architecture (S3 Bronze → Redshift Silver → Gold canonical model), embed data quality, lineage, security and CI/CD controls into every pipeline, and mentor engineers through domain‑by‑domain migration waves

What you'll do

• Inventory and baseline current Lambda functions, Dagster pipelines, dbt models, MySQL ODS flows and Kafka feeds, document lineage, schedules, SLAs and failure paths
• Design and build Glue‑based ingestion, transformation, and cataloguing patterns (Glue jobs, Glue Catalog, Crawlers) with Lambda/Step Functions/Event Bridge orchestration
• Implement S3 Bronze landing with lifecycle/archive policies, Redshift Silver conformance and Gold canonical data products (Customer, Loan, Collections, Risk)
• Build automated data‑quality gates, reconciliation checks, and source‑to‑report lineage
• Implement IAM, AWS‑native encryption, Secrets Manager and Gold‑layer RBAC/least‑privilege access

What you need

• 10–18 yrs of experience
• SQL
• Stakeholder management
• AWS
• dbt
• Redshift
• CI/CD
• Any graduate

Good to have

• Terraform
• IFRS
• Data privacy
• Machine learning
• Tableau
• IAM