Lead Python Developer

About the role

The ideal candidate will have hands-on experience working with Playwright for browser automation, managing multi-factor authentication (MFA) flows, and deploying scalable scraping tasks via AWS Lambda and related services. This role will assist in architecting and building robust, secure, and scalable scraping solutions that interact with complex web applications and secured portals.

What you'll do

• Assist with the design and implementation of advanced scraping solutions using Python, Playwright, and AWS services
• Automate interactions with JavaScript-heavy and authentication-secured websites, including handling MFA, CAPTCHAs, and session or token-based login flows
• Architect scraping pipelines using serverless AWS components such as Lambda, Step Functions, S3, CloudWatch, and Secrets Manager
• Build systems that scale to support high volumes of data extraction with fault tolerance, retries, and intelligent logging
• Integrate and manage complex workflows across multiple portals, APIs, and data sources

What you need

• 10–18 years in software engineering
• Python
• JavaScript
• AWS
• Docker
• Playwright
• ETL
• B.Tech or B.E. or B.Sc or BCA or M.Tech or MCA or M.Sc

Good to have

• Terraform
• IAM
• Selenium
• Airflow