Python Automation Engineer
Indexed description
Senior Python Automation Engineer | Web Scraping & Cloud Infrastructure
📍 Connecticut, USA (Onsite, 4 Days Per Week)
📄 Permanent Opportunity
We're working with an established name in the fintech and alternative investments space, seeking a Senior Python Automation Engineer to join a growing team building secure, large-scale data automation solutions.
This is an exciting opportunity to work on complex, real-world data extraction challenges where automation, security, and cloud architecture come together to support high-value financial workflows used industry-wide.
What You'll Be Doing
- Designing and building scraping solutions using Python, Playwright, and AWS services
- Automating interactions with JavaScript-heavy, authentication-secured websites, including MFA and token or session-based logins
- Architecting scraping pipelines using serverless components such as Lambda, Step Functions, S3, CloudWatch, and Secrets Manager
- Building systems that scale for high-volume data extraction with retries, fault tolerance, and detailed logging
- Managing complex workflows spanning multiple portals, APIs, and data sources
- Contributing to architectural decisions and engineering best practices
What We're Looking For
- 9+ years of Python development experience, with a strong focus on automation and data extraction
- Proven expertise in web scraping using Playwright, Selenium, Scrapy, BeautifulSoup, or requests
- Hands-on experience handling multi-step authentication flows, including MFA, CAPTCHA handling, and session or cookie management
- Experience deploying and managing scraping workloads on AWS, particularly Lambda, S3, IAM, CloudWatch, and Secrets Manager
- Experience with asynchronous programming, headless browsers, and JavaScript-rendered content
- Strong understanding of web protocols (HTTP, HTTPS, cookies, headers) and the ability to reverse-engineer network calls and authentication mechanisms
- Experience with CI/CD pipelines, Docker, and infrastructure as code (CloudFormation or Terraform)
Nice to Have
- Experience with data pipeline orchestration tools such as Apache Airflow or AWS Step Functions
- Prior experience scraping secure or enterprise-level portals (financial, healthcare, or legal)
- Background in data engineering or ETL workflows
Why Apply?
- Work on high-impact automation challenges at the intersection of security and scale
- Join a small, senior engineering team where your contribution matters
- Competitive base salary, plus equity and annual bonus
- Comprehensive benefits including employer-matched retirement and subsidized healthcare
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search