Python Developer

Role Overview

The organization is seeking Python Web Scraping Engineers to design, build, and operate reliable web data collection systems. This role focuses on production-ready Python scrapers and browser automation, particularly across dynamic and JavaScript-heavy websites. The successful candidate will contribute to the reliability, scalability, and quality of Deep Future’s data pipelines.

Important Requirement:Previous AWS experience is essential for this role.

Key Responsibilities

• Design, develop, and maintain Python-based web scrapers.
• Build and maintain browser automation workflows using Playwright and Selenium.
• Extract data from dynamic, JavaScript-heavy websites.
• Maintain and improve scraping systems to handle routine target-site changes.
• Containerise scraping services using Docker.
• Deploy and operate scraping workloads on AWS.
• Monitor scraper performance, reliability, and data quality.
• Troubleshoot common failures, performance issues, and data collection inconsistencies.

Required Skills & Experience

• Working knowledge of AWS services such as EC2, ECS, Lambda, S3, and SQS.
• Commercial experience using Python in production environments.
• Experience building, maintaining, and improving web scrapers.
• Practical experience with Playwright and/or Selenium.
• Experience containerising applications with Docker.
• Ability to write clear documentation and communicate effectively within a team.
• Experience collaborating using tools such as Slack, Google Workspace, Jira, and Confluence.

Desirable / Nice to Have

• Exposure to sites protected by Cloudflare or similar web application firewalls.
• Familiarity with CAPTCHA and bot-detection challenges.
• Basic understanding of browser fingerprinting concepts.
• Experience with higher-volume or distributed scraping systems.
• Familiarity with monitoring and logging using AWS CloudWatch.

Organization Offers

• Ownership of meaningful parts of core data acquisition systems.
• Opportunity to work on real-world data intelligence problems.
• Support and mentorship from experienced engineers.

·Flexible working arrangements.

• Competitive remuneration aligned with experience.

Ideal Candidate Profile

The ideal candidate is a hands-on Python engineer with strong experience in production scraping, browser automation, AWS-based deployment, and reliable data pipeline operations. They should be comfortable working with changing web targets, debugging failures, documenting technical decisions, and collaborating closely with engineering teams to maintain high-quality data acquisition systems

Originally posted on Himalayas