Hiring.Camp

Lead Python Developer

Icapitalnetwork

·

Aug 25, 2026

Location
IN - Jaipur
Type
Full-time
Department
Core Operations Technology
Seniority
Lead
Experience
10+ years
Education
Master
Source
Greenhouse

Description

iCapital is looking to hire an experienced Python Developer with expertise in web scraping, automated portal interactions, and cloud-native deployment using AWS. The ideal candidate will have hands-on experience working with Playwright for browser automation, managing multi-factor authentication (MFA) flows, and deploying scalable scraping tasks via AWS Lambda and related services. This role will assist in architecting and building robust, secure, and scalable scraping solutions that interact with complex web applications and secured portals.

 

Responsibilities

  • Assist with the design and implementation of advanced scraping solutions using Python, Playwright, and AWS services.
  • Automate interactions with JavaScript-heavy and authentication-secured websites, including handling MFA, CAPTCHAs, and session or token-based login flows.
  • Architect scraping pipelines using serverless AWS components such as Lambda, Step Functions, S3, CloudWatch, and Secrets Manager.
  • Build systems that scale to support high volumes of data extraction with fault tolerance, retries, and intelligent logging.
  • Integrate and manage complex workflows across multiple portals, APIs, and data sources.
  • Contribute to architectural decisions, tooling, and best practices.
  • Responsible for Code reviews and deployments.

 

Qualifications

  • Bachelor’s or master’s degree in computer science, software engineering, or related field, or equivalent professional experience
  • 10+ years of experience in Python development, with a strong focus on automation and data extraction
  • Proven expertise in web scraping using tools like Playwright, Selenium, Scrapy, BeautifulSoup, and requests
  • In-depth experience handling multi-step authentication flows, including multi-factor authentication (MFA), CAPTCHA solving, and session or cookie management
  • Proficient in deploying and managing scraping workloads in AWS, particularly Lambda, S3, IAM, CloudWatch, and Secrets Manager
  • Experience with asynchronous programming, headless browsers, and JavaScript-rendered content
  • Solid understanding of web protocols (i.e. HTTP, HTTPS, cookies, headers), and the ability to reverse-engineer network calls and authentication mechanisms
  • Comfortable working with APIs, JSON/XML, and data transformation
  • Experience with CI or CD pipelines, Docker, and infrastructure as code (i.e. CloudFormation, Terraform)
  • Familiar with data pipeline orchestration tools such as Apache Airflow or AWS Step Functions
  • Prior experience scraping from secure or enterprise-level portals (i.e. financial, healthcare, legal)
  • Background in data engineering or ETL workflows is a plus
  • Exposure to Python testing frameworks and writing unit or integration tests

 

We believe the best ideas and innovation happen when we are together. Employees in this role will work in the office four days, with the flexibility to work remotely one day (Friday). 

 

Benefits

iCapital offers a comprehensive benefits package that includes a total compensation program consisting of competitive salary, annual performance bonus, and equity for all full-time employees; healthcare with 100% employer-paid health and dental insurance; and generous paid time off (PTO).

For additional information on iCapital Network, please visit https://www.icapitalnetwork.com/about-us  Twitter: @icapitalnetwork | LinkedIn: https://www.linkedin.com/company/icapital-network-inc

 

 

Skills

PythonJavaScriptAWSDockerTerraformAirflowData EngineeringETL

Similar Jobs

30

Lead Python Developer

M&G·Edinburgh, Scotland +2

4d ago

Lead Python Developer

mindboxgroup·Remote, Hybrid

Lead Python Developer

Antal | Rekrutacje

Python Developer - Lead

KoiReader Technologies·Bengaluru, Karnataka·Onsite

1y+ ago

Python Developer - Lead

KoiReader Technologies·Bengaluru, Karnataka·Onsite

1y+ ago

Python Lead Developer

Nitor Infotech·Pimpri-Chinchwad, Maharashtra

1y+ ago

Lead Python Developer

Ahon Solutions Inc

Lead Python Developer, AVP

Rbs·Bengaluru, Karnataka

4d ago

Generative AI - Lead Python Developer - Vice President

Citi Bank·Jersey City, New Jersey

2mo ago

Senior Python Developer - Lead

Xtglobal·India

1y+ ago

Lead Python Developer, Risk Technology

Ion·New York City, New York·Onsite

1y+ ago

Lead Developer (Tech Lead) – Python / Java / C# / TypeScript, AWS

Brio Digital·Hybrid

2w ago

Python AI Lead Developer – Cloud Infrastructure, Software Architecture & Cross-Functional Team Leadership

Synechron·Bengaluru, Karnataka

1mo ago

Lead Python Application Developer - Vice President

Citi Bank·India·Hybrid

2mo ago

Lead Python Application Developer - Vice President

Citi Bank·Pune, Maharashtra

2mo ago

Lead Python Engineer / Developer - Associate

iCapital·Stamford, Connecticut

3mo ago

Lead Quantitative Developer (Python)

Prometeia·Bologna, Emilia-Romagna

5mo ago

Lead Backend Developer - Python

Advaya Fleet Inc·Mohali, Punjab

1y+ ago

Strado GroupSenior Python Developer (Squad Lead)WaregemVoltijdsGoede software ontstaat niet toevallig. Ze groeit uit scherpe keuzes, sterke structuren en mensen die verantwoordelijkheid durven nemen. Als Senior Python Developer (Squad Lead) sta jij midden

Elindus

Lead Software Developer (Python/Java)

Toparo·Montréal, Quebec·Remote

Vice President ( Lead Securities Python Quantitative Developer )

Wells Fargo·US·Onsite

2w ago

Lead Full Stack Developer (Python & Angular)

Emergn·Portugal·Remote

2mo ago

Python Developer / GenAI Tech Lead

In4Ge·Poland·Remote

9mo ago

Full Stack Developer Lead (Java/Linux/Python)

encircle.io

9mo ago

Lead - Python Backend Web Developer - Information Technology (IT) - Navi Mumbai - Mahape

CMS Corporation

Lead Software Engineer (Python Developer)

Myhrrescue·Hybrid

Lead Software Engineer (Python Developer)

Myhrrescue·Hybrid

Lead Ruby on Rails & Python Developer – AI & Agentic AI

Chistats·Pune, Maharashtra

1d ago

Lead Software Engineer - Python/Java Developer

JP Morgan Chase·Wilmington, North Carolina

3w ago

Lead Software Engineer - Python/Java Developer

JP Morgan Chase·Wilmington, North Carolina

3w ago