Skip to content

Lead Python Developer

iCapitalIN - JaipurRemote

First seen Aug 25 · open 87 days · posted onceNo pay listed

HirQ verdict

58/100 · Fair. Based on age, reposts, pay, the company's hiring and ghost signals.

Low ghost risk
True age
87 days
Reposts
Posted once

See the evidence behind this score.

Pro shows each part of the score, the reasons, the pay percentile and the listing history.

HirQ's ghost-risk estimate and company labels are automated opinions based on what we observe on employers' public job boards: how long a listing has been open, whether it was re-listed, wording in the description, and how often roles on that board close. They are not statements about an employer's intent, and a high-risk listing can still be a real opening. Figures are as of the date shown. How we measure

At a glance

Pay
No pay listed
Level
Lead
Experience
10+ years
Type
Full Time
Team
Core Operations Technology
Work setup
Remote

“Employees in this role will work in the office four days, with the flexibility to work remotely one day (Friday).”

iCapital hiring

Company page
Hiring fastHiring71· StrongFintech & Payments
Open roles
233
New in 30 days
89
Closed in 30 days
80
Hiring trend, 13 weeksPro
Follow-through: ••%Pro

About the role

From iCapital's careers page, checked Nov 20

iCapital is looking to hire an experienced Python Developer with expertise in web scraping, automated portal interactions, and cloud-native deployment using AWS. The ideal candidate will have hands-on experience working with Playwright for browser automation, managing multi-factor authentication (MFA) flows, and deploying scalable scraping tasks via AWS Lambda and related services. This role will assist in architecting and building robust, secure, and scalable scraping solutions that interact with complex web applications and secured portals.

Responsibilities

  • Assist with the design and implementation of advanced scraping solutions using Python, Playwright, and AWS services.
  • Automate interactions with JavaScript-heavy and authentication-secured websites, including handling MFA, CAPTCHAs, and session or token-based login flows.
  • Architect scraping pipelines using serverless AWS components such as Lambda, Step Functions, S3, CloudWatch, and Secrets Manager.
  • Build systems that scale to support high volumes of data extraction with fault tolerance, retries, and intelligent logging.
  • Integrate and manage complex workflows across multiple portals, APIs, and data sources.
  • Contribute to architectural decisions, tooling, and best practices.
  • Responsible for Code reviews and deployments.

Qualifications

  • Bachelor’s or master’s degree in computer science, software engineering, or related field, or equivalent professional experience
  • 10+ years of experience in Python development, with a strong focus on automation and data extraction
  • Proven expertise in web scraping using tools like Playwright, Selenium, Scrapy, BeautifulSoup, and requests
  • In-depth experience handling multi-step authentication flows, including multi-factor authentication (MFA), CAPTCHA solving, and session or cookie management
  • Proficient in deploying and managing scraping workloads in AWS, particularly Lambda, S3, IAM, CloudWatch, and Secrets Manager
  • Experience with asynchronous programming, headless browsers, and JavaScript-rendered content
  • Solid understanding of web protocols (i.e. HTTP, HTTPS, cookies, headers), and the ability to reverse-engineer network calls and authentication mechanisms
  • Comfortable working with APIs, JSON/XML, and data transformation
  • Experience with CI or CD pipelines, Docker, and infrastructure as code (i.e. CloudFormation, Terraform)
  • Familiar with data pipeline orchestration tools such as Apache Airflow or AWS Step Functions
  • Prior experience scraping from secure or enterprise-level portals (i.e. financial, healthcare, legal)
  • Background in data engineering or ETL workflows is a plus
  • Exposure to Python testing frameworks and writing unit or integration tests

We believe the best ideas and innovation happen when we are together. Employees in this role will work in the office four days, with the flexibility to work remotely one day (Friday).

Benefits

iCapital offers a comprehensive benefits package that includes a total compensation program consisting of competitive salary, annual performance bonus, and equity for all full-time employees; healthcare with 100% employer-paid health and dental insurance; and generous paid time off (PTO).

For additional information on iCapital Network, please visit https://www.icapitalnetwork.com/about-us Twitter: @icapitalnetwork | LinkedIn: https://www.linkedin.com/company/icapital-network-inc

Skills mentioned

  • AWS
  • Python
  • Test Automation
  • JavaScript
  • Airflow
  • Serverless
  • ETL
  • Docker
  • Terraform
  • IAM
Apply on iCapital's siteOpens iCapital's own application page.

Similar jobs

Same role or field, nearby or remote, ranked by HirQ score.

More at iCapital

All roles

Keep exploring

Lead Python Developer

No pay listed · HirQ 58

Apply