Web Scraping Engineer - Global Team
YipitDataAlternative Data company
RemoteSenior
Norwest Venture Partners
RRE Ventures
SV Angel
The Carlyle Group
DFJ Gotham
Highland Capital Partners
Software EngineeringNew
About the role
TL;DR
Design, build, and maintain robust web scrapers for critical reports and customer experiences.
- •We are seeking a Web Scraping Engineer to join our growing engineering team.
- •In this hands-on role, you’ll take ownership of designing, building, and maintaining robust web scrapers that power critical reports and customer experiences across our organization.
- •Key Responsibilities Overhaul existing scraping scripts to improve reliability, maintainability, and efficiency.
- •Utilize sophisticated fingerprinting methods to avoid detection and blocking.
- •Work closely with analysts and other stakeholders to gather requirements, align on targets, and ensure data quality.
- •Develop robust monitoring solutions and alerting frameworks to quickly identify and address failures.
- •Propose new tooling, methodologies, and technologies to enhance our scraping capabilities.
- •Requirements Effective communication in English with both technical and non-technical stakeholders. 3+ years of experience with web scraping frameworks (e.g., Selenium, Playwright, or Puppeteer).
- •Strong understanding of HTTP, RESTful APIs, HTML parsing, browser rendering, and TLS/SSL mechanics.
- •Expertise in advanced fingerprinting and evasion strategies.
- •Deep experience managing cookies, headers, session states, and proxy rotations.
Required skills
PythonPlaywrightSeleniumREST APIHTML
Nice-to-have skills
JavaScript
Benefits & perks
Vacation time, Parental leave, Team events, Learning reimbursement
Tech stack
PythonJavaScriptPlaywrightSeleniumREST APIHTMLGitLinux