Verification status

This tool is currently marked Needs verification. Official links, pricing, and license details are verified as community reviews pass.

Tool fit

CategoryScraping Crawling Tools
Pricing modelOpen source
Open sourceYes
Self-hostableYes

Primary repository

Repoapify/crawlee
Stars23,716
LanguageTypeScript
Last pushedJun 9, 2026

Mapped use cases

Browser Automation AI Tools

Browser automation libraries and AI-operated browser tools for testing, research, and workflow automation.

Use caseNeeds verification

Scraping And Crawling Tools

Scraping Crawling AI Tools

Allowed web data extraction, browser automation, crawling, and content-to-markdown tooling for builders.

Use caseNeeds verification

Related repositories

apify/crawlee

Typescript

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

RepositoryAuto enrichedTypeScriptApache-2.0Active signal

Related skills

Browser Automation

Automation

Driving browsers safely for testing, research, and user workflow automation.

Role: Recommended

SkillNeeds verificationAutomationRequired

TypeScript

Programming

Typed JavaScript for web apps, SDKs, and browser automation workflows.

Role: Recommended

SkillNeeds verificationProgrammingRecommended

Web Scraping Ethics

Governance

Using APIs, robots.txt, rate limits, attribution, and allowed collection methods.

Role: Recommended

SkillNeeds verificationGovernanceRequired