Verification status

This tool is currently marked Needs verification. Official links, pricing, and license details are verified as community reviews pass.

Tool fit

CategoryScraping Crawling Tools
Pricing modelFreemium
Open sourceYes
Self-hostableYes

Primary repository

Repoapify/crawlee
Stars23,716
LanguageTypeScript
Last pushedJun 9, 2026

Mapped use cases

Scraping And Crawling Tools

Scraping Crawling AI Tools

Allowed web data extraction, browser automation, crawling, and content-to-markdown tooling for builders.

Use caseNeeds verification

Related repositories

apify/crawlee

Typescript

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

RepositoryAuto enrichedTypeScriptApache-2.0Active signal

Related skills

API Literacy

Engineering

Understanding authentication, rate limits, request shapes, errors, and source attribution.

Role: Recommended

SkillNeeds verificationEngineeringRequired

Browser Automation

Automation

Driving browsers safely for testing, research, and user workflow automation.

Role: Recommended

SkillNeeds verificationAutomationRequired

Web Scraping Ethics

Governance

Using APIs, robots.txt, rate limits, attribution, and allowed collection methods.

Role: Recommended

SkillNeeds verificationGovernanceRequired