A
AnyCrawl
any4ai/AnyCrawl
AnyCrawl 🚀: A Node.js/TypeScript crawler that turns websites into LLM-ready data and extracts structured SERP results from Google/Bing/Baidu/etc. Native multi-threading for bulk processing.
★3.4kstars
TypeScript
MIT
Updated: Today
📋 Project at a Glance
Tap to expand
What's this?Data & Infrastructure project leveraging ai-scraping and aitools, built with TypeScript, open-source
Who made it?Maintained by any4ai team, 3.4K⭐ on GitHub, #527 out of 3133 in Data & Infrastructure
Why does it exist?In the Data & Infrastructure space, ai-scraping workflows faced efficiency bottlenecks. AnyCrawl was built by any4ai to address these aitools challenges.
What can it do?Key use cases: crawl, data, html-to-markdown
How to install with AI?Use an AI coding assistant to automatically run npm/pnpm install and configure the project per the README.
🔗 github.com/any4ai/AnyCrawl | 官网 https://anycrawl.dev
🔗 github.com/any4ai/AnyCrawl | 官网 https://anycrawl.dev
Topics
ai-scrapingaitoolscrawldatahtml-to-markdownragscrapescrapingserpwebscraper