WebcrawlerAPI
Web crawling and scraping API that returns clean markdown from web pages.
- SI Score
- 75/100
- Pricing
- Not confirmed
- Free plan
- Not confirmed
- Sign-up required
- Not confirmed
Ask SI about WebcrawlerAPI
Answers use saved listing facts and recorded sources.Homepage screenshot
What it does
WebcrawlerAPI is a web crawling and scraping API. It turns web pages into clean markdown, removing menus, footers, and banners so only the main content remains. It handles JavaScript, CAPTCHAs, and proxies automatically, and the site states pricing is per page with no subscription.
The documentation covers getting started, authentication and API keys, output formats, scraping a page, content cleaning, structured outputs, crawling a website, crawl jobs, URL filters, async requests and webhooks, plus pricing and credits. Documented endpoints include a GET request to api.webcrawlerapi.com/markdown for page markdown, POST v2/scrape for a single page in other formats, and POST v1/crawl for multi-page crawling. The docs list SDKs for JavaScript, Python, PHP, and Java, and integrations with MCP, LangChain, Make, n8n, and Zapier. An API key is obtained by registering on the dashboard and copying the key from the API key section. Sign up is at dash.webcrawlerapi.com/sign-up, and the site lists [email protected] as a contact address. A GitHub repository is linked from the home page.