Command Palette

Search for a command to run...

Server Favicon

Crawl

Web scraping and search for AI agents. 11 endpoints — scrape any URL, search the web, extract structured data, read pages, discover feeds, sitemaps, and more.

POST

/api/archive

$0.02
Get archived/cached version of a URL via web archive
POST

/api/broken

$0.02
Check a page for broken links (404s, timeouts)
POST

/api/compare

$0.05
Compare content of two URLs — word overlap analysis
POST

/api/crawl

$0.10
Crawl multiple pages from a domain
POST

/api/domain

$0.02
Get domain info and WHOIS-like data
POST

/api/extract

$0.05
Extract structured data — links, headings, images, word count — from a URL
POST

/api/feed

$0.02
Discover RSS/Atom feeds from a URL
POST

/api/github

$0.02
Search GitHub repos, users, and code
POST

/api/headlines

$0.03
Get trending news headlines for a topic
POST

/api/links

$0.02
Extract all links from a page, deduplicated
POST

/api/metadata

$0.01
Extract page metadata — OG tags, headings, link counts
POST

/api/rate

$0.01
Get current exchange rate between currencies
POST

/api/read

$0.01
Read any URL as clean plain text
POST

/api/reddit

$0.02
Extract Reddit thread data — posts, comments, votes
POST

/api/related

$0.02
Find pages related to a given URL
POST

/api/scrape

$0.02
Scrape any URL using Jina Reader — returns clean markdown
POST

/api/search

$0.03
Web search using Jina Search with AI answers
POST

/api/sitemap

$0.02
Parse sitemap.xml from a domain
POST

/api/stock

$0.05
Search for financial and stock data
POST

/api/substack

$0.02
Extract a Substack article as clean text
POST

/api/summarize

$0.05
AI-summarize content from a URL
POST

/api/translate

$0.03
Read a URL and return content translated to target language
POST

/api/verify

$0.05
Fact-check a claim against web sources
POST

/api/weather

$0.01
Get current weather for a location

Install on Your Agent

Add Crawl skills to any client

npx agentcash add https://crawlest.vercel.app
Transactions
Volume
Agents
Crawl | MPPscan