CrawlFare connects your entire Cloudflare portfolio to AI crawler monetization. See who's crawling you, set policy across every domain, and charge per request.
No credit card. Bring your Cloudflare account. Connect in 60 seconds.
CrawlFare sits on top of your existing Cloudflare account. Nothing to install. No DNS changes. Connect a token and we configure the rest.
Create a scoped API token in 30 seconds. Paste it into CrawlFare. We pull every zone you own.
Choose: allow, charge, or block — per crawler, across all domains. We write the WAF rules for you.
We enroll you in Cloudflare's Pay Per Crawl beta. Charge OpenAI, Anthropic, Perplexity per request.
Cloudflare gives you the infrastructure. CrawlFare gives you the management layer — so you can run 5 or 500 domains without logging into each one.
See every AI bot hitting every domain you own. Sort by volume, by crawler, by date. Understand what your content is worth.
Allow, charge, or block any crawler across all your domains in a single action. Or tune per-domain. We write the WAF rules for you.
Parse sitemaps, auto-generate LLMs.txt for every domain, deploy via Cloudflare Workers — or just download and serve it yourself.
We handle the enrollment workflow and auto-configure pricing the moment your domains are approved for Cloudflare's beta.
Automatic sitemap and LLMs.txt submission to Cloudflare's AI Index pub/sub, per domain. Be discoverable when it matters.
Uses the APIs your domains are already running on. No DNS changes, no agent, no middleware. Connect a token and go.
Start free. Upgrade when you're ready to enroll in Pay Per Crawl.
Plus 2% of Pay Per Crawl revenue processed through CrawlFare (only charged on revenue earned).
Every hour you wait, another 1,500 pages get scraped. Connect your Cloudflare account and start enforcing policy across your portfolio today.