Comparison, SenseGap and Cloudflare AI Crawl Control.

SenseGap vs Cloudflare AI Crawl Control. Cloudflare lets you block AI crawlers. SenseGap explains what they read and why.

Cloudflare AI Crawl Control

The question it answers

Which AI crawlers hit my site, and which should I allow, block or charge?

SenseGap

The question it answers

What does AI read on my site, what were people likely asking, and what should I fix?

At a glance, the differences that matter.

One is a control panel, the other a report. SenseGap runs on Cloudflare too, so the two fit together on the same site.

Cloudflare AI Crawl Control compared with SenseGap
Cloudflare AI Crawl ControlSenseGap
Main jobAllow, block or charge AI crawlers at the edgeExplain AI visits and say what to do next
Crawler activityRequests by crawler, operator, path and status codeRequests by bot, purpose and page, with how often each page is read
BlockingYes, per crawler, enforced at the edgeNo. SenseGap measures, it doesn't block
Charge crawlersPay per crawl, in private betaNo
Visit purposeCrawler categoriesAnswering a person, AI search index, training, agents, search engines
People sent by AIReferral metrics on paid plansEvery plan, per assistant and landing page
Plain-English insightsNot coveredWhat was measured, what it probably means, what to do next
Likely topicsNot coveredInferred from pages read together, labelled Estimate
Weekly report and client sitesNot coveredWeekly email on every plan, unlimited client sites on Studio
PriceIncluded in every Cloudflare plan$9, $29, $89 or $299 a month, by size

Fair play, where Cloudflare is the better tool.

Cloudflare is where you enforce the rules. If you want a crawler gone, Cloudflare can stop it before it reaches your server.

  • Blocking at the edge

    Allow or block each AI crawler with a click. SenseGap can't stop a request; it only reports on it.

  • Pay per crawl

    Cloudflare is building a way to charge AI crawlers for access. It is in private beta.

  • robots.txt enforcement

    Cloudflare tracks how crawlers treat your robots.txt and can turn your rules into enforced ones.

  • Included in your plan

    AI Crawl Control is available on every Cloudflare plan, free one included, with no setup.

  • Cloudflare's network view

    Bot detection draws on traffic across Cloudflare's network, and paid Bot Management adds more signals.

  • Status codes and paths

    See what each crawler requested and what your site returned, grouped into areas of the site.

What SenseGap adds, from your own traffic.

From a list of crawlers to what to do about them. SenseGap turns the same traffic into answers a marketer can act on.

How it works

Why the visit happened

A ChatGPT-User fetch means a person asked something just now. A GPTBot crawl means training. SenseGap keeps them apart.

Likely topics

Pages assistants open together point to the question behind them, shown as an Estimate.

Insights and next steps

Every finding comes with what it probably means and what to fix, in plain English.

People sent by AI, on every plan

Visits from ChatGPT, Perplexity, Gemini, Claude and Copilot, per landing page, from $9.

Evidence per visit

Each verdict carries its proof, such as the IP list matched, for 25 bots that can be checked.

Reports for clients

A weekly email on every plan. Studio covers unlimited client sites with your logo on reports.

Together, on the same Cloudflare site.

Measure first, then decide what to block. Blocking a crawler can also take you out of AI answers. SenseGap shows what you'd lose.

  1. 01

    Connect SenseGap with a Worker

    The collector runs as a Cloudflare Worker after your site answers, so it adds no delay and needs no code on your pages.

    Setup takes a few minutes.
  2. 02

    Watch a few weeks of AI visits

    See which assistants answer people with your pages, which bots only train, and which claim to be someone they aren't.

  3. 03

    Decide in Cloudflare

    Block training crawlers you don't want and fake bots, keep the assistants that send people. Enforce it in AI Crawl Control or robots.txt.

  4. 04

    Check the effect in SenseGap

    Confirm the blocked bots stopped and that people sent by AI kept coming.

Which to choose, by the question you need answered.

Use Cloudflare to act, SenseGap to understand. If your site is on Cloudflare you already have AI Crawl Control, so the question is whether you need the explanation.

Choose Cloudflare AI Crawl Control if

  • You mainly want to block or allow AI crawlers
  • You want to charge crawlers for access
  • A crawler list with paths and status codes is enough

Choose SenseGap if

  • You need to know why AI visited and what people likely asked
  • You want plain-English next steps, not a raw dashboard
  • You track people sent by AI without a paid Cloudflare plan
  • You report on AI search across client sites
Using both

SenseGap's main collector is a Cloudflare Worker, so it runs alongside AI Crawl Control with no conflict. Blocks you set in Cloudflare show up in SenseGap as visits that stopped.

Pricing, as each company publishes it.

Included with Cloudflare, or from $9 with SenseGap. AI Crawl Control comes with your Cloudflare plan. Some reports need a paid plan.

SenseGap pricing
Cloudflare AI Crawl Control and SenseGap pricing
Cloudflare AI Crawl ControlSenseGap
EntryIncluded in every Cloudflare plan, free one included$9/mo Starter: 1 site, 300k bot visits
Referral metricsPaid Cloudflare plansEvery plan
More sites and historyDepends on your Cloudflare plan$29/mo Pro: 3 sites, 3M bot visits
Agencies and busy sitesDepends on your Cloudflare plan$89/mo Studio: unlimited sites, 8M bot visits · $299/mo Scale: unlimited sites, 30M bot visits

Questions, people ask before they pick.

Questions, answered plainly

Is Cloudflare AI Crawl Control free?

It is available on every Cloudflare plan, including the free one. Cloudflare's docs say referral metrics need a paid plan, and on the free plan crawlers are identified by their user agent.

Can SenseGap block AI crawlers?

No. SenseGap measures and explains AI visits. To block a crawler, use Cloudflare AI Crawl Control, a firewall rule or robots.txt. SenseGap shows what blocking it would cost you.

Does SenseGap work with Cloudflare?

Yes. SenseGap's main collector is a Cloudflare Worker. It runs after your site answers, so it adds no delay, and it works alongside AI Crawl Control.

Should I block GPTBot?

GPTBot collects training data. Blocking it doesn't remove you from ChatGPT answers, which use other OpenAI bots such as OAI-SearchBot and ChatGPT-User. SenseGap shows how often each one reads your pages, so you can decide with data.

What's the difference between AI training and AI answering a person?

Training crawlers collect pages without anyone asking. Bots like ChatGPT-User fetch a page because a person asked a question right now. SenseGap sorts every visit by this purpose.

Do I need Cloudflare to use SenseGap?

Cloudflare is the main way to connect today and works on every Cloudflare plan. Other methods, such as server log upload and Node middleware, are coming soon.

Sources, checked October 27, 2026.

Everything this page says about Cloudflare AI Crawl Control comes from its public pages, listed below. Products change quickly. If something here is out of date, write to hello@sensegap.com and we will fix it.

Cloudflare AI Crawl Control is a trademark of its owner. SenseGap is not affiliated with it.

More comparisons, for the other tools on your list.

All comparisons

See what AI does on your site. Open the live demo, no sign-up needed.

Open the live demo