# VerifiedDR

> VerifiedDR helps you find relevant websites, check the trust behind them and build connections that support your growth.

See what holds your Domain Rating (DR) back. Find websites that can link to you and choose the next step. Track whether your DR, Google rankings and mentions in AI answers improve.

This guide is in English. [Read the full guide](https://verifieddr.com/llms-full.txt) for product details and the article index.

## Overview
- [Grow Your Domain Rating With Trusted Backlinks | VerifiedDR](https://verifieddr.com/): Find your next backlink from websites on your topic. Grow your Domain Rating and track whether AI citations and organic traffic follow.

## Product
- [What is TrueDR? True Domain Rating explained | VerifiedDR](https://verifieddr.com/truedr): See whether trust and traffic support the Domain Rating of a website. Learn which checks shape its TrueDR score from 0 to 100.
- [Trust Map: Find the Backlinks Worth Your Time | VerifiedDR](https://verifieddr.com/authority-map): Map the websites that link to you with the Trust Map. See which links add trust and where rivals earn links worth seeking.
- [Google Search Console Visibility | VerifiedDR](https://verifieddr.com/search-console): Connect Google Search Console. Find pages and search terms close to a better rank. Use trust data to choose what to improve.
- [VerifiedDR API: Visibility Data Your Agents Can Act On](https://verifieddr.com/api): Use the VerifiedDR API to bring DR, TrueDR and next steps into your scripts or AI agents. Check websites, search terms, links and AI answers.
- [Visibility & Discovery API | VerifiedDR](https://verifieddr.com/api/authority): Visibility & discovery endpoints of the VerifiedDR API: DR and TrueDR for any website, backlink maps, site discovery, link exchanges and badge snippets.
- [Keyword API | VerifiedDR](https://verifieddr.com/api/keywords): The VerifiedDR Keyword API: keyword research by DR, winnable keyword suggestions and tracked keyword snapshots for the websites you own.
- [API Reference & CLI Parity | VerifiedDR](https://verifieddr.com/api/reference): The VerifiedDR API reference: error codes, category values and the complete vdr CLI to HTTP parity table.
- [Search & AI Visibility API | VerifiedDR](https://verifieddr.com/api/search-visibility): Search & AI visibility endpoints of the VerifiedDR API: Search Console performance, index audits and AI answers on ChatGPT, Perplexity, Google AI and Claude.
- [Sites & Monitoring API | VerifiedDR](https://verifieddr.com/api/sites): Sites & monitoring endpoints of the VerifiedDR API: the websites on your account, private TrueDR detail, change monitoring, exports and badge verification.
- [MCP Server for SEO & AI Visibility | VerifiedDR](https://verifieddr.com/agents/mcp): Connect Claude, Cursor or any MCP client to the VerifiedDR MCP server for DR, TrueDR, AI visibility scans, keyword research, growth tasks and link exchanges.
- [VerifiedDR CLI: Run Visibility Work From Your Terminal](https://verifieddr.com/agents/cli): Install the VerifiedDR CLI skill in one command. Your coding agent reads DR, TrueDR, AI visibility and keyword data, then does growth work from the terminal.
- [VerifiedDR Chrome Extension: SEO, AEO & GEO Audit](https://verifieddr.com/extension): Audit any public page in Chrome. See DR, TrueDR, a visual Trust Map, and copy-ready SEO, AEO, and GEO fixes for homepages, pricing, docs, and more.
- [AI Scrapers: See Which AI Crawlers Read Your Website](https://verifieddr.com/ai-scrapers): See which AI scrapers read your website. Log visits from GPTBot, ClaudeBot, PerplexityBot and 20+ more, and see which pages they read or skip.
- [AI Visibility Checker and Tracking for Search and AI](https://verifieddr.com/ai-visibility): Track your AI visibility. See whether ChatGPT, Perplexity, Google AI and Claude name your business, which brands they name and which sources they use.
- [Free Keyword Difficulty Checker by DR | VerifiedDR](https://verifieddr.com/keyword-difficulty-checker): Free keyword difficulty checker based on the live Google top 10. See median DR, the weakest result, your DR gap and whether the keyword is winnable.
- [Free Domain Rating & Rank Checker | VerifiedDR](https://verifieddr.com/domain-rating-checker): Check the Domain Rating, trust-checked TrueDR, and monthly traffic of any website. Use the result to judge a link or compare a rival.
- [AI SEO Tools Ranked by Website Trust | VerifiedDR](https://verifieddr.com/ai-seo-tools): Compare AI tools by checked website trust. TrueDR shows whether traffic and trusted links support each site's Domain Rating.
- [Website Visibility API Built for AI Agents | VerifiedDR](https://verifieddr.com/agents): Give your AI agent a website visibility API. It finds where AI visibility slipped, picks verified next steps, drafts the work and tracks what changed.
- [Run a DR Growth Loop with an AI Agent | VerifiedDR](https://verifieddr.com/agents/growth-loop): Run a DR growth loop with an AI agent. Find what holds your Domain Rating back, pick a verified backlink opportunity, draft a proposal and track what changes.
- [Prove Visibility Progress with an AI Agent | VerifiedDR](https://verifieddr.com/agents/visibility-progress): Prove visibility progress with an AI agent. Check how TrueDR moved, find weak backlinks, pick one next step and write an update a client can read.
- [Tune AI Visibility Questions with an Agent | VerifiedDR](https://verifieddr.com/agents/tune-ai-questions): Tune the AI visibility questions VerifiedDR asks ChatGPT, Perplexity, Google AI and Claude. Add buyer questions, target a country and compare scans.
- [Find Sponsors & Partners with an AI Agent | VerifiedDR](https://verifieddr.com/agents/find-prospects): Find sponsors and partners worth pitching with an AI agent. Rank websites by TrueDR, keep the ones with validated traffic and check the evidence first.
- [Clear Your Link Exchange Inbox with an Agent | VerifiedDR](https://verifieddr.com/agents/inbox-triage): Clear your link exchange inbox with an AI agent. It summarizes waiting proposals, checks each website's trust evidence and drafts replies for your approval.
- [Verify a New Website with an AI Agent | VerifiedDR](https://verifieddr.com/agents/launch-a-site): List and verify a new website on VerifiedDR with an AI agent. Choose categories, embed the badge, and read the first DR and TrueDR baseline.
- [Google Index Audit Agent Workflow | VerifiedDR](https://verifieddr.com/agents/gsc-audit): Run a Google index audit with an AI agent. Check sitemap health, pages Google skips and soft 404s, then approve the fixes through the VerifiedDR CLI.
- [AI Link Exchange Workflow, Verified Backlinks | VerifiedDR](https://verifieddr.com/agents/link-exchange): Use an AI link exchange workflow with the VerifiedDR CLI. Find a verified match, check the fit, preview one relevant link each, and send after approval.
- [AI Article Writing Workflow with Keyword Data | VerifiedDR](https://verifieddr.com/agents/write-article): AI article writing that starts with keyword data. Your agent picks a winnable keyword, checks product claims, drafts, scores and submits the page for indexing.
- [Competitor Visibility Analysis Agent Workflow | VerifiedDR](https://verifieddr.com/agents/competitor-teardown): Break down competitor visibility with an AI agent. Compare DR and TrueDR, map backlinks, find keywords you can contest and pick one step to close the gap.
- [AI Visibility Agent: Get Mentioned in AI | VerifiedDR](https://verifieddr.com/agents/ai-visibility): An AI visibility agent that reads where ChatGPT, Perplexity, Google AI and Claude name your website, which sources they cite and the next step to take.
- [Run a Fresh AI Visibility Scan with an Agent | VerifiedDR](https://verifieddr.com/agents/run-ai-visibility): Run a fresh AI visibility scan with an agent. Ask every tracked question across ChatGPT, Perplexity, Google AI and Claude, then compare the results.
- [Link Building Partners in Your Niche | VerifiedDR](https://verifieddr.com/link-building): Link building with verified website owners in your niche who are open to swapping links. Compare trust and traffic, then review a ready-to-send message.
- [Domain Rating leaderboard: top sites by TrueDR](https://verifieddr.com/leaderboard): This Domain Rating leaderboard ranks websites by TrueDR: real trust, not just link counts. Explore top websites across AI, marketing, SEO and more.
- [Top Founders by Verified Website Trust](https://verifieddr.com/founders): See founders ranked by total TrueDR across badge-verified websites, scored on traffic, age and trust evidence rather than link count alone.
- [Website profiles in plain markdown](https://verifieddr.com/website/verifieddr-com.md): Any public profile as markdown at /website/<slug>.md, with DR, TrueDR, trust, traffic, category rank and score history.
- [Founder portfolios in plain markdown](https://verifieddr.com/founder/thijs_smudde.md): Any founder profile as markdown at /founder/<handle>.md, with portfolio totals, website scores and milestones.
- [Founder leaderboard in plain markdown](https://verifieddr.com/founders.md): Compare founders by combined TrueDR. See changes each week, portfolio totals and how the ranking works.
- [AI agent setup in plain markdown](https://verifieddr.com/agents.md): Connect an AI agent through MCP or the vdr CLI. Find commands and guides for each task.

## Comparisons
- [Compare Websites by DR, Trust and Traffic | VerifiedDR](https://verifieddr.com/compare): Compare two websites by Domain Rating, TrueDR, trust score, monthly traffic, and global rank. Free side-by-side results with no account required.
- [VerifiedDR vs FrogDR vs Ahrefs Domain Rating Checker](https://verifieddr.com/compare/verifieddr-vs-frogdr-vs-ahrefs): Compare VerifiedDR, FrogDR, and the free Ahrefs Domain Rating checker by tracking, trust analysis, growth plans, link exchanges, AI visibility, and price.
- [VerifiedDR vs Moz vs Semrush Website Score Checkers](https://verifieddr.com/compare/verifieddr-vs-moz-vs-semrush): Compare VerifiedDR, the free Moz Domain Analysis tool and the Semrush checker by tracking, trust checks, next steps, link exchanges, AI visibility and price.

## Pricing
- [VerifiedDR Pricing: Raise Your Domain Rating Faster](https://verifieddr.com/pricing): Raise your Domain Rating faster with a 90-day program. Get a plan each week, first proposals in week one and a day-90 report. One payment from $299.
- [VerifiedDR pricing in plain markdown](https://verifieddr.com/pricing.md): Compare growth programs, prices and usage limits in plain text.

## Resources
- [Which websites AI assistants cite most](https://verifieddr.com/ai-cited): See which websites ChatGPT, Perplexity, Google AI and Claude use as sources in buying answers. Explore aggregate source data refreshed weekly.
- [Which brands AI assistants recommend, by category](https://verifieddr.com/ai-answers): See how often AI assistants recommend each brand by category, based on real ChatGPT, Perplexity, Google AI and Claude answers.
- [VerifiedDR Statistics: DR vs TrueDR](https://verifieddr.com/stats): Compare DR with trust-adjusted TrueDR, verification, and monthly traffic across the VerifiedDR index.
- [VerifiedDR blog: visibility, backlinks, and TrueDR](https://verifieddr.com/blog): The VerifiedDR blog covers Domain Rating, backlink quality, real traffic, the TrueDR score and link exchanges that help websites grow.
- [AI SEO Agency Strategy Starts With Traditional SEO](https://verifieddr.com/blog/ai-seo-agency-traditional-seo-strategy): Why a good AI SEO agency starts with traditional SEO. DR 71 and an AI Visibility Score of 14 show the gap between search and AI visibility.
- [LaunchChair and the spec-driven development loop](https://verifieddr.com/blog/launchchair-spec-driven-development-loop): How LaunchChair turns startup validation, living product specs, spec-aware prompts, launch workflow, and SEO/GEO/AEO into one AI build loop.
- [BuildHop now shows TrueDR by VerifiedDR](https://verifieddr.com/blog/not-all-backlinks-are-created-equal): BuildHop helps founders earn quality directory backlinks. VerifiedDR now shows them whether those links translate into real, trusted visibility.
- [Context.dev: visibility work needs fresh web context](https://verifieddr.com/blog/authority-work-needs-fresh-web-context): Context.dev turns domains and URLs into typed brand, web, and AI-ready data. Learn why fresh web context matters for visibility workflows.
- [Wysera: content needs trust, and trust needs content](https://verifieddr.com/blog/wysera-ai-and-verifieddr-content-authority-loop): Wysera.ai runs the content and revenue loop. VerifiedDR shows whether the trust behind that work is real enough to compound.
- [PerplexityBot user agent and robots.txt rules | VerifiedDR](https://verifieddr.com/blog/perplexitybot-user-agent): The exact PerplexityBot user agent and Perplexity-User strings, robots.txt rules to allow or block each bot and how to verify hits with Perplexity's IP lists.
- [GPTBot robots.txt, OAI-SearchBot and ChatGPT-User](https://verifieddr.com/blog/gptbot-robots-txt): GPTBot robots.txt rules that block OpenAI training but keep your website in ChatGPT search. User agents for GPTBot, OAI-SearchBot and ChatGPT-User.
- [What is a good Domain Rating? Data from 570 websites](https://verifieddr.com/blog/what-is-a-good-domain-rating): What is a good Domain Rating? Of 570 verified websites the median DR is 21. DR 30 is the top quarter and DR 50 the top 5%. By category, 28 September 2026.
- [A $1,000 website acquisition, 3 months later | VerifiedDR](https://verifieddr.com/blog/website-acquisition-verifieddr-3-months): VerifiedDR was a $1,000 website acquisition in June 2026. Three months later it earns about $1,000 a month. The numbers, the product changes and the lessons.
- [LaunchPanda shows live DR tracking by VerifiedDR](https://verifieddr.com/blog/launchpanda-live-dr-tracking): LaunchPanda helps indie builders launch everywhere at once. Live VerifiedDR trackers now show whether those launches are building real visibility.

## Company
- [About VerifiedDR: earn your place at the top](https://verifieddr.com/about): Our vision: the best companies become the most trusted websites in their market without buying their way there. See how VerifiedDR helps you earn links.
- [Privacy Policy](https://verifieddr.com/privacy): How VerifiedDR collects, uses, and protects data. Read our privacy policy.
- [Terms of Service](https://verifieddr.com/terms): The terms that govern your use of VerifiedDR. Read our terms of service.
- [Data Processing Addendum](https://verifieddr.com/dpa): The data processing addendum that covers business and agency use of VerifiedDR.
- [VerifiedDR Support: Account & Data Help](https://verifieddr.com/support): VerifiedDR support for your account, billing and data. Contact our team with questions about DR, TrueDR and visibility data.
- [Chrome Extension Privacy Policy | VerifiedDR](https://verifieddr.com/extension-privacy): How the VerifiedDR Chrome extension handles your data: what it collects, what it never sees, and how lookups stay private.

## Contact
- Email: contact@verifieddr.com

## About VerifiedDR

Become the most authoritative website in your market.
Our vision is a future where the best companies become the most authoritative sources on the internet, without buying their way to the top.
VerifiedDR helps owners find the websites that fit their topic and audience, check the evidence and earn the right links.
Owners choose which links help their readers. A backlink is a link from another website to yours.
Track your Domain Rating as rankings, AI citations and organic traffic follow the climb.

## DR and TrueDR

Domain Rating (DR) is a score from third-party providers.
TrueDR checks that score against trust and traffic.
A high DR with a low TrueDR means the links carry less trust than the DR suggests.
Website profiles show these scores, traffic checks and score history.
The Trust Map shows the websites that link to a site.

## Find the next step

- Link Exchange: find verified websites on your topic and discuss links with their owners.
- Backlinks: find lost links to recover and review the quality of the websites that link to you.
- Search terms: find terms to target and compare the DR of sites in Google's top results.
- Google visibility: connect Google Search Console to see search results and pages Google skips.
- AI visibility: see whether ChatGPT, Perplexity, Google AI and Claude name your business for buyer questions.
- Competitors: compare links, search terms and visibility to choose what to improve.

The visibility score counts mentions in AI answers. Read each answer to see whether AI recommends the business.
Track whether your DR, Google rankings and AI mentions improve as you work on the plan.

## Growth programs

Free shows where your website stands. A growth program adds steps to build better backlinks.
A program covers 90 days with one payment for one campaign website.
It includes a baseline, a growth plan, steps each week and a report at day 90.
The programs are Grow, Scale and Managed.
Managed includes outreach and backlink work by VerifiedDR.
See the [pricing page](https://verifieddr.com/pricing) for current prices and limits.

Every program bought on or after 17 October 2026 carries a DR guarantee: the campaign website's Domain Rating is higher on day 90 than on its day-1 baseline, or a full refund.
Every program also promises the work on a fixed schedule: a day-1 baseline, a plan each week, the first proposals in week one and a before and after report on day 90.
Rankings, AI citations and traffic are tracked, not guaranteed.
The [terms](https://verifieddr.com/terms) set out the program terms.
Monitoring is available after a completed program.

## Tools for developers and AI agents

VerifiedDR provides a public REST API, an MCP server and the vdr CLI.
The Chrome extension provides website scores and page checks.
Public website and founder profiles have plain Markdown versions.
The [agent guide](https://verifieddr.com/agents.md) explains setup, access and commands.

## Articles

Every article is also served as plain markdown at the same URL with a `.md` suffix.

### What is a good Domain Rating?

- URL: https://verifieddr.com/blog/what-is-a-good-domain-rating
- Markdown: https://verifieddr.com/blog/what-is-a-good-domain-rating.md
- Published: 2026-09-28
- Summary: The DR of 570 verified websites, by category. The median is 21, DR 30 is the top quarter and DR 50 the top 5%. Plus DR 0, DR drops and what DR 50 takes.
- Short answer: A good Domain Rating matches or beats the websites that rank for your search terms. As a general bar, the median DR of the 570 verified websites on VerifiedDR was 21 on 28 September 2026. DR 30 put a website in the top quarter, DR 40 in the top 10% and DR 50 in the top 5%.
- Answers:
  - What is a good Domain Rating for a new website?
  - What does a Domain Rating of 0 mean?
  - Why is my Domain Rating dropping?
  - How many referring websites do you need for DR 50?
  - Is DR 30 a good Domain Rating?

### A $1,000 website acquisition. What happened in 3 months

- URL: https://verifieddr.com/blog/website-acquisition-verifieddr-3-months
- Markdown: https://verifieddr.com/blog/website-acquisition-verifieddr-3-months.md
- Published: 2026-09-22
- Summary: Thijs Smudde acquired VerifiedDR for $1,000 in June 2026. Three months later it earns about $1,000 a month. The numbers, what changed in the product and the lessons.
- Short answer: VerifiedDR was acquired for $1,000 at the start of June 2026. By 21 September 2026 it earned about $1,000 a month, with $3,447 in total revenue at a 95% margin and no ads. The index grew from 1,681 to over 4,600 websites and the website's own Domain Rating went from 46 to 68. All numbers come from the founder's video of that date.
- Answers:
  - How much did VerifiedDR cost to acquire?
  - How much does VerifiedDR earn after the acquisition?
  - Why does VerifiedDR sell 90-day programs instead of subscriptions?
  - How did the VerifiedDR index grow?
  - What is the Domain Rating of verifieddr.com?
  - What is PromptRadar?

### AI SEO Agency Strategy Starts With Traditional SEO

- URL: https://verifieddr.com/blog/ai-seo-agency-traditional-seo-strategy
- Markdown: https://verifieddr.com/blog/ai-seo-agency-traditional-seo-strategy.md
- Published: 2026-08-14
- Summary: Traditional SEO gives AI search a crawlable, useful, and trusted source to retrieve. See why VerifiedDR partner Intellar starts there before adding AI-specific work.
- Short answer: Traditional SEO should lead your AI search strategy because AI systems still need pages they can find, understand, and trust. AI-specific work adds prompt research, clear answer formats, wider brand mentions, and separate visibility tracking, but it cannot rescue blocked pages, weak content, or missing evidence.
- Answers:
  - What does an AI SEO agency do?
  - How is AI SEO different from traditional SEO?
  - Can traditional SEO improve AI visibility?
  - Should I hire an AI SEO specialist or an agency?
  - How should AI SEO results be measured?

### LaunchPanda shows live DR tracking by VerifiedDR

- URL: https://verifieddr.com/blog/launchpanda-live-dr-tracking
- Markdown: https://verifieddr.com/blog/launchpanda-live-dr-tracking.md
- Published: 2026-07-14
- Summary: LaunchPanda helps indie builders launch everywhere at once. Live VerifiedDR trackers now show whether those launches are building real visibility.
- Answers:
  - What does the LaunchPanda and VerifiedDR partnership include?
  - What is LaunchPanda's Auto Launch?
  - Do directory launches actually improve Domain Rating?
  - How is TrueDR different from the DR shown in LaunchPanda?

### LaunchChair and the spec-driven development loop

- URL: https://verifieddr.com/blog/launchchair-spec-driven-development-loop
- Markdown: https://verifieddr.com/blog/launchchair-spec-driven-development-loop.md
- Published: 2026-06-30
- Summary: LaunchChair gives AI-assisted founders a product loop before the build loop: validate the market, write the living spec, generate build prompts, launch with SEO/GEO/AEO context, and keep iterating.
- Answers:
  - How does LaunchChair keep AI-generated MVPs from drifting?
  - What role does LaunchChair play in an AI build workflow?
  - Why does a spec-driven loop matter for SEO?

### Wysera: content needs trust, and trust needs content

- URL: https://verifieddr.com/blog/wysera-ai-and-verifieddr-content-authority-loop
- Markdown: https://verifieddr.com/blog/wysera-ai-and-verifieddr-content-authority-loop.md
- Published: 2026-06-25
- Summary: Wysera.ai runs the content and revenue loop. VerifiedDR shows whether the trust behind that work is real enough to compound.
- Answers:
  - How do content and trust work together?
  - Why does content need trust?
  - Where do Wysera and VerifiedDR overlap?

### Context.dev: visibility work needs fresh web context

- URL: https://verifieddr.com/blog/authority-work-needs-fresh-web-context
- Markdown: https://verifieddr.com/blog/authority-work-needs-fresh-web-context.md
- Published: 2026-06-25
- Summary: Context.dev turns domains and URLs into typed brand, web, and AI-ready data. That's exactly the missing layer behind better visibility workflows.
- Answers:
  - What is Context.dev?
  - Why do agents need fresh web context?
  - How does Context.dev support VerifiedDR-style workflows?

### BuildHop now shows TrueDR by VerifiedDR

- URL: https://verifieddr.com/blog/not-all-backlinks-are-created-equal
- Markdown: https://verifieddr.com/blog/not-all-backlinks-are-created-equal.md
- Published: 2026-06-17
- Summary: BuildHop helps founders earn quality directory backlinks. VerifiedDR now shows them whether those links translate into real, trusted visibility.
- Answers:
  - Why are some backlinks worth more than others?
  - What does TrueDR measure that DR can miss?
  - Why is BuildHop relevant to TrueDR?

### PerplexityBot user agent and robots.txt rules

- URL: https://verifieddr.com/blog/perplexitybot-user-agent
- Markdown: https://verifieddr.com/blog/perplexitybot-user-agent.md
- Published: 2026-09-28
- Summary: The exact PerplexityBot and Perplexity-User strings, the robots.txt rules for each bot and how to check a hit against Perplexity's IP lists.
- Short answer: The PerplexityBot user agent is Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; PerplexityBot/1.0; +https://perplexity.ai/perplexitybot). It crawls for Perplexity search and follows robots.txt. Perplexity-User fetches pages when a person asks a question and generally ignores robots.txt, so blocking it takes a server or firewall rule. Both bots have a published IP list.
- Answers:
  - What is the PerplexityBot user agent string?
  - Does PerplexityBot respect robots.txt?
  - Does Perplexity-User follow robots.txt?
  - Is PerplexityBot used to train AI models?
  - How do I check that a request really came from Perplexity?
  - How do I block Perplexity completely?

### GPTBot robots.txt for all three OpenAI crawlers

- URL: https://verifieddr.com/blog/gptbot-robots-txt
- Markdown: https://verifieddr.com/blog/gptbot-robots-txt.md
- Published: 2026-09-28
- Summary: GPTBot trains models, OAI-SearchBot builds ChatGPT search and ChatGPT-User reads pages for a person. The user agents, the robots.txt rules and how to check your logs.
- Short answer: To keep your content out of OpenAI model training but stay in ChatGPT search, disallow GPTBot in robots.txt and allow OAI-SearchBot. GPTBot crawls pages that may be used for training. OAI-SearchBot builds the ChatGPT search index. ChatGPT-User fetches a page when a person asks ChatGPT something, and OpenAI says robots.txt may not apply to it.
- Answers:
  - Does blocking GPTBot remove my website from ChatGPT?
  - What is the GPTBot user agent?
  - What is the difference between OAI-SearchBot and ChatGPT-User?
  - Does ChatGPT-User respect robots.txt?
  - How long does a robots.txt change take for OpenAI?
  - Why does GPTBot seem to ignore my robots.txt?