gptbot
Here are 52 public repositories matching this topic...
Continuously-updated public IP ranges for major cloud providers, SaaS services, and bots — one txt file per provider, refreshed every 4 hours via GitHub Actions. Drop-in for firewalls, allowlists, and geo blocks.
-
Updated
Aug 13, 2026 - Shell
Machine-readable AI permissions for websites. A consolidated spec at /.well-known/ai-policy.json for declaring how AI agents may train on, search, or use your content.
-
Updated
Apr 18, 2026
GPT-Connect is a local bridge that lets ChatGPT or a Custom GPT control your own devices with authentication, using the same permissions as the account that runs it.
-
Updated
Jul 25, 2026 - Python
Self-hosted server log analytics for AI bot detection, AI agent monitoring, and AI visibility. Classifies GPTBot, ClaudeBot, ChatGPT-User, Perplexity & more from edge JSONL — no JS tag, no SaaS. Open-source alternative to Cloudflare AI Crawl Control.
-
Updated
Jun 10, 2026 - JavaScript
免费开源的 GEO 检测工具 | Free open-source GEO (Generative Engine Optimization) checker — 检测网站能否被 ChatGPT、Claude、Perplexity、Gemini 抓取、理解与引用
-
Updated
Aug 12, 2026 - JavaScript
🛡️ An GEO/SEO-friendly rate limiter for Go. Protects your server from abuse/DDoS while safely whitelisting verified Search Engines & AI Bots (Google, Bing, GPTBot, etc.) via IP/RDNS verification.
-
Updated
Jan 11, 2026 - Go
See which AI crawlers can read your site — GPTBot, ClaudeBot, PerplexityBot & 20 more. Curated, operator-sourced bot list + a zero-dep CLI and GitHub Action to audit robots.txt, test reachability, read access logs, and gate it all in CI.
-
Updated
Jul 21, 2026 - JavaScript
🤖 Generate optimized robots.txt files for AI search engine crawlers (GPTBot, PerplexityBot, ClaudeBot, and more)
-
Updated
Mar 9, 2026 - Python
Claude Code skill that generates and audits ai.txt, robots.txt (AI-crawler rules), llms.txt, and TDM opt-out files for websites.
-
Updated
Apr 24, 2026
Detect, verify, and log AI crawlers at the edge — no blocking. A Cloudflare Worker that confirms which AI bots (GPTBot, ClaudeBot, PerplexityBot…) really fetch your site using forward-confirmed reverse DNS, and flags impostors.
-
Updated
Aug 7, 2026 - JavaScript
Validates whether GPTBot, ClaudeBot, PerplexityBot and other LLM crawlers are allowed by a robots.txt file.
-
Updated
May 10, 2026 - Python
LogWerk is a lightweight, offline-first server log analyzer dashboard that runs entirely in your web browser.
-
Updated
Jul 28, 2026 - JavaScript
The best AEO/GEO skill for Claude Code. Audit, fix, and monitor your website's visibility across ChatGPT, Claude, Perplexity, Gemini, and Google AI Overviews. 100+ optimization techniques, 33 evidence collectors, 4-vector GEO Score. Built on Princeton KDD 2024 paper. Free, MIT.
-
Updated
May 1, 2026 - Python
Agent-native multi-bot web crawler simulator. See your site through the eyes of Googlebot, GPTBot, ClaudeBot, and PerplexityBot.
-
Updated
May 6, 2026 - Shell
Complete database of AI search engine crawler user-agents (GPTBot, PerplexityBot, ClaudeBot) with robots.txt configuration examples
-
Updated
Mar 9, 2026 - HTML
Interactive crawler IP intelligence dashboard for search, AI, and user-triggered fetchers.
-
Updated
Aug 13, 2026 - JavaScript
Local MCP tools for crawler-readability and discovery-file diagnostics
-
Updated
Aug 9, 2026 - JavaScript
Improve this page
Add a description, image, and links to the gptbot topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the gptbot topic, visit your repo's landing page and select "manage topics."