io.github.sharozdawa/robotstxt-ai✓
io.github.sharozdawa/robotstxt-ai · v1.0.1
ⓘAbout
Analyze and generate robots.txt with AI crawler detection for 20+ bots like GPTBot and ClaudeBot.
＋Endpoints
Package
npm: robotstxt-ai-mcp
Analyze and generate robots.txt with AI crawler detection for 20+ bots like GPTBot and ClaudeBot.