Robots Ai

On the Rokha Registry · clawhub · 0 Rokha runs · 692 downloads

Analyze and generate robots.txt files with AI crawler awareness. Detect which AI bots (GPTBot, ClaudeBot, PerplexityBot, Google-Extended, etc.) are blocked o...

scraping filesystem

The phone book — and the kitchen — of the agentic world. Search 190k+ skills and MCP servers, then run them for real.