Search results

perplexity

Status: Open.

#117 In ai-robots-txt/ai.robots.txt;

· seolotsen opened on May 7, 2025

Bingbot Quandry

Status: Open.

#111 In ai-robots-txt/ai.robots.txt;

· dennislee1 opened on Apr 23, 2025

Bytespider and robots.txt

bugSomething isn't workingSomething isn't working

enhancementNew feature or requestNew feature or request

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#108 In ai-robots-txt/ai.robots.txt;

· dennislee1 opened on Apr 20, 2025

Expand explanation of .htaccess implementation in readme

documentationImprovements or additions to documentationImprovements or additions to documentation

good first issueGood for newcomersGood for newcomers

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#106 In ai-robots-txt/ai.robots.txt;

· splorp opened on Apr 17, 2025

Caddy snippet

enhancementNew feature or requestNew feature or request

good first issueGood for newcomersGood for newcomers

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#96 In ai-robots-txt/ai.robots.txt;

· extremelyonline opened on Apr 1, 2025

Blocking Opedia?

Status: Open.

#77 In ai-robots-txt/ai.robots.txt;

· juliemoynat opened on Feb 14, 2025

AI agents - potential candidates for robots.txt

Status: Open.

#75 In ai-robots-txt/ai.robots.txt;

· not-not-the-imp opened on Feb 5, 2025

Agents

Status: Open.

#72 In ai-robots-txt/ai.robots.txt;

· iandoug opened on Jan 26, 2025

Blocking Bytedance "hidden" AI bot

Status: Open.

#69 In ai-robots-txt/ai.robots.txt;

· bohwaz opened on Jan 9, 2025

The case of DuckAssistBot: real-time vs LLM bots

Status: Open.

#53 In ai-robots-txt/ai.robots.txt;

· nisbet-hubbard opened on Nov 9, 2024

Test dark visitors update and improve code/test_files/robots.json

good first issueGood for newcomersGood for newcomers

Status: Open.

#52 In ai-robots-txt/ai.robots.txt;

· glyn opened on Oct 20, 2024