limepotato/limepot-xyz
1
0
Fork 0
Code Issues 3 Pull requests Activity

More robots.txt

Browse source
This commit is contained in:
nelle 2024-07-04 11:41:13 -06:00
parent c75f4c9479
commit 3dadac39fe
1 changed files with 12 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

12
public/robots.txt
View file

@ -30,8 +30,20 @@ Disallow: /
User-agent: Omgilibot User-agent: Omgilibot
Disallow: / Disallow: /
User-agent: Omgili
Disallow: /
User-Agent: FacebookBot User-Agent: FacebookBot
Disallow: / Disallow: /
User-agent: Amazonbot User-agent: Amazonbot
Disallow: / Disallow: /
User-agent: anthropic-ai
Disallow: /
User-agent: Bytespider
Disallow: /
User-agent: Applebot-Extended
Disallow: /