limepotato/akkoma
1
0
Fork 0
Code Pull requests Activity

Apply 1 suggestion(s) to 1 file(s)

Browse source
This commit is contained in:
Ilja 2020-08-10 11:29:40 +00:00
parent e0dee833f2
commit a4a2d38640
1 changed files with 1 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
docs/configuration/static_dir.md
View file

@ -26,7 +26,7 @@ There's a mix tasks to [generate a new robot.txt](../../administration/CLI_tasks
For more complex things, you can write your own robots.txt to `$static_dir/robots.txt`. For more complex things, you can write your own robots.txt to `$static_dir/robots.txt`.
E.g. if you want to block all crawerls except for [fediverse.newtork](https://fediverse.network/about) you can use E.g. if you want to block all crawlers except for [fediverse.network](https://fediverse.network/about) you can use
``` ```
User-Agent: * User-Agent: *