Added robots.txt for each site.

This commit is contained in:
Alexander Andreev 2021-04-08 20:37:01 +04:00
parent 16c8690d35
commit 8d3db3c39c
Signed by: Arav
GPG Key ID: 610DF2574456329F
3 changed files with 8 additions and 0 deletions

View File

@ -0,0 +1,3 @@
User-agent: *
Disallow: /.well-known/
Disallow: /assets/

2
static/files/robots.txt Normal file
View File

@ -0,0 +1,2 @@
User-agent: *
Disallow: /assets/

3
static/radio/robots.txt Normal file
View File

@ -0,0 +1,3 @@
User-agent: *
Disallow: /assets/
Disallow: /stream.ogg