Files
hudozka/robots.txt
T
2015-07-12 21:02:08 +03:00

7 lines
146 B
Plaintext

User-agent: *
Disallow:
Allow: /
Host: art.shlisselburg.org
Sitemap: http://art.shlisselburg.org/sitemap.xml
Crawl-delay: 3
Crawl-rate: 1/3