mirror of
https://github.com/RayLabsHQ/gitea-mirror.git
synced 2025-12-11 22:16:44 +03:00
Updated website deisgn
This commit is contained in:
8
www/public/robots.txt
Normal file
8
www/public/robots.txt
Normal file
@@ -0,0 +1,8 @@
|
||||
# Robots.txt for Gitea Mirror
|
||||
User-agent: *
|
||||
Allow: /
|
||||
Sitemap: https://gitea-mirror.com/sitemap.xml
|
||||
|
||||
# Crawl-delay for responsible crawling
|
||||
User-agent: *
|
||||
Crawl-delay: 1
|
||||
Reference in New Issue
Block a user