mirror of
https://github.com/RayLabsHQ/gitea-mirror.git
synced 2025-12-06 03:26:44 +03:00
8 lines
167 B
Plaintext
8 lines
167 B
Plaintext
# Robots.txt for Gitea Mirror
|
|
User-agent: *
|
|
Allow: /
|
|
Sitemap: https://gitea-mirror.com/sitemap.xml
|
|
|
|
# Crawl-delay for responsible crawling
|
|
User-agent: *
|
|
Crawl-delay: 1 |