lib.itmens/misc/www/robots.txt
2023-12-30 22:20:57 -05:00

14 lines
210 B
Text

User-agent: CCBot
Disallow: /review/
User-agent: GPTBot
Disallow: /review/
User-agent: Google-Extended
Disallow: /review/
User-agent: FacebookBot
Disallow: /review/
User-agent: Omgilibot
Disallow: /review/