graphonline/robots.txt
2022-01-02 11:50:22 +02:00

27 lines
677 B
Plaintext
Executable File

User-Agent: *
Host: graphonline.ru
Disallow: /wiki/pmwiki.php/Main/AllRecentChanges
Disallow: /wiki/pmwiki.php/
Disallow: /wiki/*/search
Disallow: /wiki/SearchWiki
Disallow: /wiki/*RecentChanges
Disallow: /wiki/RecentChanges
Disallow: /wiki/*action=
Disallow: /wiki/action=
Disallow: /en/wiki/pmwiki.php/Main/AllRecentChanges
Disallow: /en/wiki/pmwiki.php/
Disallow: /en/wiki/*/search
Disallow: /en/wiki/SearchWiki
Disallow: /en/wiki/*RecentChanges
Disallow: /en/wiki/RecentChanges
Disallow: /en/wiki/*action=
Disallow: /en/wiki/action=
User-Agent: W3C-checklink
Disallow: /wiki/*
Disallow: /en/wiki/*
User-agent: Crawler
Disallow: /
User-agent: Yandex
Clean-param: graphName