mirrors/graphonline
1
0
Fork 0
mirror of https://github.com/UnickSoft/graphonline.git synced 2026-08-27 04:38:04 +00:00
Code Issues Packages Projects Releases Wiki Activity

Disabled crawler

Browse Source
This commit is contained in:
Unick Soft
2018-04-27 21:21:31 +03:00
parent c4b72cca51
commit fdeb56c6c9
2 changed files with 4 additions and 25 deletions
Download Patch File Download Diff File Expand all files Collapse all files
robots.txt
+4 -1
View File
@@ -18,4 +18,7 @@ Disallow: /en/wiki/*action=
Disallow: /en/wiki/action=
User-Agent: W3C-checklink
Disallow: /wiki/*
Disallow: /en/wiki/*
Disallow: /en/wiki/*
User-agent: Crawler
Disallow: /