PR | 2 |
ИКС | |
Страниц в Google | 170 |
Страниц в Яндексе | 62 |
Dmoz | ![]() |
Яндекс Каталог | Нет |
Alexa Traffic Rank | 3633600 |
Alexa Country | Нет данных |
История изменения показателей | Авторизация |
Идет сбор информации... Обновить
home [SLUUG Wiki]
home
n/a
UTF-8
16.99 КБ
465
3 350 симв.
2 736 симв.
#*******************************************************************************
#
# Control access by search engines, crawlers, spiders, or robots.
# Control is also possible by obots meta tags or X-Robots-Tag HTTP headers.
#
# This file must be named robots.txt in the root directory of the web site.
#
# Compliance by the visitor is voluntary.
# This file is purely advisory, it dpends on the cooperation of the robot.
# This doesn't stop malicious bots, crackers, humans, etc.
#
# Access is allowed everywhere (unlimited access) unless explicitly disallowed.
#
# See http://en.wikipedia.org/wiki/Robots.txt
#
#*******************************************************************************
User-agent: * # Affects all robots
Crawl-delay: 10 # Seconds to wait between requests
Disallow: /tmp/ # Private working directory
# Directories
Disallow: /private/ # Private working directory
Disallow: /test/ # Private working directory
Disallow: /incoming/ # Private working directory
#Disallow: /images/ # Images
Disallow: /cgi # Executable programs - Any cgi*
# Files
# None
# 01/07/2019 MK - Block useless high volume bot: http://www.semrush.com/bot.html
User-agent: SemrushBot
Disallow: /
США - 207.223.253.71
Contegix
Contegix
HTTP/1.1 200 OK
Date: Sun, 06 Oct 2019 18:01:15 GMT
Server: Apache
Vary: Cookie,Accept-Encoding
Set-Cookie: DokuWiki=dlbkfp8kfdc2q57ssgpcm4toq7; path=/; secure; HttpOnly
Expires: Thu, 19 Nov 1981 08:52:00 GMT
Cache-Control: no-store, no-cache, must-revalidate
Pragma: no-cache
Set-Cookie: DW7fa065a06cb74b536c124cfbe56ac6d3=deleted; expires=Thu, 01-Jan-1970 00:00:01 GMT; Max-Age=0; path=/; secure; HttpOnly
X-UA-Compatible: IE=edge,chrome=1
Transfer-Encoding: chunked
Content-Type: text/html; charset=utf-8
Кнопка для анализа сайта в один клик, для установки перетащите ссылку на "Панель закладок"