Возраст домена | n/a |
Дата окончания | n/a |
PR | 3 |
ИКС | n/a |
Страниц в Google | 2260 |
Страниц в Яндексе | 25 |
Dmoz | Нет |
Яндекс Каталог | Нет |
Alexa Traffic Rank | 669867 |
Alexa Country | ![]() |
История изменения показателей | Авторизация |
Annunci Gratis - Annunci Classificati Italia
n/a
Annunci Gratis - Annunci Classificati Italia
UTF-8
49.99 КБ
261
2 356 симв.
2 042 симв.
Счетчик | Посетители за 24 часа | Просмотры | Просмотров на посетителя |
---|---|---|---|
![]() | Нет доступа | Нет доступа | n/a |
#
# robots.txt
#
# This file is to prevent the crawling and indexing of certain parts
# of your site by web crawlers and spiders run by sites like Yahoo!
# and Google. By telling these "robots" where not to go on your site,
# you save bandwidth and server resources.
#
# This file will be ignored unless it is at the root of your host:
# Used: http://example.com/robots.txt
# Ignored: http://example.com/site/robots.txt
#
# For more information about the robots.txt standard, see:
# http://www.robotstxt.org/robotstxt.html
#
# For syntax checking, see:
# http://www.frobee.com/robots-txt-check
User-agent: *
Disallow: /
# Only allow search engine crawler bots from google, bing, baidu, yahoo, yandex, goo, naver , ask .
# Only image, mobile, and regular search engine crawler bots allowed.
# The user-agent values are not case-sensitive and can be ‘grouped’, per developers.google.com.
# Google
# http://www.mcanerin.com/EN/search-engine/robots-txt.asp
User-agent: Googlebot
User-agent: googlebot-image
User-agent: googlebot-mobile
# Microsoft Bing
# http://www.mcanerin.com/EN/search-engine/robots-txt.asp
User-agent: MSNBot
# Yahoo
# http://www.mcanerin.com/EN/search-engine/robots-txt.asp
User-agent: Slurp
User-agent: yahoo-mmcrawler
# Ask
# http://www.mcanerin.com/EN/search-engine/robots-txt.asp
User-agent: Teoma
# Baidu (China)
# Info: http://www.baidu.com/search/spider.htm
User-agent: baiduspider
User-agent: baiduspider-image
# Yandex (Russia)
# http://www.mcanerin.com/EN/search-engine/robots-txt.asp
User-agent: Yandex
# Goo (Japan)
# Info (Japanese): http://help.goo.ne.jp/help/article/704/
# Info (English): http://help.goo.ne.jp/help/article/853/
User-agent: moget
User-agent: ichiro
# Naver (Korea)
# Info: http://help.naver.com/customer/etc/webDocument02.nhn
User-agent: naverbot
User-agent: yeti
Crawl-delay: 300
Allow: /
HTTP/1.1 200 OK
Date: Thu, 18 Jan 2018 00:08:55 GMT
Content-Type: text/html; charset=utf-8
Set-Cookie: ses_gen=jb2nqht4bat20r51g2s3afuo10; path=/; domain=blidoo.it
Expires: Fri, 19 Jan 2018 00:08:55
Cache-Control: public, max_age=86400
Last-Modified: Thu, 18 Jan 2018 00:08:55
Age: 0
X-Cache: MISS
X-Cache-Hits: 0
Transfer-Encoding: chunked
Connection: keep-alive
Accept-Ranges: bytes
Кнопка для анализа сайта в один клик, для установки перетащите ссылку на "Панель закладок"