ИКС | |
Страниц в Google | 507000 |
Страниц в Яндексе | n/a |
Dmoz | Нет |
Яндекс Каталог | Нет |
Alexa Traffic Rank | 2124397 |
Alexa Country | Нет данных |
История изменения показателей | Авторизация |
Идет сбор информации... Обновить
n/a
n/a
n/a
ISO-8859-1
0.37 КБ
30
328 симв.
286 симв.
Идет сбор информации... Обновить
Идет сбор информации... Обновить
#Google Search Engine Robot
User-agent: Googlebot
Allow: /?_escaped_fragment_
Allow: /*?lang=
Allow: /hashtag/*?src=
Allow: /search?q=%23
Disallow: /search/realtime
Disallow: /search/users
Disallow: /search/*/grid
Disallow: /*?
Disallow: /*/followers
Disallow: /*/following
Disallow: /account/not_my_account
#Yahoo! Search Engine Robot
User-Agent: Slurp
Allow: /?_escaped_fragment_
Allow: /*?lang=
Allow: /hashtag/*?src=
Allow: /search?q=%23
Disallow: /search/realtime
Disallow: /search/users
Disallow: /search/*/grid
Disallow: /*?
Disallow: /*/followers
Disallow: /*/following
Disallow: /account/not_my_account
#Yandex Search Engine Robot
User-agent: Yandex
Allow: /?_escaped_fragment_
Allow: /*?lang=
Allow: /hashtag/*?src=
Allow: /search?q=%23
Disallow: /search/realtime
Disallow: /search/users
Disallow: /search/*/grid
Disallow: /*?
Disallow: /*/followers
Disallow: /*/following
Disallow: /account/not_my_account
#Microsoft Search Engine Robot
User-Agent: msnbot
Allow: /?_escaped_fragment_
Allow: /*?lang=
Allow: /hashtag/*?src=
Allow: /search?q=%23
Disallow: /search/realtime
Disallow: /search/users
Disallow: /search/*/grid
Disallow: /*?
Disallow: /*/followers
Disallow: /*/following
Disallow: /account/not_my_account
# Every bot that might possibly read and respect this file.
User-agent: *
Allow: /*?lang=
Allow: /hashtag/*?src=
Allow: /search?q=%23
Disallow: /search/realtime
Disallow: /search/users
Disallow: /search/*/grid
Disallow: /*?
Disallow: /*/followers
Disallow: /*/following
Disallow: /account/not_my_account
Disallow: /oauth
Disallow: /1/oauth
Disallow: /i/streams
Disallow: /i/hello
# Wait 1 second between successive requests. See ONBOARD-2698 for details.
Crawl-delay: 1
# Independent of user agent. Links in the sitemap are full URLs using https:// and need to match
# the protocol of the sitemap.
Sitemap: https://twitter.com/sitemap.xml
США - Ривертон - 216.58.218.244
HTTP/1.1 200 OK
Content-Type: text/plain; charset=iso-8859-1
X-Cloud-Trace-Context: 7b79785a601614e919809604d945d5e0
Date: Fri, 05 Oct 2018 15:37:58 GMT
Server: Google Frontend
Content-Length: 375
Кнопка для анализа сайта в один клик, для установки перетащите ссылку на "Панель закладок"