Возраст домена | n/a |
Дата окончания | n/a |
PR | 4 |
ИКС | |
Страниц в Google | 203 |
Страниц в Яндексе | 1 |
Dmoz | Нет |
Яндекс Каталог | Нет |
Alexa Traffic Rank | 10259737 |
Alexa Country | Нет данных |
История изменения показателей | Авторизация |
Идет сбор информации... Обновить
BYATA: New Zealand Backpacker Youth and Adventure Tourism Association
n/a
n/a
UTF-8
15.84 КБ
249
1 860 симв.
1 577 симв.
Данные предоставлены сервисом semrush
Сайт | Общие фразы | PR | тИЦ | Alexa Rank | Alexa Country | |
---|---|---|---|---|---|---|
adventuretravelnews.com | 5 | 5 |
0 | 543973 | 436174 | |
wystc.org | 4 | 6 |
0 | 1647429 | Нет данных | |
newzealand.com | 2 | 8 |
0 | 30248 | 24647 | |
backpackerboard.co.nz | 2 | 5 |
10 | 274673 | 983 | |
umimarketing.net | 2 | 4 |
0 | Нет данных | Нет данных | |
kiwiexperience.com | 1 | 5 |
0 | 441702 | 37792 | |
bootsnall.com | 1 | 6 |
30 | 345576 | 157116 | |
bbh.co.nz | 1 | 5 |
10 | 1436638 | 9428 | |
backpack-newzealand.com | 1 | 4 |
0 | 19107202 | Нет данных | |
backpackrotoruanz.com | 1 | 1 |
0 | 13654571 | Нет данных | |
backpackingmatt.com | 1 | 3 |
0 | 1739780 | 310749 | |
backpackerbus.co.nz | 1 | 3 |
0 | 1579993 | Нет данных | |
saferpage.com | 1 | 3 |
10 | 14978785 | Нет данных | |
internetadvantage.com | 1 | 4 |
10 | 1937443 | Нет данных | |
grouptourmagazine.com | 1 | 4 |
0 | 21703195 | Нет данных | |
facebook.com | 1 | 9 |
0 | 3 | 3 | |
browserdefender.com | 1 | 6 |
190 | 979089 | Нет данных | |
backpackertradenews.com.au | 1 | 3 |
0 | 3117516 | Нет данных | |
alexa.com | 1 | 7 |
0 | 3614 | 4540 | |
acommonroom.org | 1 | 4 |
30 | 21700949 | Нет данных | |
Еще 30 сайтов после авторизации |
Данные предоставлены сервисом semrush
Счетчик | Посетители за 24 часа | Просмотры | Просмотров на посетителя |
---|---|---|---|
Google Analytics | Нет доступа | Нет доступа | n/a |
Внешние ссылки главной страницы ( 3 ) | |
facebook.com/groups/325146250942431/ | <img> |
linkedin.com/groups/6684428 | <img> |
announcedesign.co.nz | Web Design by Announce |
Внутренние ссылки главной страницы ( 27 ) | |
/index.html | HOME |
/about.html | ABOUT |
/membership.html | SIGN UP HERE |
/members.html | BYATA Members |
/board-members.html | Board Members |
/contact.html | CONTACT US |
/advocacy.html | Learn More |
/immigration.html | Immigration |
/tourism-2025.html | Tourism 2025 |
/working-holiday-visas.html | Working Holiday Visa |
/work-safe.html | Work Safe |
/drive-safe.html | Drive Safe |
/Sustainability-.html | Sustainability |
/AirBnB.html | AirBnB |
/research.html | Learn More |
/industry-tracker.html | BYATA Industry Tracker |
/international-tourism-data.html | Industry Tourism Data |
/NZ-Visa-Statistics.html | NZ Visa Statistics |
/conference.html | BYATA Conference |
/events.html | Tradeshows |
/news/index.html | NEWS |
/news/newsletters.html | Newsletters |
/news/C9-Board Meeting Minutes.html | Board Meeting Minutes |
/news/C8-News.html | News |
# | <img> |
/news.html | Learn More |
/site-map.html | SITE MAP |
[Querying whois.srs.net.nz]
[whois.srs.net.nz]
% New Zealand Domain Name Registry Limited
% Users confirm on submission their agreement to all published Terms
%
version: 5.00
query_datetime: 2013-04-16T20:48:36+12:00
domain_name: byata.org.nz
query_status: 200 Active
domain_dateregistered: 2010-11-30T15:00:07+13:00
domain_datebilleduntil: 2013-11-30T15:00:07+13:00
domain_datelastmodified: 2013-04-03T13:10:18+13:00
domain_delegaterequested: yes
domain_signed: no
%
registrar_name: 1st Domains
registrar_address1: P O Box 1520
registrar_address2: Christchurch Mail Centre
registrar_city: Christchurch
registrar_province: Canterbury
registrar_country: NZ (NEW ZEALAND)
registrar_phone: +64 3 962-9520
registrar_fax: +64 3 962-9513
registrar_email: hostmaster@1stdomains.net.nz
%
registrant_contact_name: NZ Backpacking Youth And Adventure Tourism Association
registrant_contact_address1: P.O. 2498
registrant_contact_address2: Wakatipu
registrant_contact_city: Queenstown
registrant_contact_province: Otago
registrant_contact_postalcode: 9349
registrant_contact_country: NZ (NEW ZEALAND)
registrant_contact_phone: +64 3 4418494
registrant_contact_email: daniel.roberts@xebidy.com
%
admin_contact_name: Dan Roberts
admin_contact_address1: Po Box 2498
admin_contact_address2: Wakatipu
admin_contact_city: Queenstown
admin_contact_postalcode: na
admin_contact_country: NZ (NEW ZEALAND)
admin_contact_phone: +64 3 441-8494
admin_contact_email: mat.weir@xebidy.com
%
technical_contact_name: NZ Backpacking Youth And Adventure Tourism Association
technical_contact_address1: P.O. 2498
technical_contact_address2: Wakatipu
technical_contact_city: Queenstown
technical_contact_province: Otago
technical_contact_postalcode: 9349
technical_contact_country: NZ (NEW ZEALAND)
technical_contact_phone: +64 3 4418494
technical_contact_email: daniel.roberts@xebidy.com
%
ns_name_01: ns1.1stdomains.net.nz
ns_name_02: ns2.1stdomains.net.nz
%
% Users are advised that the following activities are strictly forbidden.
%
% Using multiple WHOIS queries, or using the output of multiple WHOIS
% queries in conjunction with any other facility or service, to enable
% or effect a download of part or all of the .nz Register.
%
% Using any information contained in the WHOIS query output to attempt a
% targeted contact campaign with any person, or any organisation, using any
% medium.
%
% A breach of these conditions will be treated as a breach of the .nz Policies
% and Procedures. Sanctions in line with those specified in the policies and
% procedures at www.dnc.org.nz may result from any breach.
%
% Copyright InternetNZ
# Gogo System Default robots.txt
# This file may be updated automatically, to stop this and instead
# have a custom robots.txt, just delete these header comments.
###############################################################################
## DENIED BOTS
## - Bots which we do not allow at all, because they are bad, or useless.
###############################################################################
# Name : sqlmap
# Info :
# Header: sqlmap/1.3.7.38#dev (http://sqlmap.org)
User-agent: sqlmap
Disallow: /
# Name : BUbiNG
# Info :
# Header: BUbiNG (+http://law.di.unimi.it/BUbiNG.html)
User-agent: BUbiNG
Disallow: /
# Name : SiteExplorer
# Info : http://siteexplorer.info/Backlink-Checker-Spider/
# Header: Mozilla/5.0 (compatible; SiteExplorer/1.1b; +http://siteexplorer.info/Backlink-Checker-Spider/)
User-agent: SiteExplorer
Disallow: /
# Name : 360Spider
# Info :
# Header: Mozilla/5.0 (compatible; MSIE 9.0; Windows NT 6.1; Trident/5.0); 360Spider
User-agent: 360Spider
Disallow: /
# Name : cognitiveseo
# Info : http://cognitiveseo.com/bot.html
# Header: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.6) Gecko/20070725 Firefox/2.0.0.6 - James BOT - WebCrawler http://cognitiveseo.com/bot.html
User-agent: cognitiveseo
Disallow: /
# Name : MJ12bot
# Info : http://mj12bot.com/
# Header: Mozilla/5.0 (compatible; MJ12bot/v1.4.6; http://mj12bot.com/)
User-agent: MJ12bot
Disallow: /
# Name : rogerbot
# Info : http://moz.com/help/guides/search-overview/crawl-diagnostics#more-help,
# Header: rogerbot/1.1 (http://moz.com/help/guides/search-overview/crawl-diagnostics#more-help, rogerbot-crawler+pr2-crawler-06@moz.com)
User-agent: rogerbot
Disallow: /
# Name : Scrapy
# Info : http://scrapy.org
# Header: Scrapy/1.2.1 (+http://scrapy.org)
User-agent: Scrapy
Disallow: /
# Name : Screaming
# Info :
# Header: Screaming Frog SEO Spider/5.1
User-agent: Screaming
Disallow: /
# Name : SemrushBot
# Info : http://www.semrush.com/bot.html
# Header: Mozilla/5.0 (compatible; SemrushBot/1.1~bl; +http://www.semrush.com/bot.html)
User-agent: SemrushBot
Disallow: /
# Name : SMTBot
# Info : http://www.similartech.com/smtbot
# Header: Mozilla/5.0 (compatible; SMTBot/1.0; http://www.similartech.com/smtbot)
User-agent: SMTBot
Disallow: /
# Name : spbot
# Info : http://OpenLinkProfiler.org/bot
# Header: Mozilla/5.0 (compatible; spbot/4.4.0; +http://OpenLinkProfiler.org/bot )
User-agent: spbot
Disallow: /
# Name : vebidoobot
# Info :
# Header: vebidoobot
User-agent: vebidoobot
Disallow: /
# Name : YisouSpider
# Info :
# Header: YisouSpider
User-agent: YisouSpider
Disallow: /
# Name : ZoomBot
# Info : http://suite.seozoom.it/bot.html
# Header: ZoomBot (Linkbot 1.0 http://suite.seozoom.it/bot.html)
User-agent: ZoomBot
Disallow: /
# Name : AhrefsBot
# Info : http://ahrefs.com/robot/
# Header: Mozilla/5.0 (compatible; AhrefsBot/5.1; +http://ahrefs.com/robot/)
User-agent: AhrefsBot
Disallow: /
# Name : MegaIndex.ru
# Info : http://megaindex.com/crawler
# Header: Mozilla/5.0 (compatible; MegaIndex.ru/2.0; +http://megaindex.com/crawler)
User-agent: MegaIndex.ru
Disallow: /
# Name : aiHitBot
# Info : https://www.aihitdata.com/about
# Header: Mozilla/5.0 (compatible; aiHitBot/2.9; +https://www.aihitdata.com/about)
User-agent: aiHitBot
Disallow: /
# Name : BLEXBot
# Info : http://webmeup-crawler.com/
# Header: Mozilla/5.0 (compatible; BLEXBot/1.0; +http://webmeup-crawler.com/)
User-agent: BLEXBot
Disallow: /
# Name : BOT
# Info :
# Header: BOT/0.1 (BOT for JCE)
User-agent: BOT
Disallow: /
# Name : CCBot
# Info : http://commoncrawl.org/faq/
# Header: CCBot/2.0 (http://commoncrawl.org/faq/)
User-agent: CCBot
Disallow: /
# Name : CheckMarkNetwork
# Info : http://www.checkmarknetwork.com/spider.html
# Header: CheckMarkNetwork/1.0 (+http://www.checkmarknetwork.com/spider.html)
User-agent: CheckMarkNetwork
Disallow: /
# Name : Cliqzbot
# Info : http://cliqz.com/company/cliqzbot
# Header: Mozilla/5.0 (compatible; Cliqzbot/1.0 +http://cliqz.com/company/cliqzbot)
User-agent: Cliqzbot
Disallow: /
# Name : coccocbot-web
# Info : http://help.coccoc.com/searchengine
# Header: Mozilla/5.0 (compatible; coccocbot-web/1.0; +http://help.coccoc.com/searchengine)
User-agent: coccocbot-web
Disallow: /
# Name : DeuSu
# Info : https://deusu.de/robot.html
# Header: Mozilla/5.0 (compatible; DeuSu/5.0.2; +https://deusu.de/robot.html)
User-agent: DeuSu
Disallow: /
# Name : DomainStatsBot
# Info : http://domainstats.io/our-bot
# Header: DomainStatsBot/1.0 (http://domainstats.io/our-bot)
User-agent: DomainStatsBot
Disallow: /
# Name : DotBot
# Info : http://www.opensiteexplorer.org/dotbot,
# Header: Mozilla/5.0 (compatible; DotBot/1.1; http://www.opensiteexplorer.org/dotbot, help@moz.com)
User-agent: DotBot
Disallow: /
# Name : eCairn-Grabber
# Info : http://ecairn.com/grabber
# Header: Mozilla/5.0 eCairn-Grabber/1.0 (+http://ecairn.com/grabber)
User-agent: eCairn-Grabber
Disallow: /
# Name : Exabot
# Info : http://www.exabot.com/go/robot
# Header: Mozilla/5.0 (compatible; Exabot/3.0; +http://www.exabot.com/go/robot)
User-agent: Exabot
Disallow: /
# Name : FatBot
# Info : http://www.thefind.com/crawler
# Header: Mozilla/5.0 (compatible; FatBot 2.0; http://www.thefind.com/crawler)
User-agent: FatBot
Disallow: /
# Name : GrapeshotCrawler
# Info : http://www.grapeshot.co.uk/crawler.php
# Header: Mozilla/5.0 (compatible; GrapeshotCrawler/2.0; +http://www.grapeshot.co.uk/crawler.php)
User-agent: GrapeshotCrawler
Disallow: /
# Name : HaosouSpider
# Info : http://www.haosou.com/help/help_3_2.html
# Header: Mozilla/5.0 (compatible; MSIE 9.0; Windows NT 6.1; Trident/5.0); 360Spider(compatible; HaosouSpider; http://www.haosou.com/help/help_3_2.html)
User-agent: HaosouSpider
Disallow: /
# Name : linkdexbot
# Info : http://www.linkdex.com/bots/
# Header: Mozilla/5.0 (compatible; linkdexbot/2.0; +http://www.linkdex.com/bots/)
User-agent: linkdexbot
Disallow: /
# Name : ltx71
# Info : http://ltx71.com/
# Header: ltx71 - (http://ltx71.com/)
User-agent: ltx71
Disallow: /
# Name : Mail.RU_Bot
# Info : http://go.mail.ru/help/robots
# Header: Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/2.0; +http://go.mail.ru/help/robots)
User-agent: Mail.RU_Bot
Disallow: /
# Name : memoryBot
# Info : http://mignify.com/bot.html
# Header: Mozilla/5.0 (compatible; memoryBot/1.21.14 +http://mignify.com/bot.html)
User-agent: memoryBot
Disallow: /
# Name : psbot
# Info : http://www.picsearch.com/bot.html
# Header: psbot/0.1 (+http://www.picsearch.com/bot.html)
User-agent: psbot
Disallow: /
# Name : roboto
# Info :
# Header: roboto
User-agent: roboto
Disallow: /
# Name : SecurityResearch.bot
# Info : http://besome1.info/securityresearchbot.html
# Header: Mozilla/5.0 (compatible; SecurityResearch.bot; +http://besome1.info/securityresearchbot.html)
User-agent: SecurityResearch.bot
Disallow: /
# Name : SEOkicks-Robot
# Info : http://www.seokicks.de/robot.html
# Header: Mozilla/5.0 (compatible; SEOkicks-Robot; +http://www.seokicks.de/robot.html)
User-agent: SEOkicks-Robot
Disallow: /
# Name : SurdotlyBot
# Info : http://sur.ly/bot.html
# Header: Mozilla/5.0 (compatible; SurdotlyBot/1.0; +http://sur.ly/bot.html)
User-agent: SurdotlyBot
Disallow: /
# Name : WBSearchBot
# Info : http://www.warebay.com/bot.html
# Header: Mozilla/5.0 (compatible; WBSearchBot/1.1; +http://www.warebay.com/bot.html)
User-agent: WBSearchBot
Disallow: /
# Name : Wotbox
# Info : http://www.wotbox.com/bot/
# Header: Wotbox/2.01 (+http://www.wotbox.com/bot/)
User-agent: Wotbox
Disallow: /
# Name : yoozBot-2.2
# Info : http://yooz.ir
# Header: Mozilla/5.0 (compatible; yoozBot-2.2; http://yooz.ir; info@yooz.ir)
User-agent: yoozBot-2.2
Disallow: /
## REDUCED SPEED BOTS
## - Bots which we will allow, but are not very important so should slow down
###############################################################################
# Name : applebot
# Info : http://www.apple.com/go/applebot
# Header: Mozilla/5.0 (iPhone; CPU iPhone OS 8_1 like Mac OS X) AppleWebKit/600.1.4 (KHTML, like Gecko) Version/8.0 Mobile/12B410 Safari/600.1.4 (Applebot/0.1; +http://www.apple.com/go/applebot)
User-agent: applebot
Disallow: /__classpath/
Disallow: /__errorpages/
Disallow: /catalog/*?*Sort
Disallow: /catalog/*?*Filter
Disallow: /users/
Disallow: /newsletters/subscribers/
Disallow: /__*
Crawl-Delay: 5
# Name : bingbot
# Info : http://www.bing.com/bingbot.htm
# Header: Mozilla/5.0 (iPhone; CPU iPhone OS 7_0 like Mac OS X) AppleWebKit/537.51.1 (KHTML, like Gecko) Version/7.0 Mobile/11A465 Safari/9537.53 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)
User-agent: bingbot
Disallow: /__classpath/
Disallow: /__errorpages/
Disallow: /catalog/*?*Sort
Disallow: /catalog/*?*Filter
Disallow: /users/
Disallow: /newsletters/subscribers/
Disallow: /__*
Crawl-Delay: 5
# Name : BingPreview
# Info :
# Header: Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/534+ (KHTML, like Gecko) BingPreview/1.0b
User-agent: BingPreview
Disallow: /__classpath/
Disallow: /__errorpages/
Disallow: /catalog/*?*Sort
Disallow: /catalog/*?*Filter
Disallow: /users/
Disallow: /newsletters/subscribers/
Disallow: /__*
Crawl-Delay: 5
# Name : Googlebot-Mobile
# Info : http://www.google.com/bot.html
# Header: SAMSUNG-SGH-E250/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 UP.Browser/6.2.3.3.c.1.101 (GUI) MMP/2.0 (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html)
User-agent: Googlebot-Mobile
Disallow: /__classpath/
Disallow: /__errorpages/
Disallow: /catalog/*?*Sort
Disallow: /catalog/*?*Filter
Disallow: /users/
Disallow: /newsletters/subscribers/
Disallow: /__*
Crawl-Delay: 5
# Name : MsnBot-Media
# Info :
# Header: Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/534+ (KHTML, like Gecko) MsnBot-Media /1.0b
User-agent: MsnBot-Media
Disallow: /__classpath/
Disallow: /__errorpages/
Disallow: /catalog/*?*Sort
Disallow: /catalog/*?*Filter
Disallow: /users/
Disallow: /newsletters/subscribers/
Disallow: /__*
Crawl-Delay: 5
# Name : AdsBot-Google
# Info : http://www.google.com/adsbot.html
# Header: AdsBot-Google (+http://www.google.com/adsbot.html)
User-agent: AdsBot-Google
Disallow: /__classpath/
Disallow: /__errorpages/
Disallow: /catalog/*?*Sort
Disallow: /catalog/*?*Filter
Disallow: /users/
Disallow: /newsletters/subscribers/
Disallow: /__*
Crawl-Delay: 5
# Name : AdsBot-Google-Mobile
# Info : http://www.google.com/mobile/adsbot.html
# Header: Mozilla/5.0 (iPhone; CPU iPhone OS 9_1 like Mac OS X) AppleWebKit/601.1.46 (KHTML, like Gecko) Version/9.0 Mobile/13B143 Safari/601.1 (compatible; AdsBot-Google-Mobile; +http://www.google.com/mobile/adsbot.html)
User-agent: AdsBot-Google-Mobile
Disallow: /__classpath/
Disallow: /__errorpages/
Disallow: /catalog/*?*Sort
Disallow: /catalog/*?*Filter
Disallow: /users/
Disallow: /newsletters/subscribers/
Disallow: /__*
Crawl-Delay: 5
# Name : Baidu
# Info : http://www.baidu.com/search/spi_der.html
# Header: Mozilla/5.0 (Linux;u;Android 2.3.7;zh-cn;) AppleWebKit/533.1 (KHTML,like Gecko) Version/4.0 Mobile Safari/533.1 (compatible; +http://www.baidu.com/search/spi_der.html)
User-agent: Baidu
Disallow: /__classpath/
Disallow: /__errorpages/
Disallow: /catalog/*?*Sort
Disallow: /catalog/*?*Filter
Disallow: /users/
Disallow: /newsletters/subscribers/
Disallow: /__*
Crawl-Delay: 5
# Name : Baiduspider
# Info : http://www.baidu.com/search/spider.html
# Header: Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)
User-agent: Baiduspider
Disallow: /__classpath/
Disallow: /__errorpages/
Disallow: /catalog/*?*Sort
Disallow: /catalog/*?*Filter
Disallow: /users/
Disallow: /newsletters/subscribers/
Disallow: /__*
Crawl-Delay: 5
# Name : Baiduspider-image
# Info : http://www.baidu.com/search/spider.htm
# Header: Baiduspider-image+(+http://www.baidu.com/search/spider.htm)
User-agent: Baiduspider-image
Disallow: /__classpath/
Disallow: /__errorpages/
Disallow: /catalog/*?*Sort
Disallow: /catalog/*?*Filter
Disallow: /users/
Disallow: /newsletters/subscribers/
Disallow: /__*
Crawl-Delay: 5
# Name : Googlebot-Image
# Info :
# Header: Googlebot-Image/1.0
User-agent: Googlebot-Image
Disallow: /__classpath/
Disallow: /__errorpages/
Disallow: /catalog/*?*Sort
Disallow: /catalog/*?*Filter
Disallow: /users/
Disallow: /newsletters/subscribers/
Disallow: /__*
Crawl-Delay: 5
# Name : Googlebot-Video
# Info :
# Header: Googlebot-Video/1.0
User-agent: Googlebot-Video
Disallow: /__classpath/
Disallow: /__errorpages/
Disallow: /catalog/*?*Sort
Disallow: /catalog/*?*Filter
Disallow: /users/
Disallow: /newsletters/subscribers/
Disallow: /__*
Crawl-Delay: 5
# Name : Slurp
# Info : http://help.yahoo.com/help/us/ysearch/slurp
# Header: Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)
User-agent: Slurp
Disallow: /__classpath/
Disallow: /__errorpages/
Disallow: /catalog/*?*Sort
Disallow: /catalog/*?*Filter
Disallow: /users/
Disallow: /newsletters/subscribers/
Disallow: /__*
Crawl-Delay: 5
# Name : YandexBot
# Info : http://yandex.com/bots
# Header: Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)
User-agent: YandexBot
Disallow: /__classpath/
Disallow: /__errorpages/
Disallow: /catalog/*?*Sort
Disallow: /catalog/*?*Filter
Disallow: /users/
Disallow: /newsletters/subscribers/
Disallow: /__*
Crawl-Delay: 5
# Name : YandexImageResizer
# Info : http://yandex.com/bots
# Header: Mozilla/5.0 (compatible; YandexImageResizer/2.0; +http://yandex.com/bots)
User-agent: YandexImageResizer
Disallow: /__classpath/
Disallow: /__errorpages/
Disallow: /catalog/*?*Sort
Disallow: /catalog/*?*Filter
Disallow: /users/
Disallow: /newsletters/subscribers/
Disallow: /__*
Crawl-Delay: 5
# Name : YandexImages
# Info : http://yandex.com/bots
# Header: Mozilla/5.0 (compatible; YandexImages/3.0; +http://yandex.com/bots)
User-agent: YandexImages
Disallow: /__classpath/
Disallow: /__errorpages/
Disallow: /catalog/*?*Sort
Disallow: /catalog/*?*Filter
Disallow: /users/
Disallow: /newsletters/subscribers/
Disallow: /__*
Crawl-Delay: 5
# Name : msnbot-media
# Info : http://search.msn.com/msnbot.htm
# Header: msnbot-media/1.1 (+http://search.msn.com/msnbot.htm)
User-agent: msnbot-media
Disallow: /__classpath/
Disallow: /__errorpages/
Disallow: /catalog/*?*Sort
Disallow: /catalog/*?*Filter
Disallow: /users/
Disallow: /newsletters/subscribers/
Disallow: /__*
Crawl-Delay: 5
# Name : archive.org_bot
# Info : http://www.archive.org/details/archive.org_bot
# Header: Mozilla/5.0 (compatible; archive.org_bot +http://www.archive.org/details/archive.org_bot)
User-agent: archive.org_bot
Disallow: /__classpath/
Disallow: /__errorpages/
Disallow: /catalog/*?*Sort
Disallow: /catalog/*?*Filter
Disallow: /users/
Disallow: /newsletters/subscribers/
Disallow: /__*
Crawl-Delay: 5
# Name : Pinterest
# Info : http://www.pinterest.com/
# Header: Pinterest/0.2 (+http://www.pinterest.com/)
User-agent: Pinterest
Disallow: /__classpath/
Disallow: /__errorpages/
Disallow: /catalog/*?*Sort
Disallow: /catalog/*?*Filter
Disallow: /users/
Disallow: /newsletters/subscribers/
Disallow: /__*
Crawl-Delay: 5
# Name : SearchNZ
# Info : http://www.searchnz.co.nz/
# Header: Mozilla/5.0 (compatible; SearchNZ; +http://www.searchnz.co.nz/)
User-agent: SearchNZ
Disallow: /__classpath/
Disallow: /__errorpages/
Disallow: /catalog/*?*Sort
Disallow: /catalog/*?*Filter
Disallow: /users/
Disallow: /newsletters/subscribers/
Disallow: /__*
Crawl-Delay: 5
# Name : Twitterbot
# Info :
# Header: Twitterbot/1.0
User-agent: Twitterbot
Disallow: /__classpath/
Disallow: /__errorpages/
Disallow: /catalog/*?*Sort
Disallow: /catalog/*?*Filter
Disallow: /users/
Disallow: /newsletters/subscribers/
Disallow: /__*
Crawl-Delay: 5
## FAST BOTS
## - Bots which we allow to come as fast as they can, self-regulating bots
###############################################################################
# Name : Googlebot
# Info : http://www.google.com/bot.html
# Header: Mozilla/5.0 (iPhone; CPU iPhone OS 6_0 like Mac OS X) AppleWebKit/536.26 (KHTML, like Gecko) Version/6.0 Mobile/10A5376e Safari/8536.25 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
User-agent: Googlebot
Disallow: /__classpath/
Disallow: /__errorpages/
Disallow: /catalog/*?*Sort
Disallow: /catalog/*?*Filter
Disallow: /users/
Disallow: /newsletters/subscribers/
Disallow: /__*
## OTHER BOTS
## - The default for bots that don't match the above, limit to very slow speeds
###############################################################################
User-agent: *
Disallow: /__classpath/
Disallow: /__errorpages/
Disallow: /catalog/*?*Sort
Disallow: /catalog/*?*Filter
Disallow: /users/
Disallow: /newsletters/subscribers/
Disallow: /__*
Crawl-Delay: 20
США - 50.56.218.9
Rackspace Cloud Servers
Rackspace Hosting
HTTP/1.1 200 OK
Date: Thu, 02 Jan 2020 18:51:17 GMT
Server: Apache
X-Powered-By: PHP/5.6.40
X-Server: gogoTemplate_RequestServer
Expires: Thu, 02 Jan 2020 18:51:17 GMT
Cache-Control: private, max-age=0, pre-check=0
Set-Cookie: PHPSESSID=session-5e0e3ba58b157; path=/
Strict-Transport-Security: max-age=63072000; includeSubdomains;
Transfer-Encoding: chunked
Content-Type: text/html; charset=utf-8
Кнопка для анализа сайта в один клик, для установки перетащите ссылку на "Панель закладок"