Возраст домена | n/a |
Дата окончания | n/a |
ИКС | 10 |
Страниц в Google | n/a |
Страниц в Яндексе | n/a |
Dmoz | Нет |
Яндекс Каталог | Нет |
Alexa Traffic Rank | 2649643 |
Alexa Country | Нет данных |
История изменения показателей | Авторизация |
Идет сбор информации... Обновить
All Reptiles
All Reptiles, allreptiles, supply, food, reptile food, reptile supply, toronto reptile store, scarborough reptile store, anphibians, feeders, supplies, reptile hobby, large varieties of reptiles
Servicing Canada’s reptile hobby one pet at a time since 2008. Canada's premier reptile store selling one of the largest varieties of Reptiles, Amphibians, Supplies, and Feeders in Canada. Shipping products, supplies, feeders, and animals across Canada.
UTF-8
71.01 КБ
861
6 235 симв.
5 107 симв.
Идет сбор информации... Обновить
Идет сбор информации... Обновить
Счетчик | Посетители за 24 часа | Просмотры | Просмотров на посетителя |
---|---|---|---|
![]() | Нет доступа | Нет доступа | n/a |
Идет сбор информации... Обновить
Идет сбор информации... Обновить
# robots.txt for Magento 1.9.x / v1.6 2018-08-19 / Peeter Marvet
# (original version from 2015, edited in 2017 to add filter query parameter disallow samples + some wildcards,
# edited in 2018 to add query params blocking to Yandex as named User-agent does not read *)
# based on:
# http://inchoo.net/ecommerce/ultimate-magento-robots-txt-file-examples/
# http://www.byte.nl/blog/magento-robots-txt/
# https://astrio.net/blog/optimize-robots-txt-for-magento/
#
# comment and clone at https://gist.github.com/petskratt/016c9dbf159a81b9d6aa
# Keep in mind that by standard robots.txt should NOT contain empty lines, except between UA blocks!
#
# Sitemap (uncomment, change and add language/shop specific sitemaps, if running on multiple domains
# keep in mind sitemap can only point to own domain so something like sitemapindex.php is needed)
# Sitemap: http://example.com/sitemap.xml
#
# Google Image Crawler Setup - having crawler-specific sections makes it ignore generic e.g *
#User-agent: Googlebot-Image
#Disallow:
#
# Yandex tends to be rather aggressive, may be worth keeping them at arms lenght
User-agent: YandexBot
Crawl-delay: 20
# Problem is mostly related to layered nav and query params, allow only paging
Allow: /*?p=
#Disallow: /*?p=*&
#Disallow: /*?
#
# Crawlers Setup
User-agent: *
#Crawl-delay: 10
#
# Allow paging (unless paging inside a listing with more params, as disallowed below)
Allow: /*?
#
# Directories
Disallow: /404/
Disallow: /app/
Disallow: /cgi-bin/
Disallow: /downloader/
Disallow: /errors/
Disallow: /includes/
Disallow: /magento/
#Disallow: /media/
#Disallow: /media/captcha/
#Disallow: /media/catalog/
#Disallow: /media/customer/
Disallow: /media/dhl/
Disallow: /media/downloadable/
#Disallow: /media/import/
#Disallow: /media/pdf/
#Disallow: /media/sales/
#Disallow: /media/tmp/
#Disallow: /media/wysiwyg/
Disallow: /media/xmlconnect/
Disallow: /pkginfo/
Disallow: /report/
Disallow: /scripts/
Disallow: /shell/
Disallow: /skin/
Disallow: /stats/
Disallow: /var/
#
# Paths (if using shop id in URL must prefix with * or copy for each)
#Disallow: */index.php/
#Disallow: */catalog/product_compare/
#Disallow: */catalog/category/view/
#Disallow: */catalog/product/view/
#Disallow: */catalog/product/gallery/
#Disallow: */catalogsearch/
#Disallow: */control/
#Disallow: */contacts/
#Disallow: */customer/
#Disallow: */customize/
#Disallow: */newsletter/
#Disallow: */poll/
#Disallow: */review/
#Disallow: */sendfriend/
#Disallow: */tag/
#Disallow: */wishlist/
Disallow: */checkout/
Disallow: */onestepcheckout/
#
# Files
Disallow: /cron.php
Disallow: /cron.sh
Disallow: /error_log
Disallow: /install.php
Disallow: /LICENSE.html
Disallow: /LICENSE.txt
Disallow: /LICENSE_AFL.txt
Disallow: /STATUS.txt
#
# Do not crawl sub category pages that are sorted or filtered.
# This would be very broad, could hurt (incl. SEO).
# Disallow: /*?*
#
# These are more specific, pick what you need - and do not forget to add your custom filters!
#Disallow: /*?dir*
#Disallow: /*?limit*
#Disallow: /*?mode*
#Disallow: /*?___from_store=*
#Disallow: /*?___store=*
#Disallow: /*?cat=*
#Disallow: /*?q=*
#Disallow: /*?price=*
#Disallow: /*?availability=*
#Disallow: /*?brand=*
#
# Paths that can be safely ignored (no clean URLs)
Disallow: /*?p=*&
Disallow: /*.php$
#Disallow: /*?SID=
#
#
Канада - Торонто - 178.128.236.77
FORTHnet SA
FORTHnet SA
HTTP/1.1 200 OK
Date: Wed, 20 Jul 2022 18:43:18 GMT
Server: Apache/2.4.29 (Ubuntu)
Set-Cookie: om_frontend=jjh2efk9at75gp3mkp0tk0ipf7; expires=Wed, 20-Jul-2022 23:43:18 GMT; Max-Age=18000; path=/; domain=allreptiles.ca; secure; HttpOnly
Expires: Thu, 19 Nov 1981 08:52:00 GMT
Cache-Control: no-store, no-cache, must-revalidate, post-check=0, pre-check=0
Pragma: no-cache
X-Frame-Options: SAMEORIGIN
Vary: Accept-Encoding
Transfer-Encoding: chunked
Content-Type: text/html; charset=UTF-8
Кнопка для анализа сайта в один клик, для установки перетащите ссылку на "Панель закладок"