Возраст домена | n/a |
Дата окончания | n/a |
ИКС | n/a |
Страниц в Google | n/a |
Страниц в Яндексе | 23 |
Dmoz | n/a |
Яндекс Каталог | n/a |
Alexa Traffic Rank | n/a |
Alexa Country | n/a |
История изменения показателей | Авторизация |
St1.no - St1
n/a
St1 – et nordisk miljøbevisst energiselskap. St1 driver Shell-stasjonene i Norge.
UTF-8
74.43 КБ
2
12 симв.
9 симв.
Идет сбор информации... Обновить
Идет сбор информации... Обновить
Идет сбор информации... Обновить
## GENERAL SETTINGS
## Enable robots.txt rules for all crawlers
User-agent: *
## DEVELOPMENT RELATED SETTINGS
## Do not crawl development files and folders
Disallow: /*CVS
Disallow: /*.git
Disallow: /*.svn
Disallow: /*.idea
Disallow: /*.sql
Disallow: /*.tgz
## MAGENTO SETTINGS
## Do not crawl Magento admin page
Disallow: /hallinta/
Disallow: /admin/
## Do not crawl common Magento technical folders
Disallow: /app/
Disallow: /downloader/
Disallow: /errors/
Disallow: /includes/
Disallow: /lib/
Disallow: /pkginfo/
Disallow: /report/
Disallow: /rest/
Disallow: /shell/
Disallow: /tag/
Disallow: /var/
## Do not crawl common Magento files
Disallow: /*.php$
Disallow: /*.sh$
Disallow: /*.txt$
Disallow: /*.md$
Disallow: /error_log
Disallow: /LICENSE.html
## MAGENTO SEO IMPROVEMENTS
## Do not crawl sub category pages that are sorted or filtered.
Disallow: /*?dir*
Disallow: /*?dir=desc
Disallow: /*?dir=asc
Disallow: /*?limit=all
Disallow: /*?mode*
Disallow: /*?q*
Disallow: /*?query*
Disallow: /*?form_key*
## Do not crawl 2-nd home page copy (example.com/index.php/)
Disallow: /index.php/
## Do not crawl links with session IDs
Disallow: /*?SID=
Disallow: /*?email=
## Do not crawl checkout and user account pages
Disallow: /checkout/
Disallow: /onestepcheckout/
Disallow: /customer/
Disallow: /customer/account/
Disallow: /customer/account/login/
Disallow: /cms/index/noRoute/
Disallow: /enable-cookies
Disallow: /review/
Disallow: /tag/
Disallow: /wishlist/
## Do not crawl pages that are only for mobile app
Disallow: /autopesut
Disallow: /qvik-app-frontpage
Disallow: /qvik-app-carousel
Disallow: /mobile-frontend
Disallow: /valkommen-in
## Do not crawl search pages and not-SEO optimized catalog links
Disallow: /catalogsearch/
Disallow: /search/
Disallow: /catalog/product_compare/
Disallow: /catalog/category/view/
Disallow: /catalog/product/view/
## SERVER SETTINGS
## Do not crawl common server technical folders and files
Disallow: /cgi-bin/
Sitemap: https://www.st1.no/media/sitemaps/st1_website_no_no.xml
США - Канзас-Сити - 107.178.248.27
Google Cloud
Google Cloud
HTTP/1.1 200 OK
Server: nginx/1.8.1
Date: Thu, 18 Jul 2019 19:39:01 GMT
Content-Type: text/html; charset=UTF-8
Transfer-Encoding: chunked
Set-Cookie: frontend=95bab22df5c58101e82fb44c4f4a0b37; expires=Thu, 18-Jul-2019 20:09:01 GMT; Max-Age=1800; path=/; domain=www.st1.no; secure; HttpOnly
Expires: Thu, 19 Nov 1981 08:52:00 GMT
Cache-Control: no-store, no-cache, must-revalidate
Pragma: no-cache
Via: 1.1 google
Alt-Svc: clear
Кнопка для анализа сайта в один клик, для установки перетащите ссылку на "Панель закладок"