Возраст домена | n/a |
Дата окончания | n/a |
PR | 3 |
ИКС | |
Страниц в Google | 345 |
Страниц в Яндексе | 0 |
Dmoz | Нет |
Яндекс Каталог | Нет |
Alexa Traffic Rank | Нет данных |
Alexa Country | Нет данных |
История изменения показателей | Авторизация |
Идет сбор информации... Обновить
Geographic-space - Digital Marketing with one blink
n/a
The new way of looking at SEO, Digital Marketing Data with one blink!
UTF-8
18.49 КБ
408
2 789 симв.
2 305 симв.
Данные предоставлены сервисом semrush
Идет сбор информации... Обновить
Данные linkpad ( 24 Апреля 2016 ) | |
Количество ссылок на сайт | 218 |
Количество доменов, которые ссылаются на сайт | 8 |
Количество найденных анкоров | 5 |
Исходящие (внешние) ссылки домена | 56 |
Количество доменов, на которые ссылается сайт | 3 |
Количество исходящих анкоров | 37 |
Внешние ссылки главной страницы ( 2 ) | |
beheshtclinic.com/%d9%84%db%8c%d9%be%d9%88%d9%85%d8%a7%d8%aa... | لاغری با لیپوماتیک |
moz.com/beginners-guide-to-seo nofollow | SEO |
Внутренние ссылки главной страницы ( 1 ) | |
# | - |
domain: geographic-space.ir
ascii: geographic-space.ir
remarks: (Domain Holder) Islamic Azad University Ahar Branch
remarks: (Domain Holder Address) 2nd km Of Ahar, Tabriz Road,, Ahar, East Azarbayejan, IR
holder-c: is63-irnic
admin-c: is63-irnic
tech-c: is63-irnic
nserver: azad-ahar.iau-ahar.ac.ir
last-updated: 2014-08-17
expire-date: 2018-07-30
source: IRNIC # Filtered
nic-hdl: is63-irnic
org: Islamic Azad University Ahar Branch
e-mail: iau.ahar@yahoo.com
address: 2nd km Of Ahar, Tabriz Road,, Ahar, East Azarbayejan, IR
phone: 0426-2235432
fax-no: 0426-2235432
source: IRNIC # Filtered
User-agent: SemrushBot
Disallow: /
User-agent: SemrushBot-SA
Disallow: /
User-agent: AhrefsBot
Disallow: /
User-agent: dotbot
Disallow: /
User-agent: MJ12bot
Disallow: /
User-agent: Rogerbot
User-agent: Exabot
User-agent: MJ12bot
User-agent: Dotbot
User-agent: Gigabot
User-agent: AhrefsBot
User-agent: BlackWidow
User-agent: ChinaClaw
User-agent: Custo
User-agent: DISCo
User-agent: Download\ Demon
User-agent: eCatch
User-agent: EirGrabber
User-agent: EmailSiphon
User-agent: EmailWolf
User-agent: Express\ WebPictures
User-agent: ExtractorPro
User-agent: EyeNetIE
User-agent: FlashGet
User-agent: GetRight
User-agent: GetWeb!
User-agent: Go!Zilla
User-agent: Go-Ahead-Got-It
User-agent: GrabNet
User-agent: Grafula
User-agent: HMView
User-agent: HTTrack
User-agent: Image\ Stripper
User-agent: Image\ Sucker
User-agent: Indy\ Library
User-agent: InterGET
User-agent: Internet\ Ninja
User-agent: JetCar
User-agent: JOC\ Web\ Spider
User-agent: larbin
User-agent: LeechFTP
User-agent: Mass\ Downloader
User-agent: MIDown\ tool
User-agent: Mister\ PiX
User-agent: Navroad
User-agent: NearSite
User-agent: NetAnts
User-agent: NetSpider
User-agent: Net\ Vampire
User-agent: NetZIP
User-agent: Octopus
User-agent: Offline\ Explorer
User-agent: Offline\ Navigator
User-agent: PageGrabber
User-agent: Papa\ Foto
User-agent: pavuk
User-agent: pcBrowser
User-agent: RealDownload
User-agent: JamesBOT
User-agent: NerdyBot
User-agent: BlekkoBot
User-agent: Majestic-SEO
User-agent: Majestic-12
User-agent: Ezooms
User-agent: BLEXBot
User-agent: linkdexbot
User-agent: spbot
User-agent: Aboundexbot
User-agent: archive.org_bot
User-agent: BacklinkCrawler
User-agent: ReGet
User-agent: SiteSnagger
User-agent: SmartDownload
User-agent: SuperBot
User-agent: SuperHTTP
User-agent: Surfbot
User-agent: tAkeOut
User-agent: Teleport\ Pro
User-agent: VoidEYE
User-agent: Web\ Image\ Collector
User-agent: Web\ Sucker
User-agent: spyfu
User-agent: WebAuto
User-agent: WebCopier
User-agent: WebFetch
User-agent: WebGo\ IS
User-agent: WebLeacher
User-agent: Linkminer
User-agent: BacklinkWatch
User-agent: KWfinder
User-agent: ScrapeBox
User-agent: OpenLinkProfiler
User-agent: ScrapeBox
User-agent: ia_archiver
User-agent: ScrapeBox
User-agent: LinkPad
User-agent: ScrapeBox
User-agent: Seobility
User-agent: BuzzSumo
User-agent: Seobility
User-agent: BLP_bbot
User-agent: BLP_bbot/0.1
User-agent: deepcrawl
User-agent: MJ12bot
User-agent: LinkResearchTools
User-agent: Moonsearch
User-agent: LinkResearchTools
User-agent: Sheer Explorer
User-agent: SheerExplorer
User-agent: Sheer_Explorer
User-agent: webseoanalytics
User-agent: BLEXBot
User-agent: AhrefsBot
User-agent: MJ12bot
User-agent: rogerbot
User-agent: SemrushBot
User-agent: SEOkicks-Robot
User-agent: WebReaper
User-agent: WebSauger
User-agent: Website\ eXtractor
User-agent: Website\ Quester
User-agent: WebStripper
User-agent: WebWhacker
User-agent: WebZIP
User-agent: SemrushBot-SA
User-agent: AhrefsBot
User-agent: SemrushBot
User-agent: Wget
User-agent: ScoutJet
User-agent: Widow
User-agent: WWWOFFLE
User-agent: Xaldon\ WebSpider
User-agent: Zeus
Disallow: /
# Disallow: Sistrix
User-agent: sistrix
Disallow: /
# Disallow: Sistrix
User-agent: SISTRIX Crawler
Disallow: /
# Disallow: Sistrix
User-agent: SISTRIX
Disallow: /
# Disallow: SEOkicks-Robot
User-agent: SEOkicks-Robot
Disallow: /
# Disallow: jobs.de-Robot
User-agent: jobs.de-Robot
Disallow: /
# Backlink Analysis
user-agent: AhrefsBot
disallow: /
# Bot der Leipziger Unister Holding GmbH
user-agent: UnisterBot
disallow: /
# http://moz.com/products
User-agent: dotbot
Disallow: /
# http://www.searchmetrics.com
User-agent: SearchmetricsBot
Disallow: /
# http://www.majestic12.co.uk/projects/dsearch/mj12bot.php
User-agent: MJ12bot
Disallow: /
# http://www.domaintools.com/webmasters/surveybot.php
User-agent: SurveyBot
Disallow: /
# http://www.seodiver.com/bot
user-agent: SEOdiver
disallow: /
# http://openlinkprofiler.org/bot
User-agent: spbot
Disallow: /
# http://www.wotbox.com/bot/
User-agent: wotbox
Disallow: /
# http://www.opensiteexplorer.org/dotbot
# http://moz.com/researchtools/ose/dotbot
User-agent: dotbot
Disallow: /
# http://www.meanpath.com/meanpathbot.html
User-agent: meanpathbot
Disallow: /
# http://www.backlinktest.com/crawler.html
User-agent: BacklinkCrawler
Disallow: /
# http://www.brandwatch.com/magpie-crawler/
User-agent: magpie-crawler
Disallow: /
# http://filterdb.iss.net/crawler/
User-agent: oBot
Disallow: /
User-agent: fr-crawler
Disallow: /
# http://webmeup-crawler.com
User-agent: BLEXBot
Disallow: /
# https://megaindex.com/crawler
User-agent: MegaIndex.ru
Disallow: /
User-agent: megaindex.com
Disallow: /
# http://www.cloudservermarket.com
User-Agent: CloudServerMarketSpider
Disallow: /
# http://www.trendiction.de/de/publisher/bot
User-Agent: trendictionbot
Disallow: /
# http://www.exalead.com
User-agent: Exabot
Disallow: /
# http://www.career-x.de/bot.html
User-agent: careerbot
Disallow: /
# https://www.lipperhey.com/en/about/
User-agent: Lipperhey-Kaus-Australis
Disallow: /
User-agent: seoscanners.net
Disallow: /
User-agent: MetaJobBot
Disallow: /
User-agent: Spiderbot
Disallow: /
User-agent: LinkStats
Disallow: /
User-agent: JobboerseBot
Disallow: /
User-agent: ICCrawler
Disallow: /
User-agent: Plista
Disallow: /
User-agent: Domain Re-Animator Bot
Disallow: /
# https://www.lipperhey.com/en/about/
User-agent: Lipperhey-Kaus-Australis
Disallow: /
# https://turnitin.com/robot/crawlerinfo.html
User-agent: turnitinbot
Disallow: /
# http://help.coccoc.com/
User-agent: coccoc
Disallow: /
# ubermetrics-technologies.com
User-agent: um-IC
Disallow: /
# datenbutler.de
User-agent: mindUpBot
Disallow: /
# http://searchgears.de/uber-uns/crawling-faq.html
User-agent: sg-Orbiter
Disallow: /
# http://commoncrawl.org/faq/
User-agent: CCBot
Disallow: /
# https://www.qwant.com/
User-agent: Qwantify
Disallow: /
# http://linkfluence.net/
User-agent: Kraken
Disallow: /
# http://www.botje.com/plukkie.htm
User-agent: plukkie
Disallow: /
# https://www.safedns.com/searchbot
User-agent: SafeDNSBot
Disallow: /
# http://www.haosou.com/help/help_3_2.html
User-agent: 360Spider
Disallow: /
# http://www.haosou.com/help/help_3_2.html
User-agent: HaosouSpider
Disallow: /
# http://www.moz.com/dp/rogerbot
User-agent: rogerbot
Disallow: /
# http://www.openhose.org/bot.html
User-agent: OpenHoseBot
Disallow: /
# http://www.screamingfrog.co.uk/seo-spider/
User-agent: Screaming Frog SEO Spider
Disallow: /
# http://thumbsniper.com
User-agent: ThumbSniper
Disallow: /
# http://www.radian6.com/crawler
User-agent: R6_CommentReader
Disallow: /
User-agent: ImplisenseBot
Disallow: /
# http://cliqz.com/company/cliqzbot
User-agent: Cliqzbot
Disallow: /
# https://www.aihitdata.com/about
User-agent: aiHitBot
Disallow: /
# http://www.trendiction.com/en/publisher/bot
User-Agent: trendictionbot
Disallow: /
# http://warebay.com/bot.html
User-agent: WBSearchBot
Disallow: /
User-agent: Python/3.5 aiohttp
Disallow: /
User-agent: Toweya.com
Disallow: /
# http://www.website-datenbank.de/
User-agent: netEstate
Disallow: /
# http://law.di.unimi.it/BUbiNG.html
User-agent: BUbiNG
Disallow: /
# http://www.linguee.com/bot; bot@linguee.com
User-agent: Linguee
Disallow: /
# https://www.semrush.com/bot/
User-agent: SemrushBot
Disallow: /
User-agent: SemrushBot-SA
Disallow: /
# www.sentibot.eu
User-agent: sentibot
Disallow: /
User-agent: SentiBot
Disallow: /
# http://velen.io
User-agent: VelenPublicWebCrawler
Disallow: /
User-agent: DomainCrawler
Disallow: /
# https://moz.com/help/guides/moz-procedures/what-is-rogerbot
User-agent: rogerbot
Disallow: /
User-agent: IndeedBot
Disallow: /
# http://www.garlik.com
User-agent: GarlikCrawler
Disallow: /
# https://www.gosign.de/typo3-extension/typo3-sicherheitsmonitor/
User-agent: Gosign-Security-Crawler
Disallow: /
# http://www.siteliner.com/bot
User-agent: Siteliner
Disallow: /
User-agent: serpstatbot
Disallow: /
User-agent: AhrefsBot
Disallow: /
User-agent: Yandex
Disallow: /
# Disallow: Sistrix
User-agent: sistrix
Disallow: /
# Disallow: Sistrix
User-agent: SISTRIX Crawler
Disallow: /
# Disallow: Sistrix
User-agent: SISTRIX
Disallow: /
# Disallow: SEOkicks-Robot
User-agent: SEOkicks-Robot
Disallow: /
# Disallow: jobs.de-Robot
User-agent: jobs.de-Robot
Disallow: /
# Backlink Analysis
user-agent: AhrefsBot
disallow: /
# Bot der Leipziger Unister Holding GmbH
user-agent: UnisterBot
disallow: /
# http://moz.com/products
User-agent: dotbot
Disallow: /
# http://www.searchmetrics.com
User-agent: SearchmetricsBot
Disallow: /
# http://www.majestic12.co.uk/projects/dsearch/mj12bot.php
User-agent: MJ12bot
Disallow: /
# http://www.domaintools.com/webmasters/surveybot.php
User-agent: SurveyBot
Disallow: /
# http://www.seodiver.com/bot
user-agent: SEOdiver
disallow: /
# http://openlinkprofiler.org/bot
User-agent: spbot
Disallow: /
# http://www.wotbox.com/bot/
User-agent: wotbox
Disallow: /
# http://www.opensiteexplorer.org/dotbot
# http://moz.com/researchtools/ose/dotbot
User-agent: dotbot
Disallow: /
# http://www.meanpath.com/meanpathbot.html
User-agent: meanpathbot
Disallow: /
# http://www.backlinktest.com/crawler.html
User-agent: BacklinkCrawler
Disallow: /
# http://www.brandwatch.com/magpie-crawler/
User-agent: magpie-crawler
Disallow: /
# http://filterdb.iss.net/crawler/
User-agent: oBot
Disallow: /
User-agent: fr-crawler
Disallow: /
# http://webmeup-crawler.com
User-agent: BLEXBot
Disallow: /
# https://megaindex.com/crawler
User-agent: MegaIndex.ru
Disallow: /
User-agent: megaindex.com
Disallow: /
# http://www.cloudservermarket.com
User-Agent: CloudServerMarketSpider
Disallow: /
# http://www.trendiction.de/de/publisher/bot
User-Agent: trendictionbot
Disallow: /
# http://www.exalead.com
User-agent: Exabot
Disallow: /
# http://www.career-x.de/bot.html
User-agent: careerbot
Disallow: /
# https://www.lipperhey.com/en/about/
User-agent: Lipperhey-Kaus-Australis
Disallow: /
User-agent: seoscanners.net
Disallow: /
User-agent: MetaJobBot
Disallow: /
User-agent: Spiderbot
Disallow: /
User-agent: LinkStats
Disallow: /
User-agent: JobboerseBot
Disallow: /
User-agent: ICCrawler
Disallow: /
User-agent: Plista
Disallow: /
User-agent: Domain Re-Animator Bot
Disallow: /
# https://www.lipperhey.com/en/about/
User-agent: Lipperhey-Kaus-Australis
Disallow: /
# https://turnitin.com/robot/crawlerinfo.html
User-agent: turnitinbot
Disallow: /
# http://help.coccoc.com/
User-agent: coccoc
Disallow: /
# ubermetrics-technologies.com
User-agent: um-IC
Disallow: /
# datenbutler.de
User-agent: mindUpBot
Disallow: /
# http://searchgears.de/uber-uns/crawling-faq.html
User-agent: sg-Orbiter
Disallow: /
# http://commoncrawl.org/faq/
User-agent: CCBot
Disallow: /
# https://www.qwant.com/
User-agent: Qwantify
Disallow: /
# http://linkfluence.net/
User-agent: Kraken
Disallow: /
# http://www.botje.com/plukkie.htm
User-agent: plukkie
Disallow: /
# https://www.safedns.com/searchbot
User-agent: SafeDNSBot
Disallow: /
# http://www.haosou.com/help/help_3_2.html
User-agent: 360Spider
Disallow: /
# http://www.haosou.com/help/help_3_2.html
User-agent: HaosouSpider
Disallow: /
# http://www.moz.com/dp/rogerbot
User-agent: rogerbot
Disallow: /
# http://www.openhose.org/bot.html
User-agent: OpenHoseBot
Disallow: /
# http://www.screamingfrog.co.uk/seo-spider/
User-agent: Screaming Frog SEO Spider
Disallow: /
# http://thumbsniper.com
User-agent: ThumbSniper
Disallow: /
# http://www.radian6.com/crawler
User-agent: R6_CommentReader
Disallow: /
User-agent: ImplisenseBot
Disallow: /
# http://cliqz.com/company/cliqzbot
User-agent: Cliqzbot
Disallow: /
# https://www.aihitdata.com/about
User-agent: aiHitBot
Disallow: /
# http://www.trendiction.com/en/publisher/bot
User-Agent: trendictionbot
Disallow: /
# http://warebay.com/bot.html
User-agent: WBSearchBot
Disallow: /
# http://crawler.007ac9.net/
User-agent: 007ac9
Disallow: /
# http://www.aboundex.com/crawler/
User-agent: Aboundexbot
Disallow: /
# https://www.adbeat.com/operation_policy
User-agent: adbeat_bot
Disallow: /
User-agent: AddThis
Disallow: /
# http://advbot.org/bot.html
User-agent: AdvBot
Disallow: /
# https://ahrefs.com/robot/
User-agent: AhrefsBot
Disallow: /
User-agent: aiHitBot
Disallow: /
# http://alphaseobot.com/bot.html
User-agent: AlphaSeoBot
Disallow: /
# http://alphaseobot.com/bot.html
User-agent: AlphaSeoBot-SA
Disallow: /
# https://audisto.com/help/crawler/bot
User-agent: audisto
Disallow: /
# https://audisto.com/help/crawler/bot
User-agent: audisto-essential
Disallow: /
# https://awario.com/bots.html
User-agent: AwarioRssBot
Disallow: /
# https://awario.com/bots.html
User-agent: AwarioSmartBot
Disallow: /
# http://www.backlinktest.com/crawler.html
User-agent: BacklinkCrawler
Disallow: /
# (http://begun.ru/advertiser/technologies/indexer.php)
User-agent: BegunAdvertising
Disallow: /
User-agent: betaBot
Disallow: /
# (https://bitly.com/)
User-agent: bitlybot
Disallow: /
# http://webmeup-crawler.com/
User-agent: BLEXBot
Disallow: /
User-agent: BoogleBot
Disallow: /
# http://law.di.unimi.it/BUbiNG.html
User-agent: BUbiNG
Disallow: /
# https://hypefactors.com/webcrawler
User-agent: BuckyOHare
Disallow: /
# no more active!?
User-agent: careerbot
Disallow: /
User-agent: ca-crawler
Disallow: /
User-agent: calculon
Disallow: /
# http://catchbot.com/ (via archive.org)
User-agent: CatchBot
Disallow: /
# http://commoncrawl.org/big-picture/frequently-asked-questions/
User-agent: CCBot
Disallow: /
User-agent: CheckMarkNetwork/1.0 (+http://www.checkmarknetwork.com/spider.html)
Disallow: /
# http://www.cmscrawler.com/ (missachtet robots.txt)
User-agent: CMS Crawler
Disallow: /
User-agent: CompSpyBot
Disallow: /
User-agent: crawler4j
Disallow: /
# http://www.crazywebcrawler.com/
User-agent: CrazyWebCrawler-Spider
Disallow: /
# https://www.companiesintheuk.co.uk/bot.html
User-agent: CukBot
Disallow: /
# https://www.dataprovider.com/spider/
User-agent: Dataprovider
Disallow: /
# https://www.deepcrawl.com/bot/
User-agent: deepcrawl
Disallow: /
# https://benbernardblog.com/der-bot/
User-agent: DER-bot
Disallow: /
User-agent: Diffbot
Disallow: /
# https://support.dlvrit.com/hc/en-us/articles/200402934-How-do-I-block-dlvr-it-from-retrieving-the-feeds-on-my-site-
User-agent: dlvr.it
Disallow: /
# (http://www.profound.net/domainappender)
User-agent: DomainAppender
Disallow: /
# http://domainstats.io/our-bot
User-agent: DomainStatsBot
Disallow: /
# https://moz.com/researchtools/ose/dotbot (previously Ezooms bot!?)
User-agent: dotbot
Disallow: /
# http://adressendeutschland.de/ (obeys specific rule!?)
User-agent: dubaiindex
Disallow: /
# https://www.duedil.com/our-crawler
User-agent: ElectricMonk
Disallow: /
# http://www.envolk.com/envolkspiderinfo.html
User-agent: envolk
Disallow: /
User-agent: evc-batch/2.0
Disallow: /
# http://www.expertsearch.nl/spider (redirects to JobdiggerSpider)
User-agent: ExpertSearchSpider
Disallow: /
# https://extlinks.com/Bot.html
User-agent: ExtLinksBot
Disallow: /
User-agent: Fatbot
Disallow: /
# http://www.findxbot.com/
User-agent: Findxbot
Disallow: /
User-agent: fr-crawler
Disallow: /
# (http://www.garlik.com)
User-agent: GarlikCrawler
Disallow: /
# http://www.genieo.com/webfilter.html
User-agent: Genieo
Disallow: /
# https://www.gloomar.com/bot
User-agent: gloomarbot
Disallow: /
# http://www.grapeshot.com/crawler/
User-agent: grapeshot
Disallow: /
User-agent: HTTrack
Disallow: /
# http://www.huaweisymantec.com/en/IRL/spider/ (via archive.org)
User-agent: HuaweiSymantecSpider
Disallow: /
# https://knowledge.hubspot.com/articles/kcs_article/reports/why-do-i-get-an-error-in-page-performance-that-the-crawler-is-blocked-by-robots-txt-for-my-hubspot-staging-domain
User-agent: HubSpot Crawler 1.0 http://www.hubspot.com/
Disallow: /
# https://knowledge.hubspot.com/articles/kcs_article/reports/why-do-i-get-an-error-in-page-performance-that-the-crawler-is-blocked-by-robots-txt-for-my-hubspot-staging-domain
User-agent: HubSpot Links Crawler 1.0 http://www.hubspot.com/
Disallow: /
# http://www.seograph.net/bot.html
User-agent: HyperCrawl
Disallow: /
# http://www.hypestat.com/bot
User-agent: HypeStat
Disallow: /
# https://integralads.com/site-indexing-policy/
User-agent: ias_crawler
Disallow: /
# https://www.icjobs.de/bot.htm
User-agent: ICCrawler - iCjobs
Disallow: /
# http://www.idmarch.org/bot.html
User-agent: idmarch
Disallow: /
# (http://implisense.com/)
User-agent: ImplisenseBot
Disallow: /
User-agent: ips-agent
Disallow: /
# http://irl.cs.tamu.edu/crawler/
User-agent: IRLbot
Disallow: /
# https://cognitiveseo.com/bot.html
User-agent: JamesBOT
Disallow: /
# https://www.jobb�rse.com/bot.htm
User-agent: JobboerseBot
Disallow: /
# http://www.jobdigger.nl/spider/
User-agent: JobdiggerSpider
Disallow: /
# http://static.kalooga.com/legal/crawler.html
User-agent: kalooga
Disallow: /
# (http://linkfluence.net/)
User-agent: Kraken
Disallow: /
# (http://larbin.sourceforge.net/index-eng.html)
User-agent: larbin
Disallow: /
# https://www.linkdex.com/en-us/about/bots/ (doesn't obey specific rule)
User-agent: linkdexbot
Disallow: /
# http://www.linkpad.ru
User-agent: LinkpadBot
Disallow: /
# https://www.lipperhey.com/en/about/website-spider/ (doesn't obey specific rule)
User-agent: Lipperhey
Disallow: /
User-agent: LSSRocketCrawler
Disallow: /
# http://ltx71.com/
User-agent: ltx71
Disallow: /
# https://www.brandwatch.com/magpie-crawler/
User-agent: magpie-crawler
Disallow: /
# http://mappydata.net/#eng
User-agent: Mappy
Disallow: /
User-agent: MauiBot
Disallow: /
User-agent: MBCrawler
Disallow: /
# http://www.meanpath.com/meanpathbot.html
User-agent: meanpathbot
Disallow: /
User-agent: MegaIndex.ru 2.0
Disallow: /
# http://www.metajob.de/the/crawler
User-agent: metajobbot
Disallow: /
# http://www.majestic12.co.uk/projects/dsearch/mj12bot.php
User-agent: MJ12bot
Disallow: /
User-agent: MSIECrawler
Disallow: /
User-agent: nbot
Disallow: /
# https://www.neofonie.de/spider/
User-agent: neofonie
Disallow: /
# http://nerdybot.com/
User-agent: NerdyBot
Disallow: /
User-agent: NetcraftSurveyAgent
Disallow: /
User-agent: NetpeakSpiderBot
Disallow: /
# http://www.netseer.com/crawler/
User-agent: netseer
Disallow: /
# http://www.zoominfo.com/About/misc/NextGenSearchBot.aspx (via arcvhive.org)
User-agent: NextGenSearchBot
Disallow: /
# http://nutch.apache.org/bot.html
User-agent: Nutch
Disallow: /
# http://filterdb.iss.net/crawler/
User-agent: oBot
Disallow: /
# https://www.openindex.io/saas/about-our-spider/
User-agent: OpenindexSpider
Disallow: /
# http://www.panscient.com/faq.htm
User-agent: panscient.com
Disallow: /
# https://pipl.com/bot/
User-agent: PiplBot
Disallow: /
# http://www.botje.com/plukkie.htm
User-agent: plukkie
Disallow: /
User-agent: Pockey-GetHTML
Disallow: /
# https://www.comscore.com/proximic-spider
User-agent: proximic
Disallow: /
# https://www.semanticjuice.com/web-crawler.php
User-agent: Pu_iN
Disallow: /
# (bixocrawler)
User-agent: pub-crawler
Disallow: /
# R6_FeedFetcher + R6_CommentReader (www.radian6.com/crawler)
User-agent: Radian6
Disallow: /
# https://ranksonic.com/ranksonic_sab.html
User-agent: RankSonicSiteAuditor
Disallow: /
# https://raven.zendesk.com/hc/en-us/articles/203221440-How-do-I-slow-down-Site-Auditor-s-crawl-of-my-website-
# (https://raventools.com/)
User-agent: RavenCrawler
Disallow: /
# https://redbot.org/about/
User-agent: RED
Disallow: /
# (http://g2pi.tsc.uc3m.es/)
User-agent: RedesScrapy
Disallow: /
# http://riddler.io/about
User-agent: Riddler
Disallow: /
# http://moz.com/help/pro/what-is-rogerbot- (via archive.org)
User-agent: rogerbot
Disallow: /
# https://www.safedns.com/searchbot
User-agent: SafeDNSBot
Disallow: /
# http://www.secretsearchenginelabs.com/secret-web-crawler.php
User-agent: SBSearch
Disallow: /
# http://scoutjet.com/
# (Blekkobot)
User-agent: ScoutJet
Disallow: /
# https://www.screamingfrog.co.uk/seo-spider/user-guide/general/
User-agent: Screaming Frog SEO Spider
Disallow: /
# http://de.semrush.com/bot/
User-agent: SemrushBot
Disallow: /
# http://sentibot.eu/
User-agent: sentibot
Disallow: /
# https://seocharger.com/robot
User-agent: seocharger-robot
Disallow: /
# http://www.seokicks.de/robot.html
User-agent: SEOkicks-Robot
Disallow: /
# http://crawler.seolytics.net/
User-agent: SEOlyticsCrawler
Disallow: /
# http://crawler.seolytics.net/
User-agent: seoscanners.net/1
Disallow: /
# http://www.searchgears.com/ueber-uns/crawling-faq.html
User-agent: sg-Orbiter
Disallow: /
# http://crawler.sistrix.net/
# User-agent: sistrix
# Disallow: /
# http://siteexplorer.info/about.html
User-agent: SiteExplorer
Disallow: /
# https://smabbler.com/en/Home/About
User-agent: SmabblerBot
Disallow: /
# https://www.similartech.com/smtbot
User-agent: SMTBot
Disallow: /
# http://www.openlinkprofiler.org/bot
User-agent: spbot
Disallow: /
# http://nlp.fi.muni.cz/projects/biwec/
User-agent: SpiderLing
Disallow: /
User-agent: Spiderlytics
Disallow: /
User-agent: ssearch_bot
Disallow: /
User-agent: sSearch Crawler
Disallow: /
# http://www.tkl.iis.u-tokyo.ac.jp/~crawler/
User-agent: Steeler
Disallow: /
User-agent: stq_bot
Disallow: /
# http://sur.ly/bot.html
User-agent: SurdotlyBot
Disallow: /
User-agent: SurveyBot
Disallow: /
# https://swiftype.com/swiftbot
User-agent: Swiftbot
Disallow: /
User-agent: The Knowledge AI
Disallow: /
# http://www.thumbshots.de/content-39-seite_auszuschliessen.html
User-agent: thumbshots-de-bot
Disallow: /
# https://thumbsniper.com/cat/news/ (via Google cache)
User-agent: ThumbSniper (http://thumbsniper.com)
Disallow: /
# http://search.thunderstone.com/texis/websearch/about.html
User-agent: thunderstone
Disallow: /
# (https://www.tineye.com/crawler.html)
User-agent: TinEye
Disallow: /
# http://www.toshiba.co.jp/rdc/about/crawl_info_en.htm
User-agent: TosCrawler
Disallow: /
# http://www.trendiction.com/de/publisher/bot
User-agent: trendictionbot
Disallow: /
# https://turnitin.com/robot/crawlerinfo.html
User-agent: TurnitinBot
Disallow: /
# https://blog.ucoz.ru/upolicy/
User-agent: uCrawler
Disallow: /
# https://uptime.com/uptimebot
User-agent: Uptimebot
Disallow: /
# http://www.wise-guys.nl/webcrawler.php
User-agent: Vagabondo
Disallow: /
# (https://blog.vebidoo.de/vebidoobot/)
User-agent: vebidoobot
Disallow: /
# https://velen.io/
User-agent: VelenPublicWebCrawler
Disallow: /
# http://80legs.com/the-80legs-web-crawler/
User-agent: voltron
Disallow: /
# http://warebay.com/bot.html (expired)
User-agent: WBSearchBot
Disallow: /
# http://rvs.informatik.uni-leipzig.de/bot.php
User-agent: webmeasurement-bot
Disallow: /
# http://www.wesee.com/bot (via archive.org)
User-agent: WeSEE
Disallow: /
User-agent: WeViKaBot
Disallow: /
User-agent: Wget
Disallow: /
# http://www.wikido.com/wikido.php
User-agent: WikiDo
Disallow: /
User-agent: wonderbot
Disallow: /
# http://www.wotbox.com/bot/
User-agent: wotbox
Disallow: /
# http://x28.ch/bot.html
User-agent: x28-job-bot
Disallow: /
# http://www.xovibot.net/
User-agent: XoviBot
Disallow: /
# https://suite.seozoom.it/bot.html
User-agent: ZoomBot
Disallow: /
User-agent: 360Spider
Disallow:/
User-agent: 404checker
Disallow:/
User-agent: 404enemy
Disallow:/
User-agent: 80legs
Disallow:/
User-agent: Abonti
Disallow:/
User-agent: Aboundex
Disallow:/
User-agent: Aboundexbot
Disallow:/
User-agent: Acunetix
Disallow:/
User-agent: ADmantX
Disallow:/
User-agent: AfD-Verbotsverfahren
Disallow:/
User-agent: AhrefsBot
Disallow:/
User-agent: AIBOT
Disallow:/
User-agent: AiHitBot
Disallow:/
User-agent: Aipbot
Disallow:/
User-agent: Alexibot
Disallow:/
User-agent: Alligator
Disallow:/
User-agent: AllSubmitter
Disallow:/
User-agent: AlphaBot
Disallow:/
User-agent: Anarchie
Disallow:/
User-agent: Apexoo
Disallow:/
User-agent: archive.org_bot
Disallow:/
User-agent: ASPSeek
Disallow:/
User-agent: Asterias
Disallow:/
User-agent: Attach
Disallow:/
User-agent: autoemailspider
Disallow:/
User-agent: BackDoorBot
Disallow:/
User-agent: Backlink-Ceck
Disallow:/
User-agent: backlink-check
Disallow:/
User-agent: BacklinkCrawler
Disallow:/
User-agent: BackStreet
Disallow:/
User-agent: BackWeb
Disallow:/
User-agent: Bandit
Disallow:/
User-agent: Barkrowler
Disallow:/
User-agent: BatchFTP
Disallow:/
User-agent: Battleztar Bazinga
Disallow:/
User-agent: BBBike
Disallow:/
User-agent: BDCbot
Disallow:/
User-agent: BDFetch
Disallow:/
User-agent: BetaBot
Disallow:/
User-agent: Bigfoot
Disallow:/
User-agent: Bitacle
Disallow:/
User-agent: Blackboard
Disallow:/
User-agent: Black Hole
Disallow:/
User-agent: BlackWidow
Disallow:/
User-agent: BLEXBot
Disallow:/
User-agent: Blow
Disallow:/
User-agent: BlowFish
Disallow:/
User-agent: Boardreader
Disallow:/
User-agent: Bolt
Disallow:/
User-agent: BotALot
Disallow:/
User-agent: Brandprotect
Disallow:/
User-agent: Brandwatch
Disallow:/
User-agent: Buddy
Disallow:/
User-agent: BuiltBotTough
Disallow:/
User-agent: BuiltWith
Disallow:/
User-agent: Bullseye
Disallow:/
User-agent: BunnySlippers
Disallow:/
User-agent: BuzzSumo
Disallow:/
User-agent: Calculon
Disallow:/
User-agent: CATExplorador
Disallow:/
User-agent: CazoodleBot
Disallow:/
User-agent: CCBot
Disallow:/
User-agent: Cegbfeieh
Disallow:/
User-agent: CheeseBot
Disallow:/
User-agent: CherryPicker
Disallow:/
User-agent: CheTeam
Disallow:/
User-agent: ChinaClaw
Disallow:/
User-agent: Chlooe
Disallow:/
User-agent: Claritybot
Disallow:/
User-agent: Cliqzbot
Disallow:/
User-agent: Cloud mapping
Disallow:/
User-agent: coccocbot-web
Disallow:/
User-agent: Cogentbot
Disallow:/
User-agent: cognitiveseo
Disallow:/
User-agent: Collector
Disallow:/
User-agent: com.plumanalytics
Disallow:/
User-agent: Copier
Disallow:/
User-agent: CopyRightCheck
Disallow:/
User-agent: Copyscape
Disallow:/
User-agent: Cosmos
Disallow:/
User-agent: Craftbot
Disallow:/
User-agent: crawler4j
Disallow:/
User-agent: crawler.feedback
Disallow:/
User-agent: crawl.sogou.com
Disallow:/
User-agent: CrazyWebCrawler
Disallow:/
User-agent: Crescent
Disallow:/
User-agent: CrunchBot
Disallow:/
User-agent: CSHttp
Disallow:/
User-agent: Curious
Disallow:/
User-agent: Custo
Disallow:/
User-agent: DatabaseDriverMysqli
Disallow:/
User-agent: DataCha0s
Disallow:/
User-agent: DBLBot
Disallow:/
User-agent: demandbase-bot
Disallow:/
User-agent: Demon
Disallow:/
User-agent: Deusu
Disallow:/
User-agent: Devil
Disallow:/
User-agent: Digincore
Disallow:/
User-agent: DigitalPebble
Disallow:/
User-agent: DIIbot
Disallow:/
User-agent: Dirbuster
Disallow:/
User-agent: Disco
Disallow:/
User-agent: Discobot
Disallow:/
User-agent: Discoverybot
Disallow:/
User-agent: Dispatch
Disallow:/
User-agent: DittoSpyder
Disallow:/
User-agent: DnyzBot
Disallow:/
User-agent: DomainAppender
Disallow:/
User-agent: DomainCrawler
Disallow:/
User-agent: DomainSigmaCrawler
Disallow:/
User-agent: DomainStatsBot
Disallow:/
User-agent: Dotbot
Disallow:/
User-agent: Download Wonder
Disallow:/
User-agent: Dragonfly
Disallow:/
User-agent: Drip
Disallow:/
User-agent: DSearch
Disallow:/
User-agent: DTS Agent
Disallow:/
User-agent: EasyDL
Disallow:/
User-agent: Ebingbong
Disallow:/
User-agent: eCatch
Disallow:/
User-agent: ECCP/1.0
Disallow:/
User-agent: Ecxi
Disallow:/
User-agent: EirGrabber
Disallow:/
User-agent: EMail Siphon
Disallow:/
User-agent: EMail Wolf
Disallow:/
User-agent: EroCrawler
Disallow:/
User-agent: evc-batch
Disallow:/
User-agent: Evil
Disallow:/
User-agent: Exabot
Disallow:/
User-agent: Express WebPictures
Disallow:/
User-agent: ExtLinksBot
Disallow:/
User-agent: Extractor
Disallow:/
User-agent: ExtractorPro
Disallow:/
User-agent: Extreme Picture Finder
Disallow:/
User-agent: EyeNetIE
Disallow:/
User-agent: Ezooms
Disallow:/
User-agent: facebookscraper
Disallow:/
User-agent: FDM
Disallow:/
User-agent: FemtosearchBot
Disallow:/
User-agent: FHscan
Disallow:/
User-agent: Fimap
Disallow:/
User-agent: Firefox/7.0
Disallow:/
User-agent: FlashGet
Disallow:/
User-agent: Flunky
Disallow:/
User-agent: Foobot
Disallow:/
User-agent: Freeuploader
Disallow:/
User-agent: FrontPage
Disallow:/
User-agent: FyberSpider
Disallow:/
User-agent: Fyrebot
Disallow:/
User-agent: GalaxyBot
Disallow:/
User-agent: Genieo
Disallow:/
User-agent: GermCrawler
Disallow:/
User-agent: Getintent
Disallow:/
User-agent: GetRight
Disallow:/
User-agent: GetWeb
Disallow:/
User-agent: Gigablast
Disallow:/
User-agent: Gigabot
Disallow:/
User-agent: G-i-g-a-b-o-t
Disallow:/
User-agent: Go-Ahead-Got-It
Disallow:/
User-agent: Gotit
Disallow:/
User-agent: GoZilla
Disallow:/
User-agent: Go!Zilla
Disallow:/
User-agent: Grabber
Disallow:/
User-agent: GrabNet
Disallow:/
User-agent: Grafula
Disallow:/
User-agent: GrapeFX
Disallow:/
User-agent: GrapeshotCrawler
Disallow:/
User-agent: GridBot
Disallow:/
User-agent: GT::WWW
Disallow:/
User-agent: Haansoft
Disallow:/
User-agent: HaosouSpider
Disallow:/
User-agent: Harvest
Disallow:/
User-agent: Havij
Disallow:/
User-agent: HEADMasterSEO
Disallow:/
User-agent: Heritrix
Disallow:/
User-agent: Hloader
Disallow:/
User-agent: HMView
Disallow:/
User-agent: HTMLparser
Disallow:/
User-agent: HTTP::Lite
Disallow:/
User-agent: HTTrack
Disallow:/
User-agent: Humanlinks
Disallow:/
User-agent: HybridBot
Disallow:/
User-agent: Iblog
Disallow:/
User-agent: IDBot
Disallow:/
User-agent: Id-search
Disallow:/
User-agent: IlseBot
Disallow:/
User-agent: Image Fetch
Disallow:/
User-agent: Image Sucker
Disallow:/
User-agent: IndeedBot
Disallow:/
User-agent: Indy Library
Disallow:/
User-agent: InfoNaviRobot
Disallow:/
User-agent: InfoTekies
Disallow:/
User-agent: instabid
Disallow:/
User-agent: Intelliseek
Disallow:/
User-agent: InterGET
Disallow:/
User-agent: Internet Ninja
Disallow:/
User-agent: InternetSeer
Disallow:/
User-agent: internetVista monitor
Disallow:/
User-agent: ips-agent
Disallow:/
User-agent: Iria
Disallow:/
User-agent: IRLbot
Disallow:/
User-agent: Iskanie
Disallow:/
User-agent: IstellaBot
Disallow:/
User-agent: JamesBOT
Disallow:/
User-agent: Jbrofuzz
Disallow:/
User-agent: JennyBot
Disallow:/
User-agent: JetCar
Disallow:/
User-agent: Jetty
Disallow:/
User-agent: JikeSpider
Disallow:/
User-agent: JOC Web Spider
Disallow:/
User-agent: Joomla
Disallow:/
User-agent: Jorgee
Disallow:/
User-agent: JustView
Disallow:/
User-agent: Jyxobot
Disallow:/
User-agent: Kenjin Spider
Disallow:/
User-agent: Keyword Density
Disallow:/
User-agent: Kozmosbot
Disallow:/
User-agent: Lanshanbot
Disallow:/
User-agent: Larbin
Disallow:/
User-agent: LeechFTP
Disallow:/
User-agent: LeechGet
Disallow:/
User-agent: LexiBot
Disallow:/
User-agent: Lftp
Disallow:/
User-agent: LibWeb
Disallow:/
User-agent: Libwhisker
Disallow:/
User-agent: Lightspeedsystems
Disallow:/
User-agent: Likse
Disallow:/
User-agent: Linkdexbot
Disallow:/
User-agent: LinkextractorPro
Disallow:/
User-agent: LinkpadBot
Disallow:/
User-agent: LinkScan
Disallow:/
User-agent: LinksManager
Disallow:/
User-agent: LinkWalker
Disallow:/
User-agent: LinqiaMetadataDownloaderBot
Disallow:/
User-agent: LinqiaRSSBot
Disallow:/
User-agent: LinqiaScrapeBot
Disallow:/
User-agent: Lipperhey
Disallow:/
User-agent: Lipperhey Spider
Disallow:/
User-agent: Litemage_walker
Disallow:/
User-agent: Lmspider
Disallow:/
User-agent: LNSpiderguy
Disallow:/
User-agent: Ltx71
Disallow:/
User-agent: lwp-request
Disallow:/
User-agent: LWP::Simple
Disallow:/
User-agent: lwp-trivial
Disallow:/
User-agent: Magnet
Disallow:/
User-agent: Mag-Net
Disallow:/
User-agent: magpie-crawler
Disallow:/
User-agent: Mail.RU_Bot
Disallow:/
User-agent: Majestic12
Disallow:/
User-agent: Majestic SEO
Disallow:/
User-agent: Majestic-SEO
Disallow:/
User-agent: MarkMonitor
Disallow:/
User-agent: MarkWatch
Disallow:/
User-agent: Masscan
Disallow:/
User-agent: Mass Downloader
Disallow:/
User-agent: Mata Hari
Disallow:/
User-agent: MauiBot
Disallow:/
User-agent: meanpathbot
Disallow:/
User-agent: Meanpathbot
Disallow:/
User-agent: MeanPath Bot
Disallow:/
User-agent: Mediatoolkitbot
Disallow:/
User-agent: mediawords
Disallow:/
User-agent: MegaIndex.ru
Disallow:/
User-agent: Metauri
Disallow:/
User-agent: MFC_Tear_Sample
Disallow:/
User-agent: Microsoft Data Access
Disallow:/
User-agent: Microsoft URL Control
Disallow:/
User-agent: MIDown tool
Disallow:/
User-agent: MIIxpc
Disallow:/
User-agent: Mister PiX
Disallow:/
User-agent: MJ12bot
Disallow:/
User-agent: Mojeek
Disallow:/
User-agent: Mr.4x3
Disallow:/
User-agent: MSFrontPage
Disallow:/
User-agent: MSIECrawler
Disallow:/
User-agent: Msrabot
Disallow:/
User-agent: muhstik-scan
Disallow:/
User-agent: Musobot
Disallow:/
User-agent: Name Intelligence
Disallow:/
User-agent: Nameprotect
Disallow:/
User-agent: Navroad
Disallow:/
User-agent: NearSite
Disallow:/
User-agent: Needle
Disallow:/
User-agent: Nessus
Disallow:/
User-agent: NetAnts
Disallow:/
User-agent: Netcraft
Disallow:/
User-agent: netEstate NE Crawler
Disallow:/
User-agent: NetLyzer
Disallow:/
User-agent: NetMechanic
Disallow:/
User-agent: NetSpider
Disallow:/
User-agent: Nettrack
Disallow:/
User-agent: Net Vampire
Disallow:/
User-agent: Netvibes
Disallow:/
User-agent: NetZIP
Disallow:/
User-agent: NextGenSearchBot
Disallow:/
User-agent: Nibbler
Disallow:/
User-agent: NICErsPRO
Disallow:/
User-agent: Niki-bot
Disallow:/
User-agent: Nikto
Disallow:/
User-agent: NimbleCrawler
Disallow:/
User-agent: Nimbostratus
Disallow:/
User-agent: Ninja
Disallow:/
User-agent: Nmap
Disallow:/
User-agent: NPbot
Disallow:/
User-agent: Nutch
Disallow:/
User-agent: oBot
Disallow:/
User-agent: Octopus
Disallow:/
User-agent: Offline Explorer
Disallow:/
User-agent: Offline Navigator
Disallow:/
User-agent: OnCrawl
Disallow:/
User-agent: Openfind
Disallow:/
User-agent: OpenLinkProfiler
Disallow:/
User-agent: Openvas
Disallow:/
User-agent: OpenVAS
Disallow:/
User-agent: OrangeBot
Disallow:/
User-agent: OrangeSpider
Disallow:/
User-agent: OutclicksBot
Disallow:/
User-agent: OutfoxBot
Disallow:/
User-agent: PageAnalyzer
Disallow:/
User-agent: Page Analyzer
Disallow:/
User-agent: PageGrabber
Disallow:/
User-agent: page scorer
Disallow:/
User-agent: PageScorer
Disallow:/
User-agent: Pandalytics
Disallow:/
User-agent: Panscient
Disallow:/
User-agent: Papa Foto
Disallow:/
User-agent: Pavuk
Disallow:/
User-agent: pcBrowser
Disallow:/
User-agent: PECL::HTTP
Disallow:/
User-agent: PeoplePal
Disallow:/
User-agent: PHPCrawl
Disallow:/
User-agent: Picscout
Disallow:/
User-agent: Picsearch
Disallow:/
User-agent: PictureFinder
Disallow:/
User-agent: Pimonster
Disallow:/
User-agent: Pi-Monster
Disallow:/
User-agent: Pixray
Disallow:/
User-agent: PleaseCrawl
Disallow:/
User-agent: plumanalytics
Disallow:/
User-agent: Pockey
Disallow:/
User-agent: POE-Component-Client-HTTP
Disallow:/
User-agent: Probethenet
Disallow:/
User-agent: ProPowerBot
Disallow:/
User-agent: ProWebWalker
Disallow:/
User-agent: Psbot
Disallow:/
User-agent: Pump
Disallow:/
User-agent: PxBroker
Disallow:/
User-agent: PyCurl
Disallow:/
User-agent: QueryN Metasearch
Disallow:/
User-agent: Quick-Crawler
Disallow:/
User-agent: RankActive
Disallow:/
User-agent: RankActiveLinkBot
Disallow:/
User-agent: RankFlex
Disallow:/
User-agent: RankingBot
Disallow:/
User-agent: RankingBot2
Disallow:/
User-agent: Rankivabot
Disallow:/
User-agent: RankurBot
Disallow:/
User-agent: RealDownload
Disallow:/
User-agent: Reaper
Disallow:/
User-agent: RebelMouse
Disallow:/
User-agent: Recorder
Disallow:/
User-agent: RedesScrapy
Disallow:/
User-agent: ReGet
Disallow:/
User-agent: RepoMonkey
Disallow:/
User-agent: Ripper
Disallow:/
User-agent: RocketCrawler
Disallow:/
User-agent: Rogerbot
Disallow:/
User-agent: RSSingBot
Disallow:/
User-agent: s1z.ru
Disallow:/
User-agent: SalesIntelligent
Disallow:/
User-agent: SBIder
Disallow:/
User-agent: ScanAlert
Disallow:/
User-agent: Scanbot
Disallow:/
User-agent: scan.lol
Disallow:/
User-agent: ScoutJet
Disallow:/
User-agent: Scrapy
Disallow:/
User-agent: Screaming
Disallow:/
User-agent: ScreenerBot
Disallow:/
User-agent: Searchestate
Disallow:/
User-agent: SearchmetricsBot
Disallow:/
User-agent: Semrush
Disallow:/
User-agent: SemrushBot
Disallow:/
User-agent: SEOkicks
Disallow:/
User-agent: SEOkicks-Robot
Disallow:/
User-agent: SEOlyticsCrawler
Disallow:/
User-agent: Seomoz
Disallow:/
User-agent: SEOprofiler
Disallow:/
User-agent: seoscanners
Disallow:/
User-agent: SeoSiteCheckup
Disallow:/
User-agent: SEOstats
Disallow:/
User-agent: serpstatbot
Disallow:/
User-agent: Shodan
Disallow:/
User-agent: Siphon
Disallow:/
User-agent: SISTRIX
Disallow:/
User-agent: Sitebeam
Disallow:/
User-agent: SiteExplorer
Disallow:/
User-agent: Siteimprove
Disallow:/
User-agent: SiteLockSpider
Disallow:/
User-agent: SiteSnagger
Disallow:/
User-agent: SiteSucker
Disallow:/
User-agent: Site Sucker
Disallow:/
User-agent: Sitevigil
Disallow:/
User-agent: SlySearch
Disallow:/
User-agent: SmartDownload
Disallow:/
User-agent: SMTBot
Disallow:/
User-agent: Snake
Disallow:/
User-agent: Snapbot
Disallow:/
User-agent: Snoopy
Disallow:/
User-agent: SocialRankIOBot
Disallow:/
User-agent: Sociscraper
Disallow:/
User-agent: sogouspider
Disallow:/
User-agent: Sogou web spider
Disallow:/
User-agent: Sosospider
Disallow:/
User-agent: Sottopop
Disallow:/
User-agent: SpaceBison
Disallow:/
User-agent: Spammen
Disallow:/
User-agent: SpankBot
Disallow:/
User-agent: Spanner
Disallow:/
User-agent: sp_auditbot
Disallow:/
User-agent: Spbot
Disallow:/
User-agent: Spinn3r
Disallow:/
User-agent: SputnikBot
Disallow:/
User-agent: spyfu
Disallow:/
User-agent: Sqlmap
Disallow:/
User-agent: Sqlworm
Disallow:/
User-agent: Sqworm
Disallow:/
User-agent: Steeler
Disallow:/
User-agent: Stripper
Disallow:/
User-agent: Sucker
Disallow:/
User-agent: Sucuri
Disallow:/
User-agent: SuperBot
Disallow:/
User-agent: SuperHTTP
Disallow:/
User-agent: Surfbot
Disallow:/
User-agent: SurveyBot
Disallow:/
User-agent: Suzuran
Disallow:/
User-agent: Swiftbot
Disallow:/
User-agent: sysscan
Disallow:/
User-agent: Szukacz
Disallow:/
User-agent: T0PHackTeam
Disallow:/
User-agent: T8Abot
Disallow:/
User-agent: tAkeOut
Disallow:/
User-agent: Teleport
Disallow:/
User-agent: TeleportPro
Disallow:/
User-agent: Telesoft
Disallow:/
User-agent: Telesphoreo
Disallow:/
User-agent: Telesphorep
Disallow:/
User-agent: The Intraformant
Disallow:/
User-agent: TheNomad
Disallow:/
User-agent: Thumbor
Disallow:/
User-agent: TightTwatBot
Disallow:/
User-agent: Titan
Disallow:/
User-agent: Toata
Disallow:/
User-agent: Toweyabot
Disallow:/
User-agent: Tracemyfile
Disallow:/
User-agent: Trendiction
Disallow:/
User-agent: Trendictionbot
Disallow:/
User-agent: trendiction.com
Disallow:/
User-agent: trendiction.de
Disallow:/
User-agent: True_Robot
Disallow:/
User-agent: Turingos
Disallow:/
User-agent: Turnitin
Disallow:/
User-agent: TurnitinBot
Disallow:/
User-agent: TwengaBot
Disallow:/
User-agent: Twice
Disallow:/
User-agent: Typhoeus
Disallow:/
User-agent: UnisterBot
Disallow:/
User-agent: Upflow
Disallow:/
User-agent: URLy Warning
Disallow:/
User-agent: URLy.Warning
Disallow:/
User-agent: Vacuum
Disallow:/
User-agent: Vagabondo
Disallow:/
User-agent: VB Project
Disallow:/
User-agent: VCI
Disallow:/
User-agent: VeriCiteCrawler
Disallow:/
User-agent: VidibleScraper
Disallow:/
User-agent: Virusdie
Disallow:/
User-agent: VoidEYE
Disallow:/
User-agent: Voil
Disallow:/
User-agent: Voltron
Disallow:/
User-agent: Wallpapers/3.0
Disallow:/
User-agent: WallpapersHD
Disallow:/
User-agent: WASALive-Bot
Disallow:/
User-agent: WBSearchBot
Disallow:/
User-agent: Webalta
Disallow:/
User-agent: WebAuto
Disallow:/
User-agent: Web Auto
Disallow:/
User-agent: WebBandit
Disallow:/
User-agent: WebCollage
Disallow:/
User-agent: Web Collage
Disallow:/
User-agent: WebCopier
Disallow:/
User-agent: WEBDAV
Disallow:/
User-agent: WebEnhancer
Disallow:/
User-agent: Web Enhancer
Disallow:/
User-agent: WebFetch
Disallow:/
User-agent: Web Fetch
Disallow:/
User-agent: WebGo IS
Disallow:/
User-agent: WebImageCollector
Disallow:/
User-agent: WebLeacher
Disallow:/
User-agent: WebmasterWorldForumBot
Disallow:/
User-agent: webmeup-crawler
Disallow:/
User-agent: WebPix
Disallow:/
User-agent: Web Pix
Disallow:/
User-agent: WebReaper
Disallow:/
User-agent: WebSauger
Disallow:/
User-agent: Web Sauger
Disallow:/
User-agent: Webshag
Disallow:/
User-agent: WebsiteExtractor
Disallow:/
User-agent: WebsiteQuester
Disallow:/
User-agent: Website Quester
Disallow:/
User-agent: Webster
Disallow:/
User-agent: WebStripper
Disallow:/
User-agent: WebSucker
Disallow:/
User-agent: Web Sucker
Disallow:/
User-agent: WebWhacker
Disallow:/
User-agent: WebZIP
Disallow:/
User-agent: WeSEE
Disallow:/
User-agent: Whack
Disallow:/
User-agent: Whacker
Disallow:/
User-agent: Whatweb
Disallow:/
User-agent: Who.is Bot
Disallow:/
User-agent: Widow
Disallow:/
User-agent: WinHTTrack
Disallow:/
User-agent: WiseGuys Robot
Disallow:/
User-agent: WISENutbot
Disallow:/
User-agent: Wonderbot
Disallow:/
User-agent: Woobot
Disallow:/
User-agent: Wotbox
Disallow:/
User-agent: Wprecon
Disallow:/
User-agent: WPScan
Disallow:/
User-agent: WWW-Collector-E
Disallow:/
User-agent: WWW-Mechanize
Disallow:/
User-agent: WWW::Mechanize
Disallow:/
User-agent: WWWOFFLE
Disallow:/
User-agent: x09Mozilla
Disallow:/
User-agent: x22Mozilla
Disallow:/
User-agent: Xaldon WebSpider
Disallow:/
User-agent: Xaldon_WebSpider
Disallow:/
User-agent: Xenu
Disallow:/
User-agent: xpymep1.exe
Disallow:/
User-agent: YoudaoBot
Disallow:/
User-agent: Zade
Disallow:/
User-agent: Zauba
Disallow:/
User-agent: zauba.io
Disallow:/
User-agent: Zermelo
Disallow:/
User-agent: Zeus
Disallow:/
User-agent: zgrab
Disallow:/
User-agent: Zitebot
Disallow:/
User-agent: ZmEu
Disallow:/
User-agent: ZumBot
Disallow:/
User-agent: ZyBorg
Disallow:/
#Majestic SEO
User-agent: MJ12bot
Disallow: /
#Open Site Explorer
User-agent: rogerbot
Disallow: /
#domaintools.com
User-agent: SurveyBot
Disallow: /
User-agent: Updownerbot
Disallow: /
User-agent: AhrefsBot/3.1
Disallow: /
User-agent: AhrefsBot
Disallow: /
User-agent: AhrefsBot/2.0
Disallow: /
User-agent: ahrefs
Disallow: /
User-agent: ahrefs.com
Disallow: /
User-agent: backlink-check.de
Disallow: /
User-agent: BacklinkCrawler
Disallow: /
User-agent: ExtractorPro
Disallow: /
User-agent: Fasterfox
Disallow: /
User-agent: LinkextractorPro
Disallow: /
User-agent: Baiduspider
Disallow: /
User-agent: Baiduspider-video
Disallow: /
User-agent: Baiduspider-image
Disallow: /
#iwebtool.com/backlink_checker
User-agent: iwebtool
Disallow: /
#monitorbacklinks.com/seo-tools/free-backlink-checker
User-agent: monitorbacklinks
Disallow: /
#analyzebacklinks.com
User-agent: analyzebacklinks
Disallow: /
#ranksignals.com
User-agent: ranksignals
Disallow: /
#explorer.cognitiveseo.com
User-agent: cognitiveseo
Disallow: /
#seoprofiler.com
User-agent: seoprofiler
Disallow: /
User-agent: Sogou Spider
Disallow: /
User-agent: Ezooms Robot
Disallow: /
User-agent: YodaoBot
Disallow: /
User-agent: YoudaoBot
Disallow: /
User-agent: FindLinks Robot
Disallow: /
User-agent: ShopWiki Crawler
Disallow: /
User-agent: Checkbot
Disallow: /
User-agent: Discobot
Disallow: /
User-agent: InternetSeer
Disallow: /
User-agent: BotRightHere
Disallow: /
User-agent: WebZip
Disallow: /
User-agent: larbin
Disallow: /
User-agent: b2w/0.1
Disallow: /
User-agent: Copernic
Disallow: /
User-agent: psbot
Disallow: /
User-agent: Python-urllib
Disallow: /
User-agent: NetMechanic
Disallow: /
User-agent: URL_Spider_Pro
Disallow: /
User-agent: CherryPicker
Disallow: /
User-agent: EmailCollector
Disallow: /
User-agent: EmailSiphon
Disallow: /
User-agent: WebBandit
Disallow: /
User-agent: EmailWolf
Disallow: /
User-agent: CopyRightCheck
Disallow: /
User-agent: Crescent
Disallow: /
User-agent: SiteSnagger
Disallow: /
User-agent: ProWebWalker
Disallow: /
User-agent: CheeseBot
Disallow: /
User-agent: LNSpiderguy
Disallow: /
User-agent: Alexibot
Disallow: /
User-agent: Teleport
Disallow: /
User-agent: TeleportPro
Disallow: /
User-agent: MIIxpc
Disallow: /
User-agent: Telesoft
Disallow: /
User-agent: Website Quester
Disallow: /
User-agent: moget/2.1
Disallow: /
User-agent: WebZip/4.0
Disallow: /
User-agent: WebStripper
Disallow: /
User-agent: WebSauger
Disallow: /
User-agent: WebCopier
Disallow: /
User-agent: NetAnts
Disallow: /
User-agent: Mister PiX
Disallow: /
User-agent: WebAuto
Disallow: /
User-agent: TheNomad
Disallow: /
User-agent: WWW-Collector-E
Disallow: /
User-agent: RMA
Disallow: /
User-agent: libWeb/clsHTTP
Disallow: /
User-agent: asterias
Disallow: /
User-agent: httplib
Disallow: /
User-agent: turingos
Disallow: /
User-agent: spanner
Disallow: /
User-agent: InfoNaviRobot
Disallow: /
User-agent: Harvest/1.5
Disallow: /
User-agent: Bullseye/1.0
Disallow: /
User-agent: WebBandit/3.50
Disallow: /
User-agent: NICErsPRO
Disallow: /
User-agent: DittoSpyder
Disallow: /
User-agent: Foobot
Disallow: /
User-agent: SpankBot
Disallow: /
User-agent: BotALot
Disallow: /
User-agent: lwp-trivial/1.34
Disallow: /
User-agent: lwp-trivial
Disallow: /
User-agent: BunnySlippers
Disallow: /
User-agent: URLy Warning
Disallow: /
User-agent: LinkWalker
Disallow: /
User-agent: cosmos
Disallow: /
User-agent: moget
Disallow: /
User-agent: hloader
Disallow: /
User-agent: humanlinks
Disallow: /
User-agent: Mata Hari
Disallow: /
User-agent: LexiBot
Disallow: /
User-agent: Web Image Collector
Disallow: /
User-agent: The Intraformant
Disallow: /
User-agent: True_Robot/1.0
Disallow: /
User-agent: True_Robot
Disallow: /
User-agent: BlowFish/1.0
Disallow: /
User-agent: JennyBot
Disallow: /
User-agent: MIIxpc/4.2
Disallow: /
User-agent: BuiltBotTough
Disallow: /
User-agent: ProPowerBot/2.14
Disallow: /
User-agent: BackDoorBot/1.0
Disallow: /
User-agent: toCrawl/UrlDispatcher
Disallow: /
User-agent: suzuran
Disallow: /
User-agent: TightTwatBot
Disallow: /
User-agent: VCI WebViewer VCI WebViewer Win32
Disallow: /
User-agent: VCI
Disallow: /
User-agent: Szukacz/1.4
Disallow: /
User-agent: Openfind data gatherer
Disallow: /
User-agent: Openfind
Disallow: /
User-agent: Xenu's Link Sleuth 1.1c
Disallow: /
User-agent: Xenu's
Disallow: /
User-agent: Zeus
Disallow: /
User-agent: RepoMonkey Bait & Tackle/v1.01
Disallow: /
User-agent: RepoMonkey
Disallow: /
User-agent: Microsoft URL Control
Disallow: /
User-agent: Openbot
Disallow: /
User-agent: URL Control
Disallow: /
User-agent: Zeus Link Scout
Disallow: /
User-agent: Zeus 32297 Webster Pro V2.9 Win32
Disallow: /
User-agent: Webster Pro
Disallow: /
User-agent: EroCrawler
Disallow: /
User-agent: LinkScan/8.1a Unix
Disallow: /
User-agent: Keyword Density/0.9
Disallow: /
User-agent: Kenjin Spider
Disallow: /
User-agent: Iron33/1.0.2
Disallow: /
User-agent: Bookmark search tool
Disallow: /
User-agent: GetRight/4.2
Disallow: /
User-agent: FairAd Client
Disallow: /
User-agent: Gaisbot
Disallow: /
User-agent: Aqua_Products
Disallow: /
User-agent: Radiation Retriever 1.1
Disallow: /
User-agent: Flaming AttackBot
Disallow: /
Иран - 217.219.130.179
Azad University of Ahar
Information Technology Company (ITC)
HTTP/1.1 200 OK
Date: Fri, 27 Dec 2019 23:34:17 GMT
Content-Type: text/html
Transfer-Encoding: chunked
Connection: keep-alive
Set-Cookie: __cfduid=d3516f2db4837252c1148464673c37d4a1577489656; expires=Sun, 26-Jan-20 23:34:16 GMT; path=/; domain=.geographic-space.ir; HttpOnly; SameSite=Lax
Last-Modified: Fri, 27 Dec 2019 16:11:46 GMT
Vary: Accept-Encoding
X-Turbo-Charged-By: LiteSpeed
CF-Cache-Status: DYNAMIC
Server: cloudflare
CF-RAY: 54bf1ab27f72e0da-IAD
Кнопка для анализа сайта в один клик, для установки перетащите ссылку на "Панель закладок"