| Возраст домена | n/a |
| Дата окончания | n/a |
| ИКС | n/a |
| Страниц в Google | n/a |
| Страниц в Яндексе | n/a |
| Dmoz | n/a |
| Яндекс Каталог | n/a |
| Alexa Traffic Rank | n/a |
| Alexa Country | n/a |
| История изменения показателей | Авторизация |
Идет сбор информации... Обновить
Debt Management Services Company Dubai UAE | Debt Restructuring Services Company Dubai UAE | Debt Consolidation Services Companies in Dubai UAE | Loan Consolidation Services Dubai UAE
n/a
Searching for Debt Management Services Company in Dubai? Lotus is Dubai based Debt Restructuring Services Company in UAE. Also graded best in Debt Consolidation Companies in Dubai & Loan Consolidation Services in Dubai, UAE
UTF-8
367.07 КБ
939
6 932 симв.
5 835 симв.
Идет сбор информации... Обновить
Идет сбор информации... Обновить

Идет сбор информации... Обновить
Идет сбор информации... Обновить
# ============================================================
# ROBOTS.TXT FOR LOTUS ADVISORY UAE
# Optimized for SEO and AI Crawlers (2026)
# Domain: https://lotusadvisoryuae.com
# Last Updated: February 16, 2026
# ============================================================
Sitemap: https://lotusadvisoryuae.com/sitemap.xml
Sitemap: https://lotusadvisoryuae.com/sitemap_index.xml
Sitemap: https://lotusadvisoryuae.com/post-sitemap.xml
Sitemap: https://lotusadvisoryuae.com/page-sitemap.xml
# ============================================================
# DEFAULT RULES - ALLOW ALL GOOD BOTS
# ============================================================
User-agent: *
Allow: /
# Block WordPress system directories
Disallow: /wp-admin/
Disallow: /wp-includes/
Disallow: /wp-content/plugins/
Disallow: /wp-content/themes/
Disallow: /wp-content/cache/
# Allow specific WordPress files that are safe
Allow: /wp-admin/admin-ajax.php
Allow: /wp-content/uploads/
# Block system files
Disallow: /wp-config.php
Disallow: /readme.html
Disallow: /license.txt
Disallow: /xmlrpc.php
# Block duplicate content and parameters
Disallow: /*?*
Disallow: /?s=
Disallow: /search/
Disallow: /*?replytocom
Disallow: /feed/
Disallow: /*/feed/
Disallow: /trackback/
Disallow: /*/trackback/
Disallow: /embed/
Disallow: /*/embed/
# Block taxonomies that create thin content
Disallow: /tag/
Disallow: /author/
Disallow: /page/
Disallow: /category/*/page/
# Block printer-friendly and AMP versions (if not used)
Disallow: /*/print/
Disallow: /*/amp/
# Block admin and login pages
Disallow: /wp-login.php
Disallow: /wp-register.php
Disallow: /wp-signup.php
# Block private/temp directories
Disallow: /private/
Disallow: /temp/
Disallow: /backup/
Disallow: /cgi-bin/
# Block file types that shouldn't be indexed
Disallow: /*.php$
Disallow: /*.inc$
Disallow: /*.gz$
Disallow: /*.cgi$
Disallow: /*.bak$
Disallow: /*.old$
# ============================================================
# OPENAI / CHATGPT - FULL ACCESS
# ============================================================
User-agent: GPTBot
Allow: /
Crawl-delay: 1
User-agent: ChatGPT-User
Allow: /
User-agent: OAI-SearchBot
Allow: /
Crawl-delay: 1
# ============================================================
# ANTHROPIC / CLAUDE - FULL ACCESS
# ============================================================
User-agent: ClaudeBot
Allow: /
Crawl-delay: 1
User-agent: Claude-Web
Allow: /
User-agent: anthropic-ai
Allow: /
# ============================================================
# GOOGLE AI (GEMINI, BARD, VERTEX) - FULL ACCESS
# ============================================================
User-agent: Google-Extended
Allow: /
User-agent: GoogleOther
Allow: /
User-agent: GoogleProducer
Allow: /
User-agent: Vertex-AI-Agent
Allow: /
User-agent: Bard
Allow: /
# ============================================================
# PERPLEXITY AI - FULL ACCESS
# ============================================================
User-agent: PerplexityBot
Allow: /
Crawl-delay: 1
# ============================================================
# OTHER AI SEARCH ENGINES - FULL ACCESS
# ============================================================
# You.com AI Search
User-agent: YouBot
Allow: /
Crawl-delay: 1
# Apple Intelligence
User-agent: Applebot-Extended
Allow: /
# Diffbot
User-agent: Diffbot
Allow: /
# Cohere AI
User-agent: cohere-ai
Allow: /
# Allen Institute AI
User-agent: AI2Bot
Allow: /
# Omgili Search
User-agent: Omgilibot
Allow: /
Crawl-delay: 1
# ============================================================
# MAJOR SEARCH ENGINES - STANDARD ACCESS
# ============================================================
# Google (most important)
User-agent: Googlebot
Allow: /
User-agent: Googlebot-Image
Allow: /wp-content/uploads/
User-agent: Googlebot-News
Allow: /
# Bing
User-agent: Bingbot
Allow: /
Crawl-delay: 1
User-agent: MSNBot-Media
Allow: /wp-content/uploads/
# Yahoo
User-agent: Slurp
Allow: /
Crawl-delay: 1
# DuckDuckGo
User-agent: DuckDuckBot
Allow: /
# Yandex (block if not targeting Russia)
User-agent: YandexBot
Disallow: /
# Baidu (block if not targeting China)
User-agent: Baiduspider
Disallow: /
# ============================================================
# SOCIAL MEDIA CRAWLERS - ALLOW FOR SHARING
# ============================================================
# Facebook
User-agent: facebookexternalhit
Allow: /
# Twitter/X
User-agent: Twitterbot
Allow: /
# LinkedIn
User-agent: LinkedInBot
Allow: /
# Pinterest
User-agent: Pinterestbot
Allow: /
# WhatsApp
User-agent: WhatsApp
Allow: /
# Telegram
User-agent: TelegramBot
Allow: /
# ============================================================
# SEO TOOL CRAWLERS - CONTROL ACCESS
# ============================================================
# Ahrefs (uncomment to block if too aggressive)
# User-agent: AhrefsBot
# Disallow: /
# SEMrush (uncomment to block if too aggressive)
# User-agent: SemrushBot
# Disallow: /
# Moz (uncomment to block if too aggressive)
# User-agent: DotBot
# Disallow: /
# Majestic
# User-agent: MJ12bot
# Disallow: /
# ============================================================
# AGGRESSIVE CRAWLERS - BLOCK COMPLETELY
# ============================================================
# ByteDance/TikTok - Very aggressive
User-agent: Bytespider
Disallow: /
# Huawei - High bandwidth usage
User-agent: PetalBot
Disallow: /
# Generic scrapers
User-agent: Scrapy
Disallow: /
User-agent: curl
Disallow: /
User-agent: wget
Disallow: /
User-agent: python-requests
Disallow: /
# Bad/spam bots
User-agent: MJ12bot
Disallow: /
User-agent: AhrefsBot
Disallow: /
User-agent: SemrushBot
Disallow: /
User-agent: DotBot
Disallow: /
User-agent: BLEXBot
Disallow: /
User-agent: DataForSeoBot
Disallow: /
# ============================================================
# ADDITIONAL NOTES
# ============================================================
#
# This robots.txt file:
# ✓ Allows all major search engines (Google, Bing, Yahoo, DuckDuckGo)
# ✓ Allows all AI crawlers (ChatGPT, Claude, Gemini, Perplexity)
# ✓ Allows social media crawlers for proper link previews
# ✓ Blocks WordPress admin and sensitive areas
# ✓ Blocks duplicate content and parameter URLs
# ✓ Blocks aggressive/unwanted crawlers
# ✓ Includes all sitemap locations
#
# Test this file at:
# - Google Search Console: https://search.google.com/search-console
# - Bing Webmaster Tools: https://www.bing.com/webmasters
# - robots.txt Tester: https://www.google.com/webmasters/tools/robots-testing-tool
#
# ============================================================
Индия - Бангалор - 139.59.18.199
HTTP/2 200
server: nginx
date: Fri, 17 Apr 2026 05:35:17 GMT
content-type: text/html; charset=UTF-8
x-flying-press-source: PHP
content-encoding: gzip
cache-tag: lotusadvisoryuae.com
cdn-cache-control: max-age=2592000
cache-control: no-cache, must-revalidate
x-flying-press-cache: HIT
last-modified: Thu, 16 Apr 2026 20:01:46 GMT
x-frame-options: SAMEORIGIN
x-content-type-options: nosniff
x-xss-protection: 1; mode=block
x-permitted-cross-domain-policies: master-only
referrer-policy: same-origin
alt-svc: h3=":443"; ma=86400
Кнопка для анализа сайта в один клик, для установки перетащите ссылку на "Панель закладок"