RoboView icon

RoboView

by estevecastells

v1.1 Updated Mar 20, 2025 23.87KiB
CWS
39
Users
★ 5.00
1 reviews
#83691
of 207.1K
developer
#6865 of 18.1K
⚠️Not updated in over a year ⚠️Requests 2 sensitive permissions

Description

RoboView: Visualize & Debug robots.txt Files RoboView lets you experience websites exactly as search engine crawlers and AI bots do, by enforcing robots.txt rules in real-time. Perfect for SEO professionals, web developers, and content creators who need to verify crawler accessibility. Key Features - Multiple Bot Simulation - Switch between popular crawler user-agents: * Search engines (Google, Bing, Baidu, Yandex) * AI crawlers (GPTBot, Claude, Perplexity) * Social media bots (Twitter/X, Facebook, LinkedIn) - Visual Indicators - Instantly see which content is allowed or blocked: * Blocked images appear grayed out with clear visual overlays * Blocked scripts and resources are highlighted * Full-page overlay for completely disallowed pages - Two Enforcement Modes: * Visual Mode: Show what's blocked without affecting functionality * Strict Mode: Actually block resources like a real crawler would - Cross-Domain Analysis - Examines robots.txt files from all resource domains, including CDNs and external hosts - Detailed Statistics - Track blocked resources and robots.txt status across sites - Developer Tools: * Robust robots.txt parser with accurate pattern matching * Comprehensive debug logs for troubleshooting * Copy button for sharing logs with your team Perfect For - SEO specialists validating crawler access - Web developers debugging robots.txt files - Content creators ensuring AI training data access - Security professionals verifying protection of sensitive content RoboView makes robots.txt testing quick and visual - no more guesswork about what crawlers can access on your site!
RoboView screenshot 1

Reviews

Loading reviews...

Permissions (5)

Permissions

activeTab Can access the current tab when you click the extension scripting Can inject scripts into web pages storage Can store data locally in your browser webRequest Can observe and analyze network traffic webRequestBlocking Can intercept and modify network requests

Details

Version 1.1
Updated Mar 20, 2025
Size 23.87KiB
First Seen Mar 26, 2026