More screenshots
Works with the AI Agents you already use
Claude Code
Cursor
Codex CLI
Muse
Dots+20 moreClaude CodeCursorCodex CLIMuseDots
Manus
Grok
Grok Bot+17 agentsπ€ Robots Sitemap Validator
It automates the tedious process of auditing local sitemap and robots.txt files, ensuring your site's architecture is search-engine friendly.
Free
π€ Robots Sitemap Validator
Example session with this skill installed
Audit the robots.txt and sitemap.xml in my public directory to make sure I'm not blocking search engines from the main site.
- Read your context and instructions
- Compiled the robots sitemap validator
Scan results for /public
- [CRITICAL] robots.txt L4: User-agent: * Disallow: / (Blocks all crawling)
- [WARNING] robots.txt L12: Sitemap: /sitemap_index.xml (File not found in local directory)
- [INFO] sitemap.xml: Valid XML structure found with 42 URLs.
Connects securely to your tools. The creator never sees your data.
About this skill
Ensure Search Engines Can Crawl Your Code
The Robots Sitemap Validator is a specialized tool for developers and SEO teams to catch critical crawling mistakes before they hit production. It automates the tedious process of auditing local sitemap and robots.txt files, ensuring your site's architecture is search-engine friendly.
What it does
- Identifies syntax errors in
robots.txtandsitemap.xmlfiles. - Detects "orphan" sitemaps where a robots.txt references a file that doesn't exist locally.
- Flags high-severity blocking rules that might accidentally de-index important sections of your site.
- Provides structured feedback including rule IDs, severity levels, and exact line numbers.
Why use this skill?
Manual SEO audits are prone to human error, and production-only crawlers find issues too late. This skill integrates into your local development or CI/CD workflow to detect issues while you're coding. It supports standard web protocols and works with any directory structure, providing a layer of safety that generic LLM prompting cannot match in terms of precision and file-system awareness.
How to use
- 1
Connect your agent to the Agensi MCP
Copy the prompt and paste it into Claude, ChatGPT, Cursor or any agent that supports MCP. It sets up the connection for you. Manual setup
- 2
Sign in to Agensi
Your agent shows a sign-in link. Sign in and click Allow.
- 3
Ask for what you need
Your agent loads this skill and uses it on your task. It always asks before any payment.
Reviews
No reviews yet
Be one of the first to try it. Every listed skill goes through the trust checks below.
Security scanned
Checked by our 8-point scan before listing
4 uses
Times used to date
Free forever
No account required to browse
Trust & safety
Security scan
Security scan passed with 1 warning 4 months ago
- Free with an Agensi account