scrapling-technical-seo-crawler
by Roy Yuen
Professional technical SEO crawler and site auditor for deep architectural analysis and issue detection.
New: Subscription skills are here. Software for Agents, always up-to-date, delivered via MCP or web. Browse
Works with every major AI coding agent
Skills are portable instruction sets that extend what AI coding agents can do. Each skill is a SKILL.md file your agent reads to learn new capabilities, from writing tests to deploying infrastructure. Compatible with Claude Code, OpenClaw, Codex CLI, Cursor, and 20+ agents. Browse the marketplace to find skills built by the community, or publish your own.
5 skills found
by Roy Yuen
Professional technical SEO crawler and site auditor for deep architectural analysis and issue detection.
Catch the Open Graph and Twitter Card problems that make a shared link preview blank or broken. Flags missing og:title, og:image, og:description, og:url, or twitter:card, a relative og:image URL (crawlers need an absolute one), an SVG og:image (no platform renders it), and image dimensions that miss the 1200x630 standard. Reads your HTML or pasted head markup; it does not fetch the page or refresh a platform's cache.
Generate a spec-compliant llms.txt (and optional llms-full.txt) for your site or repo so AI agents and crawlers can navigate it. Curates the pages that matter, writes the exact llmstxt.org structure — single H1, blockquote summary, and link sections in the precise format agents parse — then validates the format and tells you where to put it. The honest version: a low-cost, machine-readable surface for the agentic web, not an overhyped SEO trick.
by Joker
Python project routing for Web API/crawler/automation/data/CLI. FastAPI/Django/Flask selection, async patterns, deployment strategies.
Check your robots.txt and sitemap.xml for the mistakes that quietly block crawlers. Flags a site-wide Disallow: /, malformed directives, a missing Sitemap: line, sitemap XML that is not well-formed, <loc> URLs missing a scheme, mixed http and https, and sitemaps over the 50,000-URL or 50MB limits. Reads local files or pasted text and never touches the live site.
Discover AI agent skills that accelerate UI development, component generation, CSS styling, and design system workflows. These skills help agents write cleaner front-end code and ship pixel-perfect interfaces faster.
View allEquip your AI coding agent with skills for writing unit tests, integration tests, and end-to-end tests. Improve code coverage, catch regressions early, and automate quality assurance workflows.
View allSkills that help AI agents manage CI/CD pipelines, Docker containers, infrastructure-as-code, and cloud deployments. Automate your deployment workflows and reduce operational overhead.
View allGive your AI agent the ability to perform thorough code reviews, identify anti-patterns, suggest refactors, and enforce coding standards automatically across your codebase.
View allSkills that help AI agents generate READMEs, API docs, inline comments, changelogs, and technical writing. Keep your documentation accurate and up-to-date with minimal effort.
View allBoost your development workflow with skills for task management, code scaffolding, boilerplate generation, and workflow automation. Help your AI agent save you hours of repetitive work.
View allSkills for working with databases, data pipelines, ETL processes, SQL optimization, and data modeling. Help your AI agent handle complex data transformations and schema design.
View allEquip your AI agent with skills for building REST APIs, GraphQL endpoints, authentication flows, and API integrations. Design, document, and ship robust APIs faster.
View all