More screenshots

    Works with the AI Agents you already use

    Claude CodeClaude CodeCursorCursorCodex CLICodex CLIMuseMuseDotsDots+22 more

    Crawlproof: Find what keeps your site out of search

    1

    Checks robots.txt, sitemaps, redirects, canonicals, Core Web Vitals, structured data and AI crawler rules with free tools, then writes a P0 to P3 fix list where every item has evidence and a verify step.

    $12

    Secure checkout via Stripe

    Money-back guarantee

    Converts to your local currency at checkout

    Security scanned
    Crawlproof: Find what keeps your site out of search

    Crawlproof: Find what keeps your site out of search

    Example session with this skill installed

    Crawlproof: audit https://example-clinic.test before we quote. Key templates are home, service, article and contact. No Search Console access.

    • Read your context and instructions
    • Compiled the crawlproof

    Audited 4 templates on production at a polite rate. Search Console not available, so indexing data is marked Not verified.

    IDPFindingEvidenceFixVerifyEffort
    01P0Home page noindexsource: content="noindex"remove the meta tagraw HTML has no noindexS
    02P1Sitemap lists 12 URLs that redirect/services 301 to /our-servicesregenerate from final canonical URLsevery sitemap URL returns 200 with self canonicalS
    03P1Service LCP 4.1 s (lab)1.8 MB hero image, no width or heightresize, set dimensionsLighthouse mobile LCP 2.5 s or lessM
    04P2Article canonical points to staging hosthref="https://staging.example-clinic.test/..."absolute self canonical on HTTPS hostview source on 3 articlesS
    05P2Opening hours only in an imagecontact page has no text hoursadd hours as plain textraw HTML contains hoursS
    06P37 images missing altgallery thumbnailsadd meaningful altDOM checkS
    07-Field CWV and index coverageno Search Console access-Not verified-

    Owner summary
    The home page tells search engines not to index it, which blocks traffic now. Cheapest high-impact fixes: remove the noindex, regenerate the sitemap, fix the article canonical. The hero image work needs a developer. AI crawler rules in robots.txt were copied from a template; please confirm allow or block for each one.

    Next steps

    1. Remove the noindex today and recheck the raw HTML.
    2. Confirm the AI crawler policy line by line.
    3. Turn findings 01 to 06 into a priced fix package.

    Connects securely to your tools. The creator never sees your data.

    About this skill

    A site can launch, look fine and still be missing from search for weeks. A staging noindex ships to production, the sitemap lists redirects, and the audit you got back says "improve speed" with no URL attached. Crawlproof runs a technical SEO audit of a live site with free tools and writes a fix list where every item can be checked.

    What it does

    • Crawl gates checks robots.txt, every sitemap, X-Robots-Tag headers and meta noindex on production first.
    • Status and redirects maps hop paths for each key URL and its http, www and trailing-slash variants.
    • Canonicals and duplicates catches canonicals pointing at the home page, a redirect or a staging domain.
    • Core Web Vitals budget measures LCP, INP and CLS per template, labelled field or lab, with a named cause.
    • Structured data checks JSON-LD against what is actually visible on the page.
    • AI-search basics reviews AI crawler rules with the owner and checks that key business facts are crawlable plain text.

    How it works

    1. Scope and permission: domain, 5 to 10 key templates, polite fetch rate.
    2. Production checks: crawl gates, status codes, canonicals.
    3. Per-template checks: CWV, rendering without JavaScript, metadata, internal links, alt text, schema, hreflang, HTTPS.
    4. Write-up: P0 to P3 findings with evidence, fix, verify step and effort, plus a short owner summary that leads with blockers.

    Frameworks & tools

    curl, PageSpeed Insights or local Lighthouse, the Rich Results Test and the Schema.org validator. No paid crawler or SEO API by default; it asks before any spend.

    Why this beats prompting it yourself

    Every finding needs a URL, evidence and a verify step, so vague advice does not pass. Metrics are labelled field or lab, anything not checked is marked Not verified, and Search Console data is never claimed unless it was seen.

    Use cases

    • Pre-quote audit of a client site, top ten findings.
    • Migration check on launch day and again a week later.
    • Traffic drop or "why is my site not on Google".
    • Own-repo audit with fixes made in a branch and rechecked on the preview URL.

    Known limitations

    Not for keyword research, rank tracking, job posting markup or visual redesign. Without Search Console access, field data and indexing status stay Not verified.

    How to use

    Skills on Agensi run inside your AI agent. Copy the prompt, paste it into your agent, and it connects to Agensi and installs this skill for you. If a payment is needed, your agent shows it to you first.

    Reviews

    No reviews yet

    Be one of the first to try it. Every listed skill passes our trust checks below.

    Security scanned

    Passed our 8-point scan before listing

    Fresh listing

    Recently published to Agensi

    Money-back guarantee

    Doesn't do what its page promises? You get your money back.

    Trust & safety

    Security scanned

    Verified clean 1 day ago

    • Passed all security checks, Safe to install

    Requires

    curl
    PageSpeed Insights
    Lighthouse
    Rich Results Test
    Schema.org validator

    Listed1 day ago

    What's inside

    Frequently Asked Questions