More screenshots

    Works with the AI Agents you already use

    Claude CodeClaude CodeCursorCursorCodex CLICodex CLIDeepSeekDeepSeekMuseMuse+22 more

    job posting deduper

    1

    **The same SOC Analyst job showed up three times this week.

    $8.29

    Secure checkout via Stripe

    Money-back guarantee

    Converts to your local currency at checkout

    Security scanned

    About this skill

    The same SOC Analyst job showed up three times this week. Apply once, on the right site.

    Give it the CSVs you exported or copied from each board. It maps their different column names, cleans URLs (drops utm_*, refId, trackingId and similar parameters, and reads LinkedIn job IDs and Indeed jk keys), and normalizes companies (Inc/LLC), titles (Sr./Senior, I/1, Tier 1, '(Remote)') and locations (Austin, Texas, United States = Austin, TX). Jobs merge on the same URL, the same company + title + location, or near-identical descriptions from the same company. For each job it keeps the best apply link (the employer's careers or ATS page such as Workday, Greenhouse or Lever over aggregators), the salary from whichever copy had one, and the earliest posted date. It shows board overlap so you can see which boards add unique jobs, and marks or hides jobs already in your application tracker.

    What it does

    • Column aliases for common exports (Job Title, Employer, Link, Date Posted...)
    • URL cleaning plus LinkedIn/Indeed job-ID matching
    • Title, company and location normalization
    • Union-find merging on URL, company+title+location, or description similarity
    • Canonical link prefers the employer/ATS page; keeps salary and earliest date
    • Board-overlap table and --applied / --hide-applied using your tracker CSV

    Who it's for

    Job seekers pulling from several boards and alerts who want one deduplicated list to work from, and anyone feeding a bulk-tailoring workflow.

    Limits

    Needs title and company in every file. Without descriptions, differently titled duplicates may not merge. Location normalization covers US formats best.

    What's included

    • SKILL.md: workflow, commands, how to explain results
    • scripts/: the tool (standard-library Python)
    • references/: sources
    • examples/: sample inputs used in the demo (all made up)
    • tests/: unit tests (Python 3.8 / 3.9 / 3.13)

    Standard-library Python only. No API keys, no network calls, no installs.

    Find more skills like this on the Claude Skills Marketplace, the Codex Skills Marketplace and the Gemini Skills Marketplace, or browse Claude Skills for Data & Databases.

    • Needs title and company in every file. Without descriptions, differently titled duplicates may not merge.
    • Location normalization covers US formats best.

    How to use

    1. 1

      Connect your agent to the Agensi MCP

      Copy the prompt and paste it into Claude, ChatGPT, Cursor or any agent that supports MCP. It sets up the connection for you. Manual setup

    2. 2

      Sign in to Agensi

      Your agent shows a sign-in link. Sign in and click Allow.

    3. 3

      Ask for what you need

      Your agent loads this skill and uses it on your task. It always asks before buying a skill.

    Reviews

    No reviews yet

    Be one of the first to try it. Every listed skill goes through the trust checks below.

    Security scanned

    Checked by our 8-point scan before listing

    Fresh listing

    Recently published to Agensi

    Money-back guarantee

    Doesn't do what its page promises? You get your money back.

    Trust & safety

    Security scan

    Security scan passed today

    Permissions

    Terminal / Shell
    Read Files
    Write Files
    Network Access

    File Scopes

    job-posting-deduper/**

    Fully offline. No network calls, no credential access, and it never logs into, scrapes or submits anything on job boards.

    Listedtoday

    What's inside

    Frequently Asked Questions

    No. It merges files you already have. No scraping and no logins.

    Same-company jobs with near-identical descriptions are merged even when titles differ (threshold adjustable with --threshold).

    Any CSV with company and title columns, including the Job Application Tracker skill's file.

    New in Data & Databases