Works with the AI Agents you already use

    Claude CodeClaude CodeCursorCursorCodex CLICodex CLIDeepSeekDeepSeekMuseMuse+22 more

    Twitter/X Scraper

    2

    Automated Twitter/X profile discovery and browser-based scraping with anti-detection and proxy support.

    $8

    Secure checkout via Stripe

    Money-back guarantee

    Converts to your local currency at checkout

    Security scanned
    Twitter/X Scraper

    Twitter/X Scraper

    Example session with this skill installed

    Find 10 tech influencers in Miami and scrape their profile stats and recent tweets. Save the results as a CSV.

    • Read your context and instructions
    • Compiled the twitter x scraper
    • Generated the data export

    I have initiated the discovery and scraping process for tech influencers in Miami. Using the DuckDuckGo fallback for discovery, I identified 10 relevant profiles and performed stealth browser scraping to extract their metrics.

    Miami Tech Influencer Report

    UsernameDisplay NameFollowersVerifiedTop Tweet EngagementMedia Saved
    miamitechguyAlex Rivera45,200Yes1.2k Likes, 340 RTs3 images
    305devSofia Chen12,800No450 Likes, 89 RTs1 image
    venturemiamiMiami VC89,500Yes2.1k Likes, 600 RTs5 images
    cryptobeachJulian Voss5,400No120 Likes, 15 RTs2 images
    sunshinecodeElena Rodriguez22,100Yes890 Likes, 210 RTs4 images
    techeventsmiaMIA Tech Hub31,000Yes560 Likes, 150 RTs2 images
    startuphialeahMarcus Thorne2,900No95 Likes, 12 RTs1 image
    brickellfintechDavid Bloom15,300No310 Likes, 45 RTs3 images
    magiccityaiSarah J.7,800No205 Likes, 33 RTs1 image
    siliconbeach305Tech Watch110,000Yes4.5k Likes, 1.1k RTs6 images

    Next steps

    • Access the full dataset in data/export_20260220_1430.csv.
    • Review the downloaded media files in the thumbnails/ directory.
    • Configure a residential proxy in config/scraper_config.json before running larger batches.

    export_20260220_1430.csv

    CSV · data export

    Generated

    Example file from a real run - the skill writes it into your workspace.

    Connects securely to your tools. The creator never sees your data.

    About this skill

    The problem

    Manually collecting Twitter/X profile data for lead generation or influencer research is slow and prone to immediate IP bans. Developers face constant challenges with login walls, sophisticated bot detection, and unstable DOM selectors.

    What it does

    • Discovers niche-specific profiles by location and category using Google Custom Search or DuckDuckGo.
    • Extracts full profile metadata including follower counts, verified status, and engagement metrics without requiring a login.
    • Simulates human behavior using Playwright with stealth scripts, canvas noise, and randomized mouse movements.
    • Automates media archival by downloading profile pictures and tweet media to local storage.
    • Manages long-running sessions with built-in checkpointing, auto-resume, and residential proxy rotation.

    Frameworks & tools

    Python 3, Playwright, Chromium, and Google Custom Search API.

    Why this beats prompting it yourself

    Vanilla LLM prompts cannot bypass Twitter's aggressive anti-bot measures or handle dynamic browser rendering. This skill integrates specific fingerprinting evasion and residential proxy logic that a standard agentic script lacks, ensuring reliable data extraction at scale.

    Use cases

    • Building verified lead lists for local businesses based on geographic metadata.
    • Conducting competitive analysis by monitoring engagement trends across industry influencers.
    • Archiving social media presence for brand sentiment analysis and sentiment tracking.
    • Automating the discovery of niche micro-influencers for targeted marketing campaigns.

    Known limitations

    Does not scrape private (protected) accounts. Requires a residential proxy for high-volume operations to avoid rate limits.

    Find more skills like this on the Claude Skills Marketplace, the Codex Skills Marketplace and the Gemini Skills Marketplace, or browse Claude Skills to Reverse Engineer and Scrape Websites.

    Only scrapes public profiles. High-volume scraping requires residential proxies. Discovery limited by Google API quotas if not using DuckDuckGo fallback.

    How to use

    1. 1

      Connect your agent to the Agensi MCP

      Copy the prompt and paste it into Claude, ChatGPT, Cursor or any agent that supports MCP. It sets up the connection for you. Manual setup

    2. 2

      Sign in to Agensi

      Your agent shows a sign-in link. Sign in and click Allow.

    3. 3

      Ask for what you need

      Your agent loads this skill and uses it on your task. It always asks before buying a skill.

    Reviews

    No reviews yet

    Be one of the first to try it. Every listed skill goes through the trust checks below.

    Security scanned

    Checked by our 8-point scan before listing

    Fresh listing

    Recently published to Agensi

    Money-back guarantee

    Doesn't do what its page promises? You get your money back.

    Trust & safety

    Security scan

    Security scan passed 1 month ago

    Accounts
    Duckduckgo
    Software
    Python

    Permissions

    Terminal / Shell
    Browser
    Network Access

    Allowed Hosts

    www.googleapis.com
    html.duckduckgo.com
    Listed1 month ago

    What's inside

    Frequently Asked Questions

    This skill automates the identification and data extraction of Twitter/X profiles, using stealth-focused browser automation to bypass login requirements and anti-bot measures that usually block standard scrapers.

    The package includes the full Python source code, Playwright integration scripts, stealth configuration files, and a comprehensive guide for setting up residential proxies and API keys.

    A residential proxy is highly recommended for high-volume scraping to prevent IP rate-limiting, and you will need a Google Custom Search API key if you plan to use the automated profile discovery feature.

    No, this skill is specifically designed to extract public profile metadata and media without needing to log in, which significantly reduces the risk of account suspension.

    Yes, the skill is built with Python 3 and Playwright, making it compatible with any AI agent framework that supports local script execution or custom tool integration.

    While the skill uses robust DOM selectors and stealth scripts, we provide periodic updates to address changes in Twitter's site architecture or bot detection algorithms at no additional cost.

    New in Social Media