openclaw-web-scraper
by BCStudio
A high-performance scraping engine with Playwright stealth, proxy rotation, and anti-bot bypass capabilities.
- Automate market intelligence by monitoring competitor pricing changes daily.
- Extract structured product data from JS-heavy e-commerce sites.
- Bypass Cloudflare and Captchas using stealth browser profiles.
Free
Included in download
- Downloadable skill package
- Works with Claude Code, Codex CLI
- 1 permission declared
Sample input
Extract the product name, price, and availability from https://tech-store.com/headphones/premium-wireless using playwright-stealth and a US residential proxy.
Sample output
{ "status": "success", "data": { "product_name": "Premium Wireless Headphones", "price": "$299.99", "availability": "In Stock", "metadata": { "engine": "playwright-stealth", "proxy_id": "res-us-882", "render_time": "1.2s" } } }
openclaw-web-scraper
by BCStudio
A high-performance scraping engine with Playwright stealth, proxy rotation, and anti-bot bypass capabilities.
Free
Included in download
- Downloadable skill package
- Works with Claude Code, Codex CLI
- 1 permission declared
- Instant install
Sample input
Extract the product name, price, and availability from https://tech-store.com/headphones/premium-wireless using playwright-stealth and a US residential proxy.
Sample output
{ "status": "success", "data": { "product_name": "Premium Wireless Headphones", "price": "$299.99", "availability": "In Stock", "metadata": { "engine": "playwright-stealth", "proxy_id": "res-us-882", "render_time": "1.2s" } } }
About This Skill
A powerful web scraping skill that handles everything from simple page fetches to complex multi-page crawls with anti-bot bypass and proxy rotation. Features include: Playwright-based dynamic page scraping, stealth mode for Cloudflare bypass, automatic proxy rotation with quality scoring, rate limiting with exponential backoff, structured data extraction, and robots.txt compliance. Works with Claude Code, Codex CLI, Cursor, Gemini CLI and any SKILL.md compatible agent.
Use Cases
- Automate market intelligence by monitoring competitor pricing changes daily.
- Extract structured product data from JS-heavy e-commerce sites.
- Bypass Cloudflare and Captchas using stealth browser profiles.
- Scale data collection with automatic proxy rotation and error handling.
Known Limitations
- Cannot bypass all enterprise-grade CAPTCHAs
- Higher resource usage with Playwright engine
- Performance depends on proxy provider quality
How to Install
mkdir -p ~/.claude/skills && curl -sL https://www.agensi.io/api/install/openclaw-web-scraper -o /tmp/openclaw-web-scraper.zip && unzip -o /tmp/openclaw-web-scraper.zip -d ~/.claude/skills && rm /tmp/openclaw-web-scraper.zipFree skills install directly. Paid skills require purchase - use the download button above after buying.
Reviews
No reviews yet - be the first to share your experience.
Only users who have downloaded or purchased this skill can leave a review.
No reviews yet - be the first to share your experience.
Only users who have downloaded or purchased this skill can leave a review.
Security Scanned
Passed automated security review
Permissions
Allowed Hosts
Claude Code, Codex CLI, Cursor, Gemini CLI, and SKILL.md-compatible agents.
Creator
Frequently Asked Questions
Learn More About AI Agent Skills
More Premium Skills
local-seo-audit
Automated local SEO auditing and keyword generation for agencies and small businesses.
endless-loop
Autonomous research and task loop that builds on previous findings to solve complex objectives while you sleep.
designing-hybrid-context-layers
Architects the right retrieval strategy for every query — teaching your agent when to use RAG, a knowledge graph, or a temporal index instead of defaulting to vector search for everything.
ai-automation-qa-pack
Professional QA & UAT documentation generator for AI automation agencies and complex agent deployments.