claude-scraper-skill
Scrape websites ethically with retries, sitemaps, and resumable output
Scrape websites ethically with retries, sitemaps, and resumable output
scraper offers an article mode for clean text and metadata and a soup mode for CSS-selected fields. It respects robots.txt, handles retry and exponential backoff, writes JSONL incrementally, resumes successful URLs after interruption, and can seed work from a sitemap. The tool identifies HTML, PDF, and JSON responses and can optionally use ScraperAPI for proxying or JavaScript rendering. It is intended for auditable collection rather than unbounded crawling.
Resource types
Use cases
Platforms
Public GitHub facts last synced Jul 10, 2026.
Generate study-design-aware clinical Table 1 outputs in HTML, Word, and LaTeX.
Retrieve cited Quran and Sahih hadith texts through a RAG-backed Claude skill.
Define product problems through six research lenses before proposing solutions.
Review ML and AI papers with evidence-based critiques and verified references.