Home
cd ../playbooks
Developer ToolsBeginner

Scrapling Web Extractor

Install, troubleshoot, and use the Scrapling CLI to extract HTML, Markdown, or text from webpages — including browser-backed fetching and tricky sources like WeChat articles.

10 minutes
By daymadeSource
#scraping#extraction#markdown#web#scrapling

Some pages won't yield to a simple fetch — they need a real browser, and others are simple but you're over-engineering. This playbook picks the right extraction mode and gets the content.

Who it's for: researchers, content curators, developers, data collectors

Example

"Extract this WeChat article as Markdown" → Clean Markdown via browser-backed fetching, with the static-vs-dynamic choice made for you

CLAUDE.md Template

New here? 3-minute setup guide → | Already set up? Copy the template below.

Or install from your terminal:
npx ccplaybooks add scrapling-skill
# Scrapling Skill

## Overview

Use Scrapling through its CLI as the default path. Start with the smallest working command, validate the saved output, and only escalate to browser-backed fetching when the static fetch does not contain the real page content.

Do not assume the user's Scrapling install is healthy. Verify it first.

## Default Workflow

Copy this checklist and keep it updated while working:

Get new playbooks like this one

One email a week with new Claude Code workflows. Free, like everything here.

No spam. Unsubscribe anytime.

README.md

What This Does

Install, troubleshoot, and use the Scrapling CLI to extract HTML, Markdown, or text from webpages — including browser-backed fetching and tricky sources like WeChat articles.

What's Inside

The template covers:

  • Default Workflow
  • Step 1: Diagnose the Install
  • Step 2: Fix the Install
  • Step 3: Choose the Fetcher
  • Step 4: Run the Smallest Useful Command
  • Step 5: Validate the Output

Quick Start

Step 1: Create a Project Folder

Make a dedicated folder for this workflow and open it in Claude Code.

Step 2: Download the Template

Click Download above to save the template, then drop it into your project as CLAUDE.md (or paste it into your existing one).

Step 3: Start Working

Tell Claude what you need in plain language — it will follow the template's workflow automatically. For example:

Extract this WeChat article as Markdown

Claude reads the template and runs the steps for you.

$Related Playbooks

Developer Tools

Statusline Generator

Install, configure, customize, or troubleshoot the Claude Code statusline — cwd, model, token counts, cost via ccusage, git status — and fix a statusline that's blank, stuck, or silent.

10 minutes
Beginner
Developer Tools

Tunnel Doctor

Diagnose and fix conflicts between Tailscale and proxy/VPN tools on macOS — route hijacking, proxy env vars, SSH double-tunneling, and the ~60s DNS resolver stall.

15 minutes
Advanced
Developer Tools

Vibe Coder: Idea to Prototype

Describe what you want to build and get clean, working code with a simple approach explanation, setup instructions, and optional improvements — optimized for shipping over perfecting.

5 minutes
Beginner
Developer Tools

Skill Autoresearch Optimizer

Autonomously optimize any Claude Code skill by running it dozens of times, scoring outputs against binary evals, and mutating the prompt until quality climbs.

15 minutes
Advanced
Developer Tools

Twilio SMS Integration

Automate SMS communications, two-way messaging, notifications, and voice workflows with Twilio

10 minutes
Advanced
Developer Tools

Technical Documentation from Engineering

Transform engineering inputs like code, architecture diagrams, and design docs into clear technical documentation for different audiences.

10 minutes
Intermediate
Developer Tools

Technical Specification Writing

Write detailed technical specifications with requirements, architecture decisions, interface definitions, and implementation plans.

10 minutes
Intermediate
Developer Tools

PR Reviewer

Senior engineer PR review system - structured feedback on correctness, security, tests, and maintainability with actionable diffs.

5 minutes
Intermediate
Developer Tools

Release Notes Generator

Generate release notes, changelogs, and announcement copy from diffs and PR summaries - with upgrade notes and test checklist.

5 minutes
Beginner
Developer Tools

REA: Reverse Engineer Anything

Investigate how a shipped app, binary, or website works, with evidence for every conclusion, using the REA MCP server and a Claude workflow for it

15 minutes
Advanced
Developer Tools

React Native Video (v6 & v7)

Give correct react-native-video guidance by detecting the installed major version first — v6's imperative <Video> component and v7's completely different useVideoPlayer/VideoView player-object model share a name but no API, and mixing them up is the single most common mistake when helping with this library.

5 minutes
Intermediate
Developer Tools

React Three Fiber Animation Reference

Animate React Three Fiber scenes correctly — useFrame fundamentals with render priority, full GLTF animation control via useAnimations (playback, crossfade, event listeners, speed-based blending between Idle/Walk/Run), @react-spring/three physics animations with gesture and chain integration, and the five performance rules that keep per-frame updates from triggering React re-renders.

10 minutes
Intermediate

Browse all Developer Tools playbooks →