Skill

blessonism/openclaw-search-skills434

mineru-extract

Use the official MinerU (mineru.net) parsing API to convert a URL (HTML pages like WeChat articles, or direct PDF/Office/image links) into clean Markdown + structured outputs. Use when web_fetch/browser can’t access or extracts messy content, and you want higher-fidelity parsing (layout/table/formula/OCR).

Copy install command View source

Quick install

Copy first, validate next

$npx clawhub@latest install mineru-extract

GitHub

Download SKILL.md or inspect the source before installing.

Step 1

Copy the install command

Copy the command or download SKILL.md, then add it to your AI coding environment.

Step 2

Check source and behavior

Open the source repo and confirm the skill behavior, scope, and fit for the task.

Step 3

Overview

# MinerU Extract (official API)

Use MinerU as an upstream “content normalizer”: submit a URL to MinerU, poll for completion, download the result zip, and extract the main Markdown.

Quick start (MCP-aligned)

We align to the **MinerU MCP** mental model, but we do **not** run an MCP server.

Primary script (MCP-style): `scripts/mineru_parse_documents.py`
Input: `--file-sources` (comma/newline-separated)
Output: **JSON contract** on stdout: `{ ok, items, errors }`
Low-level script (single URL): `scripts/mineru_extract.py`

Auth:

Set `MINERU_TOKEN` (Bearer token from mineru.net)

Default model heuristic:

URLs ending with `.pdf/.doc/.ppt/.png/.jpg` → `pipeline`
Otherwise → `MinerU-HTML` (best for HTML pages like WeChat articles)

1) Configure token (skill-local)

Put secrets in **skill root** `.env` (do not paste into chat outputs):

```bash

# In the mineru-extract skill directory: .env

MINERU_TOKEN=your_token_here

MINERU_API_BASE=https://mineru.net

```

2) Parse URL(s) → Markdown (recommended)

MCP-style wrapper (returns JSON, optionally includes markdown text):

Validate with a real task

Run one small real task before keeping it in your long-term workflow.

```bash

python3 mineru-extract/scripts/mineru_parse_documents.py \

--file-sources "<URL1>\n<URL2>" \

--language ch \

--enable-ocr \

--model-version MinerU-HTML

```

If you want the markdown content inline in the JSON (can be large):

```bash

python3 mineru-extract/scripts/mineru_parse_documents.py \

--file-sources "<URL>" \

--model-version MinerU-HTML \

--emit-markdown --max-chars 20000

```

Low-level (single URL, print markdown to stdout):

```bash

python3 mineru-extract/scripts/mineru_extract.py "<URL>" --model MinerU-HTML --print > /tmp/out.md

```

Output

The script always downloads + extracts the MinerU result zip to:

`~/.openclaw/workspace/mineru/<task_id>/`

It writes:

`result.zip`
extracted files (Markdown + JSON + assets)

It prints a JSON summary to **stderr** with paths:

`task_id`, `full_zip_url`, `out_dir`, `markdown_path`

Parameters (common)

`--model`: `pipeline | vlm | MinerU-HTML` (HTML requires `MinerU-HTML`)
`--ocr/--no-ocr`: enable OCR (effective for `pipeline`/`vlm`)
`--table/--no-table`: table recognition
`--formula/--no-formula`: formula recognition
`--language ch|en|...`
`--page-ranges "2,4-6"` (non-HTML)
`--timeout 600` / `--poll-interval 2`

Failure modes & fallbacks

MinerU may fail to fetch some URLs (anti-bot / geo / login).
Fallback: provide an HTML file or a PDF/long screenshot; then implement “upload + parse” flow with MinerU batch upload endpoints.
Always report the failing URL + MinerU `err_msg` and keep an original-source link in outputs.

References

MinerU API docs: https://mineru.net/apiManage/docs
MinerU output files: https://opendatalab.github.io/MinerU/reference/output_files/

Browse skill packs

If you are not sure what to pair with it, start from a workflow collection.

Continue

Read the install guide

Understand install, validation, and troubleshooting before adding more skills.

Continue

Explore more skills

Return to the community skill list and search adjacent capabilities.

Continue

content-extract

Robust URL-to-Markdown extraction for OpenClaw workflows. Use when the user wants to "extract/summarize/convert a webpage to markdown" (especially WeChat mp.weixin.qq.com) and web_fetch/browser is blocked or messy. Uses a cheap probe via web_fetch first, then falls back to the official MinerU API (via the local mineru-extract skill) and returns a traceable result contract with source links.

search-layer

DEFAULT search tool for ALL search/lookup needs. Multi-source search and deduplication layer with intent-aware scoring. Integrates Brave Search (web_search), Exa, Tavily, and Grok to provide high-coverage, high-quality results. Automatically classifies query intent and adjusts search strategy, scoring weights, and result synthesis. Use for ANY query that requires web search — factual lookups, research, news, comparisons, resource finding, "what is X", status checks, etc. Do NOT use raw web_search directly; always route through this skill.