skills: update skills

skills/chinese-text-normalize/SKILL.md

@@ -34,6 +34,49 @@ The script handles three file patterns:
 - Inline page numbers (standalone 1-2 digit lines)
 - Trailing blank lines
 
+## Beyond the script: bold fragments, conjoined paragraphs, encoding
+
+The script handles simple fixed-width body text. Some PDF→markdown conversions produce more complex artifacts that need manual multi-pass Python scripts via `execute_code`:
+
+### Bold marker fragmentation
+
+`**...text...**` blocks split across blank lines with stray `**` at fragment boundaries:
+
+```
+**第三条 特色——依据五大要素，构建次第修学。营造良好氛围，提供有效**
+
+引导。
+```
+
+**Fix**: Join fragments, remove stray `**` from join point, add closing `**` to final result. See `references/bold-fragments.md` for full pattern catalog and multi-pass workflow.
+
+**Critical pitfall**: Do NOT join lines where BOTH the first and second line are complete bold blocks (start+end with `**`). These are separate entries, not fragments:
+```
+**第一条 ...之道。**    ← complete bold item
+                        ← blank line
+**第二条 ...合一。**    ← complete bold item (DON'T JOIN)
+```
+
+### Conjoined paragraphs
+
+Separate paragraphs/sections merged into one line — opposite problem to the script. Common in song lyrics, dense instructional sections. Requires semantic splitting. See `references/bold-fragments.md`.
+
+### Encoding artifacts
+
+`川` (U+5DDD) replacing `"` (curly quote) — search-and-replace: `" 道理川` → `"道理"`, `" 自己的川` → `"自己的"`.
+
+### Multi-pass approach
+
+1. **Pass 1**: Join word fragments split by blank lines (conservative — only when current line doesn't end with `。！？` or is NOT a complete bold block)
+2. **Pass 2**: Split obviously conjoined paragraphs (manual string replacements for known patterns)
+3. **Pass 3**: Fix stray bold markers, encoding artifacts, stray page numbers
+4. Verify after each pass; revert with `git checkout` if over-aggressive
+
+### Heuristic pitfalls
+
+- **Short-line join** (< 15 chars): Over-joins section headers with body, Q&A pairs (`正念是什么？\n\n就是...`). Only use for clear word-fragment continuations.
+- **Bold-end join**: Lines ending with `**` are ambiguous — either broken bold fragment or complete bold item. Check if the content before `**` forms a complete sentence (ends with `。`).
+
 ## Pitfalls
 
 - **TOC detection boundaries**: The vertical TOC end is detected by finding the first line with 3+ CJK characters. If a page number like "2" sits between TOC and body, it lands in the TOC section — harmless but visible.

skills/chinese-text-normalize/references/bold-fragments.md

@@ -0,0 +1,110 @@
+# Bold fragments & conjoined paragraphs — fix patterns
+
+From session fixing `静心学堂学员手册.md` (1575→1478 lines, ~100 fixes).
+
+## Pattern A: Bold marker fragmentation
+
+**Problem**: `**...text...**` block split across blank line with stray `**` markers:
+
+```
+**第三条 特色——依据五大要素，构建次第修学。营造良好氛围，提供有效**
+
+引导。
+```
+
+**Detection**: Line ends with `**`, next non-blank line continues the sentence (does NOT start with `**`).
+
+**Fix** (Python):
+```python
+# curr ends with **, nxt is continuation (no leading **)
+curr_fixed = curr.rstrip()[:-2].rstrip()  # strip trailing **
+nxt_fixed = nxt.lstrip()
+if nxt_fixed.endswith('**'):
+    nxt_fixed = nxt_fixed[:-2].rstrip()
+    joined = curr_fixed + nxt_fixed + '**'
+else:
+    joined = curr_fixed + nxt_fixed  # lost closing ** — may need manual fix
+```
+
+### Anti-pattern: Complete bold items
+
+Do NOT join when BOTH lines are complete bold blocks (start+end with `**`):
+
+```
+**第一条 ...之道。**    ← DON'T JOIN
+                        ← blank line
+**第二条 ...合一。**    ← DON'T JOIN
+```
+
+**Detection**: Both `curr` and `nxt` start with `**` and end with `**`.
+
+## Pattern B: Conjoined paragraphs (Type 2)
+
+Separate sections merged into one line. Common cases:
+
+### Section headers merged with body
+```
+导言：这本指引怎么用这本指引是什么这是一本修学地图...
+```
+→ Split into:
+```
+导言：这本指引怎么用
+
+这本指引是什么
+
+这是一本修学地图...
+```
+
+### Song titles merged mid-lyrics
+```
+...生生世世不再久违《菩提花开》如果你渴求一滴水...
+```
+→ Split into:
+```
+...生生世世不再久违
+
+### 《菩提花开》
+
+如果你渴求一滴水...
+```
+
+### List items merged into one line
+```
+不在班级群发布...不从事违法活动不在班级平台拉拢...
+```
+→ Split into bullet list:
+```
+- 不在班级群发布...
+- 不从事违法活动
+- 不在班级平台拉拢...
+```
+
+**Approach**: Manual string replacements for known patterns. Regex is unreliable for semantic splits.
+
+## Pattern C: Stray page numbers
+
+Standalone digits at line ends, often from PDF page number artifacts:
+- `42`, `43`, `46`, `47` at end of content lines
+
+**Fix**: Strip trailing digits that aren't part of dates, durations, or course numbers.
+
+## Pattern D: Encoding artifacts
+
+`川` (U+5DDD) replacing curly quotes `"` (U+201C/U+201D):
+```
+把" 道理川变成" 自己的川    →    把"道理"变成"自己的"
+```
+
+**Fix**: Replace `" 道理川` → `"道理"`, `" 自己的川` → `"自己的"`.
+
+## Multi-pass workflow
+
+1. **Pass 1 — Join word fragments**: Scan for lines split by blank line where first line doesn't end with `。！？` and neither line is structural (header/list/table). Skip complete bold items.
+2. **Pass 2 — Split conjoined**: Apply known string replacements for merged sections, song transitions, list items.
+3. **Pass 3 — Clean artifacts**: Fix stray `**` markers, encoding issues, stray page numbers.
+4. **Verify**: `git diff` after each pass; `git checkout` if over-aggressive.
+
+## Rejected heuristics
+
+- **Short-line join** (< 15 chars): Over-joins section headers (`中级和高级（以后的事）`) with body, and Q&A pairs (`正念是什么？\n\n就是...`). Only use for clear mid-word fragments.
+- **Blind `**` stripping**: Removes valid bold formatting from complete bold items.