Hermes · YouTube Intel · OCR Run

The page stops being text.

Two June findings from The AI Automators circle the same shift: document AI is moving from parse-to-text toward read-the-pixels. One tames long-doc transcription; one deletes the text step from RAG entirely. Neither is a wholesale "adopt" — both carry a transferable idea.

Channel @TheAIAutomators Videos 2 · OCR-focused Window 2026-06-18 → 06-30 Transcripts auto-caption · 5.7k words Domain rag-n8n
Why both matter to Arsenal

The common enemy is parser loss — flattening a messy page (tables, diagrams, layout) to markdown destroys content before any model reasons over it. Vision-native reading dodges it. The near-term Arsenal win isn't a model swap; it's a fallback path for fetch/RAG when markdown conversion loses the visual.

01

Long-doc transcription

Verdict · Skip the model 2026-06-30

Baidu Unlimited-OCR & the RSWA trick

"Baidu Just Fixed DeepSeek-OCR for Reading Long Documents" · hESwB7Xv-K8

Open-weights ~3B MoE (~0.5B active) fine-tuned on DeepSeek-OCR, claiming dozens of pages in one pass with no slowdown. Presenter built a Claude Code demo, confirmed it works — then argued against adopting it.

The one novel idea — RSWA
  • Reference Sliding Window Attention: every generated word still sees the entire compressed page, but only the last 128 words of its own output.
  • Older text drops from memory → KV-cache stays flat, speed constant regardless of page count.
  • Up to ~35% faster on pages with >6,000 image tokens.
  • DeepSeek-OCR had solved the input (optical compression, ~16× fewer tokens). RSWA tackles the output wall.
Why it's a weak tool
  • Not "unlimited" — hard 32K-token input ceiling; tested to ~40 pages.
  • Not accuracy-leader: 93.9 OmniDocBench, but untested vs Chandra 2, MinerU 2.5 Pro, PaddleOCR-VL, GLM/Mistral OCR.
  • Only carried 2 of DeepSeek's 5 modes; errors came from resolution drop, not the memory mechanism.
  • Chunking already beats it: split pages, process parallel across workers, aggregate — more scalable than sequential single-shot.
Verdict

Clever architecture, wrong production choice. The narrow real win of one-shot is coherence — tables/sentences spanning page breaks don't get sliced. Keep RSWA as prior art for any future long-doc / long-audio transcription; skip the model. Presenter's stack: Docling default → local VLM fallback → Chandra 2 for specialist.

02

Vision-native RAG

Verdict · Evaluate the skill 2026-06-18

PixelRAG — "OCR in reverse"

"The New RAG Method that Sees the Page Instead of Reading It" · 90kPA7DOdRk

Berkeley / Princeton / Databricks. Skips text conversion entirely: screenshot → tile → embed the images → answer with a VLM. No text anywhere in the pipeline. Indexed 7M Wikipedia pages (~30M tiles, >5TB).

The number that lands
  • SimpleQA (1,000 factual Qs): >1/3 of failures = parser loss (HTML→text destroyed content pre-search).
  • >90% of all failures were parser-loss or ranker-miss — the agent caused <10%.
  • Inference: text RAG burned 37.5M prompt tokens vs PixelRAG 3.6M (~a tenth) — but treat new-vs-baseline stats with skepticism.
  • VLM-reading-tiles slightly beat OCR-ing-tiles — dodges parser loss.
The catches
  • Cost moves, doesn't vanish: ingestion = 8× H100 for 2 days; >5TB storage; a vision model on every query.
  • Model floor: below ~4B-param VLMs, pixel-reading loses >12.5 pts accuracy. Crossover ~4B; Opus 4.8 highly capable.
  • Not novel in concept — ColPali (2024) & VisRAG did vision-embed + VLM; differentiator is scale.
  • Real destination = hybrid retrieval (route visual vs text index), not wholesale replacement.
Verdict — the Arsenal artifact

Ships a Claude Code "Pixel Shots" agent skill (3-command install): screenshots a source page via Playwright/Chrome so a multimodal model reads diagrams/tables that web-fetch markdown loses. Demo: web fetch couldn't read a football-formation diagram; the screenshot skill could. Slower than web fetch → fallback only. Directly evaluable for Arsenal's own fetch/parse gaps.

03

Threads across both

OCR is a taxonomy, not a ladder

Traditional OCR (Tesseract/PaddleOCR) · structure-aware parsers (Docling) · VLMs — chosen by document type, not replacing each other.

Parser loss is the hidden failure

Most RAG failures happen at translation + ranking, not reasoning. Measurable, large, and where vision-native reading pays off.

Cost relocates, never vanishes

Pixel methods trade cheap text for expensive ingestion, storage, and per-query vision inference. Dense tiles can still undercut long text.

Hybrid retrieval wins

Give the agent both a visual and a text index and let it route — the pragmatic endpoint both videos land on.

04

Arsenal actions

Carry forward