Skip to content

pipelines.md

Latest commit

 

History

History
336 lines (251 loc) · 17 KB

pipelines.md

File metadata and controls

336 lines (251 loc) · 17 KB
Raw

Available Pipelines

All pipelines can be run with:

uv run parse-bench run <pipeline_name>

To see the full list:

uv run parse-bench pipelines

Setup

Copy .env.example to .env and fill in the API keys / endpoints for the providers you want to use:

cp .env.example .env

Cloud API Pipelines

These pipelines use hosted APIs. You only need an API key in your .env file.

Bold pipelines are baselines evaluated in the ParseBench paper. The name used in the paper is shown in parentheses.

LlamaParse

Pipeline Description Env Var
llamaparse_agentic Agentic tier (In paper: LlamaParse Agentic) LLAMA_CLOUD_API_KEY
llamaparse_cost_effective Cost-effective tier (In paper: LlamaParse Cost Effective) LLAMA_CLOUD_API_KEY
llamaparse_agentic_plus Agentic plus tier LLAMA_CLOUD_API_KEY

OpenAI

Pipeline Description Env Var
openai_gpt5_mini_reasoning_medium_parse GPT-5 Mini, medium reasoning, image mode OPENAI_API_KEY
openai_gpt5_mini_reasoning_medium_parse_file GPT-5 Mini, medium reasoning, PDF file mode OPENAI_API_KEY
openai_gpt5_mini_reasoning_minimal_parse GPT-5 Mini, minimal reasoning OPENAI_API_KEY
openai_gpt5_mini_reasoning_minimal_parse_file GPT-5 Mini, minimal reasoning, file mode OPENAI_API_KEY
openai_gpt5_mini_reasoning_medium_parse_with_layout GPT-5 Mini, medium reasoning + layout OPENAI_API_KEY
openai_gpt5_mini_reasoning_medium_parse_with_layout_file GPT-5 Mini, medium reasoning + layout, file (In paper: OpenAI GPT-5 Mini (Reasoning Medium)) OPENAI_API_KEY
openai_gpt5_mini_reasoning_minimal_parse_with_layout GPT-5 Mini, minimal reasoning + layout OPENAI_API_KEY
openai_gpt5_mini_reasoning_minimal_parse_with_layout_file GPT-5 Mini, minimal reasoning + layout, file (In paper: OpenAI GPT-5 Mini (Reasoning Minimal)) OPENAI_API_KEY
openai_gpt_5_4_parse GPT-5.4, image mode OPENAI_API_KEY
openai_gpt_5_4_parse_file GPT-5.4, PDF file mode OPENAI_API_KEY
openai_gpt_5_4_parse_with_layout_file GPT-5.4, parse + layout, file mode (In paper: OpenAI GPT-5.4) OPENAI_API_KEY

Anthropic Claude

Pipeline Description Env Var
anthropic_haiku_parse Claude Haiku 4.5, image mode ANTHROPIC_API_KEY
anthropic_haiku_parse_file Claude Haiku 4.5, PDF file mode ANTHROPIC_API_KEY
anthropic_haiku_parse_with_layout Claude Haiku 4.5, parse + layout ANTHROPIC_API_KEY
anthropic_haiku_parse_with_layout_file Claude Haiku 4.5, parse + layout, file mode (In paper: Anthropic Haiku 4.5 (Disable Thinking)) ANTHROPIC_API_KEY
anthropic_haiku_thinking_parse_with_layout_file Claude Haiku 4.5, extended thinking + layout (In paper: Anthropic Haiku 4.5 (Thinking)) ANTHROPIC_API_KEY
anthropic_opus_4_6_parse Claude Opus 4.6, image mode ANTHROPIC_API_KEY
anthropic_opus_4_6_parse_file Claude Opus 4.6, PDF file mode ANTHROPIC_API_KEY
anthropic_opus_4_6_parse_with_layout_file Claude Opus 4.6, parse + layout, file mode (In paper: Anthropic Opus 4.6) ANTHROPIC_API_KEY
anthropic_opus_4_8_parse_with_layout_file Claude Opus 4.8, parse + layout, file mode (In paper: Anthropic Opus 4.8) ANTHROPIC_API_KEY
anthropic_sonnet_5_parse_with_layout_file Claude Sonnet 5, adaptive thinking + layout, file mode ANTHROPIC_API_KEY
anthropic_fable_5_parse_with_layout_file Claude Fable 5, parse + layout, file mode ANTHROPIC_API_KEY
anthropic_fable_5_1_parse_with_layout_file Claude Fable 5.1, parse + layout, file mode ANTHROPIC_API_KEY

Google Gemini

Pipeline Description Env Var
google_gemini_3_flash_lite_parse Gemini 3 Flash Lite, image mode GOOGLE_GEMINI_API_KEY
google_gemini_3_flash_lite_parse_file Gemini 3 Flash Lite, file mode GOOGLE_GEMINI_API_KEY
google_gemini_3_flash_thinking_minimal_parse Gemini 3 Flash, minimal thinking GOOGLE_GEMINI_API_KEY
google_gemini_3_flash_thinking_minimal_parse_file Gemini 3 Flash, minimal thinking, file GOOGLE_GEMINI_API_KEY
google_gemini_3_flash_thinking_high_parse Gemini 3 Flash, high thinking GOOGLE_GEMINI_API_KEY
google_gemini_3_flash_thinking_high_parse_file Gemini 3 Flash, high thinking, file GOOGLE_GEMINI_API_KEY
google_gemini_3_flash_thinking_minimal_parse_with_layout Gemini 3 Flash, minimal thinking + layout GOOGLE_GEMINI_API_KEY
google_gemini_3_flash_thinking_high_parse_with_layout Gemini 3 Flash, high thinking + layout GOOGLE_GEMINI_API_KEY
google_gemini_3_flash_thinking_minimal_parse_with_layout_file Gemini 3 Flash, minimal thinking + layout file (In paper: Google Gemini 3 Flash (Thinking Minimal)) GOOGLE_GEMINI_API_KEY
google_gemini_3_flash_thinking_high_parse_with_layout_file Gemini 3 Flash, high thinking + layout file (In paper: Google Gemini 3 Flash (Thinking High)) GOOGLE_GEMINI_API_KEY
google_gemini_3_flash_thinking_minimal_parse_with_layout_agentic_vision Agentic vision, minimal thinking GOOGLE_GEMINI_API_KEY
google_gemini_3_flash_thinking_medium_parse_with_layout_agentic_vision Agentic vision, medium thinking GOOGLE_GEMINI_API_KEY
google_gemini_3_flash_thinking_high_parse_with_layout_agentic_vision Agentic vision, high thinking GOOGLE_GEMINI_API_KEY
google_gemini_3_1_flash_lite_parse Gemini 3.1 Flash Lite GOOGLE_GEMINI_API_KEY
google_gemini_3_1_flash_lite_thinking_high_parse Gemini 3.1 Flash Lite, high thinking GOOGLE_GEMINI_API_KEY
google_gemini_3_1_pro_parse Gemini 3.1 Pro, default thinking GOOGLE_GEMINI_API_KEY
google_gemini_3_1_pro_parse_with_layout_file Gemini 3.1 Pro, parse + layout, file mode (In paper: Google Gemini 3.1 Pro) GOOGLE_GEMINI_API_KEY
google_gemini_3_5_flash_parse_with_layout Gemini 3.5 Flash, default thinking + layout GOOGLE_GEMINI_API_KEY
google_gemini_3_5_flash_no_thinking_parse_with_layout Gemini 3.5 Flash, minimal thinking + layout GOOGLE_GEMINI_API_KEY
google_gemini_3_5_flash_parse_with_layout_file Gemini 3.5 Flash, default thinking + layout, file mode (In paper: Google Gemini 3.5 Flash (Thinking Medium)) GOOGLE_GEMINI_API_KEY
google_gemini_3_5_flash_no_thinking_parse_with_layout_file Gemini 3.5 Flash, minimal thinking + layout, file mode (In paper: Google Gemini 3.5 Flash (Thinking Minimal)) GOOGLE_GEMINI_API_KEY
google_gemini_3_5_flash_lite_parse_with_layout_file Gemini 3.5 Flash Lite, layout + file mode (In paper: Google Gemini 3.5 Flash Lite) GOOGLE_GEMINI_API_KEY
google_gemini_3_6_flash_parse_with_layout_file Gemini 3.6 Flash, default thinking + layout, file mode (In paper: Google Gemini 3.6 Flash (Thinking Medium)) GOOGLE_GEMINI_API_KEY
google_gemini_3_6_flash_no_thinking_parse_with_layout_file Gemini 3.6 Flash, minimal thinking + layout, file mode (In paper: Google Gemini 3.6 Flash (Thinking Minimal)) GOOGLE_GEMINI_API_KEY

GLM (z.ai)

Pipeline Description Env Var
glm_5_3_flash_parse_with_layout_file GLM-5.3 Flash, parse + layout, file mode GLM_ZAI_API_KEY

Azure Document Intelligence

Pipeline Description Env Vars
azure_di_layout Layout model (In paper: Azure Document Intelligence) AZURE_DOCUMENT_INTELLIGENCE_KEY, AZURE_DOCUMENT_INTELLIGENCE_ENDPOINT
azure_di_read Read model AZURE_DOCUMENT_INTELLIGENCE_KEY, AZURE_DOCUMENT_INTELLIGENCE_ENDPOINT

AWS Textract

Pipeline Description Env Vars
aws_textract Standard Textract (In paper: AWS Textract) AWS_ACCESS_KEY_ID, AWS_SECRET_ACCESS_KEY
aws_textract_with_forms Textract with forms AWS_ACCESS_KEY_ID, AWS_SECRET_ACCESS_KEY
aws_textract_text_only Textract text only AWS_ACCESS_KEY_ID, AWS_SECRET_ACCESS_KEY

Google Document AI

Pipeline Description Env Vars
google_docai Document AI OCR GOOGLE_DOCAI_PROJECT_ID, GOOGLE_DOCAI_PROCESSOR_ID
google_docai_layout Document AI Layout (In paper: Google Cloud Document AI) GOOGLE_DOCAI_PROJECT_ID, GOOGLE_DOCAI_LAYOUT_PROCESSOR_ID

Reducto

Pipeline Description Env Var
reducto Default Reducto (In paper: Reducto) REDUCTO_API_KEY
reducto_agentic Agentic mode (In paper: Reducto (Agentic)) REDUCTO_API_KEY
reducto_r1 r-1 model, settings.model="r-1" (In paper: Reducto (r-1)) REDUCTO_API_KEY

Pulse

Pipeline Description Env Var
pulse Default model with native markdown output, /tables reconstruction on every document, no refinement PULSE_API_KEY
pulse_ultra_2 pulse-ultra-2 hosted tier with native markdown output, refinement enabled, and inline formatting preserved PULSE_API_KEY

Chunkr

Pipeline Description Env Var
chunkr Default quality CHUNKR_API_KEY
chunkr_high_res High resolution CHUNKR_API_KEY

Datalab (Marker)

Pipeline Description Env Var
datalab_fast Fast mode DATALAB_API_KEY
datalab_balanced Balanced mode DATALAB_API_KEY
datalab_accurate Accurate mode DATALAB_API_KEY

Extend AI

Pipeline Description Env Var
extend_parse Default (In paper: Extend) EXTEND_API_KEY
extend_parse_2 2.0 engine (v2.0.0, GA) EXTEND_API_KEY
extend_parse_light Light engine (v1.0.0) EXTEND_API_KEY
extend_parse_document Document scope EXTEND_API_KEY
extend_parse_section Section scope EXTEND_API_KEY

Landing AI

Pipeline Description Env Var
landingai_parse Default (In paper: LandingAI) LANDING_AI_API_KEY

Unstructured

Pipeline Description Env Var
unstructured_auto Auto strategy UNSTRUCTURED_API_KEY
unstructured_fast Fast strategy UNSTRUCTURED_API_KEY
unstructured_hi_res Hi-res strategy UNSTRUCTURED_API_KEY

OpenInnovation Parser (oi-parser)

Hosted document-parsing API. Sign up at oi-parser.ai to get an API key.

Pipeline Description Env Vars
oi_parser oi-parser hosted /v1/extract API OI_PARSER_API_KEY, OI_PARSER_BASE_URL (optional)

Self-hosted Model Pipelines

These pipelines require you to deploy the model on your own infrastructure (e.g., via vLLM, Modal, etc.) and set the endpoint URL in .env.

Gemma 4

Pipeline Description Env Var
gemma4_26b_vllm Gemma 4 26B-A4B, parse mode GEMMA4_SERVER_URL
gemma4_26b_vllm_with_layout Gemma 4 26B-A4B, layout mode GEMMA4_SERVER_URL
gemma4_e4b_vllm Gemma 4 E4B (dense 8B), parse mode GEMMA4_SERVER_URL
gemma4_e4b_vllm_with_layout Gemma 4 E4B, layout mode GEMMA4_SERVER_URL

Qwen

Pipeline Description Env Var
qwen3_5_4b_vllm_parse Parse mode, markdown (In paper: Qwen 3 VL) QWEN35_SERVER_URL
qwen3_5_4b_vllm_layout Layout mode, JSON with bboxes (In paper: Qwen 3 VL) QWEN35_SERVER_URL
qwen3_8_27b_parse_with_layout Qwen3.8-27B-FP8, parse + layout QWEN3_8_27B_SERVER_URL
qwen3_8_27b_thinking_parse_with_layout Qwen3.8-27B-FP8, parse + layout with thinking QWEN3_8_27B_SERVER_URL

Chandra OCR 2

Pipeline Description Env Var
chandra2_vllm OpenAI-compatible vLLM API CHANDRA2_SERVER_URL
chandra2_sdk Official SDK endpoint CHANDRA2_SERVER_URL

DeepSeek-OCR-2

Pipeline Description Env Var
deepseekocr2_vllm With grounding layout detection DEEPSEEKOCR2_SERVER_URL
deepseekocr2_freeocr Free OCR, no grounding DEEPSEEKOCR2_SERVER_URL

Granite Vision

Pipeline Description Env Var
granite_vision_pipeline PP-DocLayout + per-region Granite Vision GRANITE_VISION_SERVER_URL
granite_vision_4_1_4b Granite Vision 4.1 4B (vLLM, multi-task) VLLM_API_KEY

PaddleOCR-VL

Pipeline Description Env Var
paddleocr_vl_vllm OpenAI-compatible vLLM API PADDLEOCR_SERVER_URL
paddleocr_vl_pipeline Full pipeline (layout + chart routing) PADDLEOCR_SERVER_URL
paddleocr_vl_1_6_vllm PaddleOCR-VL-1.6, OCR prompt PADDLEOCR_SERVER_URL
paddleocr_vl_1_6_vllm_table PaddleOCR-VL-1.6, table recognition prompt PADDLEOCR_SERVER_URL
paddleocr_vl_1_6_pipeline PaddleOCR-VL-1.6, full pipeline (layout + routing) PADDLEOCR_SERVER_URL

dots.ocr

Pipeline Description Env Var
dots_ocr_1_0_parse dots.ocr 1.0 DOTS_OCR_ENDPOINT_URL
dots_ocr_1_5_parse dots.ocr 1.5, layout+text prompt (In paper: Dots OCR 1.5) DOTS_OCR_ENDPOINT_URL

Docling

Pipeline Description Env Vars
docling_parse Docling HTTP endpoint (In paper: Docling) DOCLING_PARSE_ENDPOINT_URL, DOCLING_PARSE_API_KEY (optional)
docling_serve Docling Serve HTTP endpoint DOCLING_SERVE_ENDPOINT_URL, DOCLING_SERVE_API_KEY (optional)

MinerU 2.5

Pipeline Description Env Var
mineru25_vllm MinerU2.5-2509-1.2B vLLM server (two-step layout + recognition) MINERU25_SERVER_URL
mineru2605pro_vllm MinerU2.5-Pro-2605-1.2B vLLM server (adds chart/image analysis) MINERU2605PRO_SERVER_URL

MinerU-Diffusion

Pipeline Description Env Var
mineru_diffusion MinerU-Diffusion-V1-0320-2.5B server (diffusion-decoding OCR, two-stage layout + recognition) MINERU_DIFFUSION_SERVER_URL

Nemotron-Omni

Pipeline Description Env Var
nemotron_omni_30b_vllm_thinking Nemotron-3-Nano-Omni 30B-A3B Reasoning, thinking enabled NEMOTRON_OMNI_SERVER_URL

Surya OCR 2

Pipeline Description Env Var
surya2_sdk Surya OCR 2 SDK server (full-page OCR + layout) SURYA2_SERVER_URL

florin-parser-nano

Fine-tune of KDL-Frontier-Parser-nano (florin-inc/florin-parser-nano); served identically to the base model and driven by the same two-stage pipeline, with markdown-emission fixes (see the provider module docstring for the exact vllm serve command).

Pipeline Description Env Var
florin_parser_nano vLLM OpenAI-compatible endpoint (layout + per-region recognition) FLORIN_NANO_ENDPOINT_URL

rakedoc-nano

Fine-tune of florin-parser-nano (cloudraker/rakedoc-nano); served identically to the parent models and driven by the same two-stage pipeline and markdown emission (see the provider module docstring for the exact vllm serve command).

Pipeline Description Env Var
rakedoc_nano vLLM OpenAI-compatible endpoint (layout + per-region recognition) RAKEDOC_NANO_ENDPOINT_URL

Local Pipelines (No API key needed)

These run entirely locally and do not require API keys.

Pipeline Description Requirements
pypdf_baseline PyPDF text extraction None
pymupdf_text PyMuPDF text extraction None
pymupdf_html PyMuPDF HTML extraction None
pymupdf4llm_markdown PyMuPDF4LLM Markdown with native HTML tables and RapidOCR at 150 DPI Python 3.12, pymupdf4llm==1.28.2, and rapidocr==3.9.2
warp_ingest Warp-Ingest local parser warp-ingest[ocr]>=2.0.1 installed
tesseract_eng Tesseract OCR (English) tesseract installed
tesseract_fast Tesseract OCR (fast) tesseract installed
tesseract_high_quality Tesseract OCR (high quality) tesseract installed
infinity_parser2_flash Infinity-Parser2-Flash (vLLM server, JSON layout) infinity_parser2, running vLLM server
infinity_parser2_pro Infinity-Parser2-Pro (vLLM server, JSON layout) infinity_parser2, running vLLM server

Create the isolated Python environment for pymupdf4llm_markdown with uv sync --python 3.12 --extra pymupdf4llm, then run it with uv run --python 3.12 --extra pymupdf4llm parse-bench run pymupdf4llm_markdown --max_concurrent 1.

Layout Detection Pipelines

Pipeline Description Requirements
docling_layout_heron Docling Heron layout Self-hosted endpoint
docling_layout_heron_101 Docling Heron 1.0.1 Self-hosted endpoint
docling_layout_old Docling legacy layout Self-hosted endpoint
ppdoclayout_plus_l PaddleDetection layout Self-hosted endpoint
qwen3vl_layout Qwen3-VL layout Self-hosted endpoint
surya_layout Surya layout detection surya installed
yolo_doclaynet YOLO DocLayNet Self-hosted endpoint