GitHub - pymupdf/pymupdf4llm: PyMuPDF4LLM (original) (raw)

PyMuPDF

pymupdf%2FPyMuPDF | Trendshift

Docs PyPI Version PyPI - Python Version License AGPL PyPI Downloads Github Stars Discord Forum Twitter Hugging Face Demo

Turn PDF and other documents into clean, LLM-ready data — in one line of code. No GPU, no Cloud, no Tokens required.

PyMuPDF4LLM is a lightweight extension for PyMuPDF that converts documents into structured Markdown, JSON, and plain text optimised for RAG pipelines, vector embeddings, and LLM ingestion. It handles multi-column layouts, tables, images, headers, and scanned pages with automatic OCR — all powered by the MuPDF C engine.

import pymupdf4llm

md = pymupdf4llm.to_markdown("research-paper.pdf")

Feed directly into your LLM, vector store, or chunker

Star on GitHub

Demo


Why PyMuPDF4LLM?


Installation

This automatically installs or upgrades PyMuPDF & PyMuPDF Layout as a dependency.

Optional: Office document support (PyMuPDF Pro)

Extend support to Word, Excel, PowerPoint, and HWP/HWPX by pairing with PyMuPDF Pro:


Quick start

Markdown output

import pymupdf4llm

md = pymupdf4llm.to_markdown("document.pdf") print(md)

JSON output

import pymupdf4llm

data = pymupdf4llm.to_json("document.pdf")

Returns bounding box info, layout data, and text per element

print(data)

Plain text output

import pymupdf4llm

text = pymupdf4llm.to_text("document.pdf") print(text)

Save to file

import pymupdf4llm from pathlib import Path

md = pymupdf4llm.to_markdown("document.pdf") Path("output.md").write_bytes(md.encode())


Features

Output formats

Format API Best for
Markdown to_markdown(path) LLM prompts, RAG pipelines, vector embeddings
JSON to_json(path) Custom pipelines needing bbox + layout metadata
Plain text to_text(path) Search indexing, simple NLP tasks
LlamaIndex docs LlamaMarkdownReader().load_data(path) Direct LlamaIndex integration

Extraction capabilities

Feature Description
Layout analysis Reconstructs natural reading order across single and multi-column pages
Table detection Finds and converts tables to GitHub-compatible Markdown
Header detection Maps font sizes to # heading levels; custom header detection via IdentifyHeaders or TocHeaders is available in legacy mode after pymupdf4llm.use_layout(False)
Inline formatting Detects and preserves bold, italic, monospace, and code blocks
Image extraction Extracts embedded images and inlines references in Markdown output
Vector graphics Detects and includes references to vector graphic elements
Page chunking With page_chunks=True in layout mode, returns chunk dicts containing metadata, toc_items, page_boxes, and text
Hybrid OCR Automatically OCRs only image-covered or illegible regions; skips clean digital text.
Header / footer removal Configurable exclusion of repetitive page headers and footers
Selective pages Process a subset of pages via the pages parameter
TOC-driven headers Use the document's table of contents to derive heading hierarchy

Hybrid OCR Strategy

PyMuPDF4LLM applies OCR selectively — only where it is actually needed. Rather than blindly sending every page through an OCR engine (slow and counterproductive on clean text), or naively skipping OCR on mixed documents (leaving scanned regions unreadable), it analyses each page first and makes a targeted decision. This selective approach typically reduces OCR processing time by around 50%.

How it works

Before a page is processed, PyMuPDF4LLM analyzes its content to decide whether OCR should be used to unlock the full content. There are four conditions that can lead to OCR the page:

  1. Too many illegible characters (�)
  2. Presence of (many) vector graphics that simulate text
  3. Presence of a previous OCR text layer. This condition can be deselected which accepts a previous OCR and will not execute OCR again for the page.
  4. Presence of images containing text.

The result of all four paths is merged into a single, seamless output. There is no distinction in the Markdown between pages extracted natively and pages recovered via OCR.

Why it matters

OCR is roughly 1,000× slower than native text extraction. Applying it indiscriminately to a large document is expensive, and applying full-page OCR on top of already-readable text can actually degrade output quality by introducing recognition errors. The hybrid approach avoids both problems:

OCR triggers

Two situations cause OCR to be invoked automatically:

  1. No text at all — the page is image-covered with no selectable content. PyMuPDF4LLM also checks image quality heuristics to distinguish a scanned text page from a photograph, avoiding wasted OCR effort on pages that contain no readable text regardless.
  2. Garbled text — the page has a text layer, but too many characters are unreadable. Only the broken spans are targeted, not the full page.

Configuration

The default behaviour requires no configuration — just install Tesseract and it works:

import pymupdf4llm

OCR is triggered automatically wherever needed

md = pymupdf4llm.to_markdown("mixed-document.pdf")

For cases where you need more control:

Force OCR on every page (e.g. known-corrupt text layer)

md = pymupdf4llm.to_markdown("document.pdf", force_ocr=True)

Force OCR on specific pages only

md = pymupdf4llm.to_markdown("document.pdf", pages=[2, 3, 4], force_ocr=True)

Disable OCR entirely (pages with no text will return empty strings)

md = pymupdf4llm.to_markdown("document.pdf", use_ocr=False)

Set OCR resolution (default 300 dpi; higher values cost quadratically more)

md = pymupdf4llm.to_markdown("document.pdf", ocr_dpi=150)

Specify OCR language

md = pymupdf4llm.to_markdown("document.pdf", ocr_language="eng+fra")

Bring your own OCR function

md = pymupdf4llm.to_markdown("document.pdf", ocr_function=my_ocr_fn)

Note: force_ocr=True on a clean, text-based PDF will slow processing significantly and may reduce output quality. Use it only when you have reason to distrust the native text layer.

OCR engine selection

PyMuPDF4LLM automatically selects the best available OCR engine at runtime — no manual configuration needed. It supports Tesseract (via PyMuPDF's built-in integration) and rapidocr_onnxruntime, choosing whichever is installed. If neither is available, the default behavior is to disable OCR and emit a warning. If OCR is explicitly required (for example, force_ocr=True / ALWAYS mode), an exception is raised with installation instructions.

Find out more with the full PyMuPDF4LLM OCR documentation

Framework integrations

Framework Method
LlamaIndex pymupdf4llm.LlamaMarkdownReader().load_data("doc.pdf")
LangChain from langchain_community.document_loaders import PyMuPDFLoader
LangChain + chunking MarkdownTextSplitter on to_markdown() output

Usage examples

Page chunking for RAG

import pymupdf4llm

chunks = pymupdf4llm.to_markdown("document.pdf", page_chunks=True)

for chunk in chunks: print(chunk["metadata"]["page_number"]) # page number print(chunk["metadata"]["title"]) # document title print(chunk["text"]) # markdown text for this page print(chunk["metadata"]["page_boxes"]) # page layout boxes for this page

Each chunk contains full document metadata alongside the page content — ready to insert into a vector store.

LlamaIndex integration

import pymupdf4llm

reader = pymupdf4llm.LlamaMarkdownReader() docs = reader.load_data("document.pdf")

docs is a list of LlamaIndex Document objects

for doc in docs: print(doc.text)

LangChain integration

from langchain_community.document_loaders import PyMuPDFLoader from langchain.text_splitter import MarkdownTextSplitter import pymupdf4llm

Option A — via LangChain loader

loader = PyMuPDFLoader("document.pdf") pages = loader.load()

Option B — via to_markdown + splitter

md = pymupdf4llm.to_markdown("document.pdf") splitter = MarkdownTextSplitter(chunk_size=500, chunk_overlap=50) chunks = splitter.create_documents([md])

Extract specific pages

import pymupdf4llm

Only extract pages 0, 1, and 5

md = pymupdf4llm.to_markdown("document.pdf", pages=[0, 1, 5])

Extract images alongside text

import pymupdf4llm

md = pymupdf4llm.to_markdown( "document.pdf", write_images=True, # save extracted images to disk image_path="./images", # directory for saved images image_format="png", # output format dpi=150, # image resolution )

Custom header detection

Note, this is only available when Layout Mode is False.

import pymupdf import pymupdf4llm

pymupdf4llm.use_layout(False)

doc = pymupdf.open("document.pdf")

Automatic: scan font sizes to determine heading levels

headers = pymupdf4llm.IdentifyHeaders(doc, max_levels=3) md = pymupdf4llm.to_markdown(doc, hdr_info=headers)

TOC-driven: use the document's table of contents

toc_headers = pymupdf4llm.TocHeaders(doc) md = pymupdf4llm.to_markdown(doc, hdr_info=toc_headers)

Custom callable: full control over heading logic

def my_headers(span, page=None): if span["size"] > 16: return "# " elif span["size"] > 12: return "## " return ""

md = pymupdf4llm.to_markdown(doc, hdr_info=my_headers)

Automatic OCR for scanned documents

import pymupdf4llm

OCR is triggered automatically for pages with no selectable text.

No configuration needed — just install Tesseract language packs as required.

md = pymupdf4llm.to_markdown("scanned-report.pdf")


Output format reference

Markdown (to_markdown)

GitHub-compatible Markdown with:

JSON (to_json)

Structured output containing bounding box coordinates, layout element types, font metadata, and text content for every detected element on each page — useful for building custom rendering or retrieval pipelines.

Page chunks (with page_chunks=True)

Each page is returned as a dict:

{ "metadata": { "format": "PDF 1.7", "title": "...", "author": "...", "page": 3, "page_count": 42, "file_path": "document.pdf", # ... }, "toc_items": [[2, "Section Title", 3], ...], "text": "## Section Title\n\nBody text...", "tables": [...], "images": [...], "graphics": [...], }


Supported document formats

Format Notes
PDF Full support including scanned pages (via OCR)
XPS / OXPS Text and image extraction
EPUB / MOBI / FB2 Chapter-aware extraction
Images (PNG, JPG, TIFF…) Single-page extraction with optional OCR
Office (DOCX, XLSX, PPTX, HWP) Requires PyMuPDF Pro

Performance

PyMuPDF4LLM is built on MuPDF — a best-in-class C rendering engine — and requires no GPU. Compared to vision-based LLM extraction:


Recipes

Index a document into a vector store (Chroma)

import pymupdf4llm import chromadb from chromadb.utils.embedding_functions import SentenceTransformerEmbeddingFunction

chunks = pymupdf4llm.to_markdown("document.pdf", page_chunks=True)

client = chromadb.Client() collection = client.create_collection( "docs", embedding_function=SentenceTransformerEmbeddingFunction(), )

collection.add( documents=[c["text"] for c in chunks], metadatas=[c["metadata"] for c in chunks], ids=[f"page-{c['metadata']['page']}" for c in chunks], )

Process multiple documents in a loop

import pymupdf4llm from pathlib import Path

docs_dir = Path("./documents") all_chunks = []

for pdf in docs_dir.glob("*.pdf"): chunks = pymupdf4llm.to_markdown(str(pdf), page_chunks=True) all_chunks.extend(chunks)

print(f"Total chunks: {len(all_chunks)}")

Pass a PyMuPDF Document object directly

import pymupdf import pymupdf4llm

doc = pymupdf.open("document.pdf")

Pre-process pages however you like, then extract

md = pymupdf4llm.to_markdown(doc)

OCR options

Force OCR on every page (e.g. known-corrupt text layer)

md = pymupdf4llm.to_markdown("document.pdf", force_ocr=True)

Force OCR on specific pages only

md = pymupdf4llm.to_markdown("document.pdf", pages=[2, 3, 4], force_ocr=True)

Disable OCR entirely (pages with no text will return empty strings)

md = pymupdf4llm.to_markdown("document.pdf", use_ocr=False)

Set OCR resolution (default 300 dpi; higher values cost quadratically more)

md = pymupdf4llm.to_markdown("document.pdf", ocr_dpi=150)

Specify OCR language

md = pymupdf4llm.to_markdown("document.pdf", ocr_language="eng+fra")

Bring your own OCR function

md = pymupdf4llm.to_markdown("document.pdf", ocr_function=my_ocr_fn)


Documentation

Full API reference, guides, and examples at pymupdf.readthedocs.io/en/latest/pymupdf4llm.


Project Description
PyMuPDF The core library — low-level PDF manipulation, rendering, annotation
PyMuPDF Pro Adds Office and HWP document support
pymupdf-fonts Extended font collection for PyMuPDF text output

Licensing

PyMuPDF and MuPDF are maintained by Artifex Software, Inc.


Contributing

Contributions are welcome. Please open an issue before submitting large pull requests.

⭐ Support this project

If you find this useful, please consider giving it a star — it helps others discover it!

Star on GitHub