whereismyai
LLM-Aided OCR
LLM-Aided OCR: This tool enhances Tesseract OCR text output using local or cloud LLMs for error correction and markdown formatting.
The system improves Optical Character Recognition output by passing extracted text through large language models. It converts PDFs to images, runs Tesseract OCR with image preprocessing, and splits the text into overlapping chunks. It then uses local models via llamacpp or cloud APIs from OpenAI and Anthropic to fix errors and optionally format the text in markdown. The tool supports asynchronous processing for API providers, GPU acceleration for local models, and includes quality assessment features. It is built for developers and users who need clean, readable markdown documents from scanned PDFs.
LLM-Aided OCR at a glance
Key features
- Convert PDFs to images
- Extract text using Tesseract
- Correct errors with LLMs
- Format text in markdown
- Split text into smart chunks
- Assess output quality
- Support local and API LLMs
Use it for
- Correct OCR errors in scanned PDFs
- Format scanned documents into markdown
- Process PDFs using local or cloud LLMs
Alternatives to LLM-Aided OCR
- MiniCPM OCR — Efficient document parsing with correctness assessment and high throughput.
- Docling — Provides advanced PDF understanding and local execution for sensitive data.
- Scikit-LLM — LLM text classifiers with the familiar scikit-learn fit and predict API
- MinerU — Parses complex documents and tables into structured markdown for agents.
- LLM CLI — It enables command-line interaction with remote APIs and local machine models.
- MarkItDown — Converts documents into LLM-friendly Markdown for better token efficiency.
- OpenDataLoader PDF — It ranks first in benchmarks for layout and table extraction without needing a GPU.
- Overview — Learn language models by running hands-on experiments without writing scripts
- Soup — Fine-tune and align models like Llama-3.1-8B on a 4 GB laptop GPU.
- RapidOCR — It converts PaddleOCR models to ONNX format for fast inference and deployment.
- PDF Inspector — Detects if a PDF is scanned or text-based to avoid unnecessary OCR costs.
- PaddleOCR — Open-source OCR and document parsing for 100+ languages
All LLM-Aided OCR alternatives