llmstxt.new

llmstxt.new is a web tool that generates consolidated text files from websites for LLM training and inference.

Llmstxt.new generates consolidated text files from websites for LLM training and inference. The tool is powered by Firecrawl and allows users to enter a URL and a Firecrawl API key to produce llms-full.txt files. Users can also call the service via an API. The repository for creating these files is available on GitHub via mendableai/create-llmstxt-py. The service is designed for developers who need to prepare website content for large language models.

llmstxt.new at a glance

Best for: Software engineer, Marketer
Runs on: Web, API
Pricing: Free
Released: March 2025
Category: AI coding tool
Website: llmstxt.new

Key features

Generate llms-full.txt files from URLs
Powered by Firecrawl integration
API access available
Open source Python repository support

Use it for

Prepare website content for LLM training
Generate context files for LLM inference
Convert website data into consolidated text via API

Alternatives to llmstxt.new

MLX LM — Runs LLMs and fine-tuning natively on Apple silicon hardware.
LLM CLI — It enables command-line interaction with remote APIs and local machine models.
LMQL — It enables modularized, constraint-based prompting with portable code.
LangChain4j — Integrates LLMs and vector stores directly into Java applications.
LightLLM — It delivers high-speed inference and serving performance for large language models.
llmware — Build private, local RAG pipelines with 300+ prepackaged models and integrated document parsing.
LMDeploy — Accelerates inference with high-performance engines and quantization tools.
llm-d — Deploys production-grade LLM serving on existing hardware clusters.
MLC LLM — Enables native optimization and deployment of AI models across platforms.
llmspy.org — Self-host access to 530+ AI models across 24 providers with built-in tools.
LitGPT — Readable single-file LLM code with tested finetuning recipes
WebLLM — Runs high-performance language models directly inside web browsers.

All llmstxt.new alternatives