项目描述
The llmstxt-generator is a tool for generating consolidated text files from websites for LLM training and inference. It crawls websites, combines content into a single file, and offers both standard and full versions. It features a web interface and API access without requiring an API key for basic usage.
Project Information
Created on 11/19/2024
Updated on 7/1/2025
Categories
ai-content-generation
text-processing
search-and-retrieval
Tags
development-tools
data-processing
open-source-community
cloud-native
automation