项目描述
The llmstxt-generator is a tool for generating consolidated text files from websites for LLM training and inference. It crawls websites, combines content into a single file, and offers both standard and full versions. It features a web interface and API access without requiring an API key for basic usage.
项目信息
创建于 11/19/2024
更新于 7/1/2025
分类
text-processing
ai-content-generation
search-and-retrieval
标签
development-tools
data-processing
open-source-community
cloud-native
automation