Titan AI LogoTitan AI

LLMs-from-scratch

57,811
8,035
Jupyter Notebook

项目描述

LLMs-from-scratch is a PyTorch-based project that provides a step-by-step guide to implementing a ChatGPT-like large language model (LLM) from scratch, including development, pretraining, and finetuning.

Project Information

Created on 7/23/2023
Updated on 7/2/2025

Categories

ai-content-generation
conversational-assistant
text-processing

Tags

development-tools
learning-tutorial
open-source-community
algorithm-model
research-frontier

Topics

transformer
python
large-language-models
machine-learning
ai
language-model
from-scratch
deep-learning
chatgpt
gpt
pytorch
artificial-intelligence
llm