Titan AI LogoTitan AI

LLMs-from-scratch

57,811
8,035
Jupyter Notebook

项目描述

LLMs-from-scratch is a PyTorch-based project that provides a step-by-step guide to implementing a ChatGPT-like large language model (LLM) from scratch, including development, pretraining, and finetuning.

项目信息

创建于 7/23/2023
更新于 7/2/2025

分类

conversational-assistant
text-processing
ai-content-generation

标签

development-tools
learning-tutorial
open-source-community
algorithm-model
research-frontier

主题

ai
artificial-intelligence
chatgpt
deep-learning
from-scratch
gpt
language-model
large-language-models
llm
machine-learning
python
pytorch
transformer