Titan AI LogoTitan AI

tiny-llm

3,377
226
Python

Project Description

A course of learning LLM inference serving on Apple Silicon for systems engineers: build a tiny vLLM + Qwen.

Project Information

Created on 4/19/2025
Updated on 10/31/2025