Titan AI LogoTitan AI

tiny-llm

3,191
202
Python

Project Description

A course of learning LLM inference serving on Apple Silicon for systems engineers: build a tiny vLLM + Qwen.

Project Information

Created on 4/19/2025
Updated on 9/16/2025