Titan AI LogoTitan AI

distributed-llama

2,645
184
C++

Project Description

Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.

Project Information

Created on 12/4/2023
Updated on 9/19/2025