Titan AI LogoTitan AI

distributed-llama

2,736
193
C++

Project Description

Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.

Project Information

Created on 12/4/2023
Updated on 11/12/2025