Titan AI LogoTitan AI

distributed-llama

2,775
201
C++

Project Description

Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.

Project Information

Created on 12/4/2023
Updated on 1/1/2026