Titan AI LogoTitan AI

ring-attention-pytorch

541
33
Python

Project Description

Implementation of 💍 Ring Attention, from Liu et al. at Berkeley AI, in Pytorch

Project Information

Created on 2/14/2024
Updated on 10/1/2025