Titan AI LogoTitan AI

infini-transformer

294
23
Python

Project Description

PyTorch implementation of Infini-Transformer from "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" (https://arxiv.org/abs/2404.07143)

Project Information

Created on 4/15/2024
Updated on 12/30/2025