Titan AI LogoTitan AI

TurboTransformers

1,531
206
C++

Project Description

a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.

Project Information

Created on 4/20/2020
Updated on 10/5/2025