Titan AI LogoTitan AI

Megatron-DeepSpeed

1,424
228
Python

Project Description

Ongoing research training transformer language models at scale, including: BERT & GPT-2

Project Information

Created on 7/2/2021
Updated on 10/31/2025