Titan AI LogoTitan AI

DeepSpeed

39,171
4,448
Python

项目描述

DeepSpeed is a deep learning optimization library designed to simplify distributed training and inference, offering efficiency and effectiveness with features like model parallelism, pipeline parallelism, and zero-redundancy optimization.

Project Information

Created on 1/23/2020
Updated on 7/2/2025

Categories

ai-development-platform
machine-learning-framework
model-compression

Tags

data-processing
development-tools
open-source-community
distributed
research-frontier

Topics

gpu
trillion-parameters
model-parallelism
data-parallelism
machine-learning
compression
inference
deep-learning
zero
pipeline-parallelism
mixture-of-experts
billion-parameters
pytorch