Project Title

tianshou — An Elegant PyTorch Deep Reinforcement Learning Library

Overview

Tianshou is a PyTorch-based deep reinforcement learning library designed for both researchers and practitioners. It offers a modular, flexible, and type-safe framework for implementing and training reinforcement learning algorithms. What sets Tianshou apart is its elegant design, high performance, and user-friendly interfaces, supporting a wide range of RL algorithms and applications.

Key Features

Modular low-level interfaces for algorithm developers
Convenient high-level interfaces for RL applications
Supports online (on- and off-policy) and offline RL, multi-agent RL, and model-based algorithms

Use Cases

Researchers and developers implementing and testing various reinforcement learning algorithms
Training deep reinforcement learning agents on custom environments
Exploring and implementing advanced RL techniques like multi-agent and model-based RL

Advantages

High-performance, modularized framework for building deep RL agents
User-friendly interfaces for both algorithm development and application
Supports a broad scope of RL, including online, offline, and multi-agent RL

Limitations / Considerations

Version 2 is not backwards compatible with previous versions, requiring migration for existing users
As an actively developed library, some features may be experimental or in beta

PyTorch: A popular deep learning framework that Tianshou is built upon, offering a more general machine learning toolkit.
Gymnasium: A library for developing and comparing reinforcement learning algorithms, which Tianshou uses for environment management.
Stable Baselines3: A set of improved implementations of reinforcement learning algorithms based on Deep Learning, offering a different set of algorithms and a focus on stability.

Basic Information

GitHub: https://github.com/thu-ml/tianshou
Stars: 8,813
License: Unknown
Last Commit: 2025-10-01

📊 Project Information

Project Name: tianshou
GitHub URL: https://github.com/thu-ml/tianshou
Programming Language: Python
⭐ Stars: 8,813
🍴 Forks: 1,182
📅 Created: 2018-04-16
🔄 Last Updated: 2025-10-01

🏷️ Project Topics

Topics: [, ", a, 2, c, ", ,, , ", a, t, a, r, i, ", ,, , ", b, c, q, ", ,, , ", c, q, l, ", ,, , ", d, d, p, g, ", ,, , ", d, o, u, b, l, e, -, d, q, n, ", ,, , ", d, q, n, ", ,, , ", d, r, l, ", ,, , ", i, m, i, t, a, t, i, o, n, -, l, e, a, r, n, i, n, g, ", ,, , ", m, u, j, o, c, o, ", ,, , ", n, p, g, ", ,, , ", p, o, l, i, c, y, -, g, r, a, d, i, e, n, t, ", ,, , ", p, p, o, ", ,, , ", p, y, t, o, r, c, h, ", ,, , ", r, l, ", ,, , ", s, a, c, ", ,, , ", t, d, 3, ", ,, , ", t, r, a, n, s, f, e, r, l, a, b, ", ,, , ", t, r, p, o, ", ]