Project Title

new-api — AI Model Aggregation and Distribution System for Unified API Access

Overview

new-api is an AI model aggregation and distribution system that enables unified access to various large models such as OpenAI, Claude, and Gemini. It is designed for personal or enterprise internal management and distribution channels, built on top of One API. This next-generation LLM gateway and AI asset management system supports multiple languages and is tailored for efficient model management and access.

Key Features

Unified API access for multiple large models
Multi-language support
Online payment integration for ease of use
Key-based usage tracking and management
Database compatibility with the original One API
Model usage charging by instance
Channel weighting and randomization for load balancing
Data dashboard for monitoring and control
Token grouping and model access restrictions
Support for various authentication methods including LinuxDO, Telegram, and OIDC
Rerank model support with Cohere and Jina
Real-time API support for OpenAI and Azure channels
Format conversion between OpenAI Chat Completions, Claude Messages, and Gemini Chat
Model-specific reasoning effort settings
User-based model rate limiting
Request format conversion functionality
Cache-based billing support with adjustable rates

Use Cases

Enterprises needing to manage and distribute access to multiple AI models internally
Developers requiring a unified interface to interact with various AI models
Service providers offering AI model access to their clients through a single platform

Advantages

Simplifies management of multiple AI models through a single interface
Enhances operational efficiency with features like online payments and usage tracking
Provides flexibility in model access and usage with token grouping and rate limiting

Limitations / Considerations

The project is stated to be for personal learning use and does not guarantee stability or offer technical support
Users must comply with OpenAI's terms of use and local regulations, including not using the service for illegal purposes
It is advised not to provide unregistered generative AI services to the public in China

One API: The base project on which new-api is built, offering a foundational structure for API management.
Hugging Face's Transformers: A library for state-of-the-art models, differing in that it focuses on model deployment rather than aggregation and distribution.
OpenAI API: A direct API service for AI models, where new-api acts as an aggregator for such services.

Basic Information

GitHub: https://github.com/QuantumNous/new-api
Stars: 10,776
License: Unknown
Last Commit: 2025-09-23

📊 Project Information

Project Name: new-api
GitHub URL: https://github.com/QuantumNous/new-api
Programming Language: JavaScript
⭐ Stars: 10,776
🍴 Forks: 2,091
📅 Created: 2023-11-10
🔄 Last Updated: 2025-09-23

🏷️ Project Topics

Topics: [, ", a, i, -, g, a, t, e, w, a, y, ", ,, , ", c, l, a, u, d, e, ", ,, , ", d, e, e, p, s, e, e, k, ", ,, , ", g, e, m, i, n, i, ", ,, , ", o, p, e, n, a, i, ", ,, , ", r, e, r, a, n, k, ", ]

📚 Documentation

This article is automatically generated by AI based on GitHub project information and README content analysis

new-api

Project Description