ColossalChat

ColossalChat is a free and open-source version of the ChatGPT chatbot alternative by Colossal-AI, whose GitHub project has now earned 26K starred tags.

As today's leading open source large-scale AI modeling solution, Colossal AI is the first to open source a complete RLHF mechanism based on the LLaMA pre-trained model, which includes supervised data collection, supervised fine-tuning, rewarded model training, and reinforcement learning fine-tuning, and shares the ColossalChat- -an open source project very similar to the original ChatGPT technical solution.

The open source project includes the following:

• Demo: an interactive demo that can be tried online without registering or joining a waiting list
• Training code: open source complete RLHF training code, including 7 and 13 billion models.
• Dataset: open source 104K bilingual dataset in English and Chinese.
• Inference: 4-bit quantitative inference for 7 billion parametric models requiring only 4GB of GPU memory.
• Model weighting: fast replication with a small amount of computing power on a single server.