Popular
Join Now

become enlightened

2yrs agorelease 698 0 0

In June 2021, Beijing Zhiyuan Research Institute (...

Collection time:
2023-08-10
悟道become enlightened
悟道

2021年6月,北京智源研究院(BAAI)推出了悟道1.0的后续版本悟道2.0,作为中国第一个超大规模智能模型系统。悟道是一个语言模型,旨在在人类层面的思维上超越 OpenAI 的 GPT-3 和谷歌的 LaMDA。经过4.9TB的图像和文本训练,并在9个基准上超过了最先进(SOTA)水平,悟道比任何同行都更接近于实现通用人工智能(AGI)和人类水平的思维。

悟道接受了4.9 TB高质量英文和中文图像和文本的训练:

  • 1.2TB中文文本数据
  • 2.5TB中文图形数据
  • 1.2TB英文文本数据

悟道是基于开源的 MoE 系统 FastMoE 进行训练的。MoE是一种machine learning技术,其工作原理如下:

将预测建模任务划分为子任务,针对每个子任务训练专家(学习者)模型,开发门控模型,该门控模型基于要预测的输入来学习咨询哪个专家,并组合预测。FastMoE使悟道能够并行咨询不同的专家模型,并切换到预测结果最好的模型。例如,如果输入是英文文本,悟道将使用预测模型,该模型可以在英文文本中生成回应。

shirtAI

data statistics

Data evaluation

become enlightened浏览人数已经达到698,如你需要查询该站的相关权重信息,可以点击"5118 Data""Love Site Data""Chinaz Data"Enter; with the current website data reference, we recommend that you please refer to the love site data, more website value assessment factors such asbecome enlightenedOf course, to evaluate the value of a station, the most important thing is based on your own needs and needs, some of the exact data need to findbecome enlightenedThe webmaster of the site to negotiate to provide. Such as the station's IP, PV, bounce rate, etc.!

Aboutbecome enlightenedSpecial Announcement

This site blue shirt technology to provide thebecome enlightenedAll from the network, does not guarantee the accuracy and completeness of the external links, at the same time, for the external links to point to, not by the Blue Shirt Technology actual control, in August 10, 2023 3:46 pm included in the web page, the content, all belong to the compliance and legal, the contents of the late web page, such as irregularities, you can contact the webmaster directly to remove the Blue Shirt Technology does not assume any responsibility.

Relevant Navigation

GPT元宇宙

No comments

none
No comments...