Alibaba Tongyi Qianwen Qwen2 big model released and synchronous open source...

Alibaba Qwen2 big model

DIYuan | 2024-06-07 20:56

【数据猿导读】 Alibaba Tongyi Qianwen Qwen2 big model released and synchronous open source

June 7 news, Alibaba Tongyi Qianwen Qwen2 big model released today, and synchronously open source on Hugging Face and ModelScope. The Qwen2 series includes five sizes of pre-training and instruction fine-tuning models, including the QWEN2-0.5B, QWEN2-1.5B, QWEN2-7B, QWEN2-57B-A14B and QWEN2-72B, which are said to outperform the strongest open source model in the United States, the Llama3-70B; In addition to Chinese and English, 27 language-related data were added to the model training data, which improved the multilingual ability of the model. Context length supports further extension up to 128K tokens.

来源：DIYuan

收藏分享

声明：数据猿尊重媒体行业规范，相关内容都会注明来源与作者；转载我们原创内容时，也请务必注明“来源：数据猿”与作者名称，否则将会受到数据猿追责。