Add Haidass-143M-v1 to the leaderboard

#60

Haidass-143M-v1 is a 143M-parameter bilingual (Chinese-English) language model, based on the Huawei Ascend ecosystem using 100B tokens of Chinese and English data.

We evaluated the model on the tinyllm benchmark using lm-eval-harness, with the following results:

blimp: 79.05
arc_easy: 60.23
wiki-text byte ppl: 1.8892
Additionally, we conducted full-scale testing (5,000 test cases) on ACI-Bench, achieving a score of 55.022.

For full model details, please refer to: https://huggingface.co/DALabCommunity/Haidass-143M-v1

Haidass-143M-V1 是一个 143M 参数的中英双语言模型,在 100B token 的中英文数据上,基于华为昇腾生态进行了全流程训练。
我们是用lm-eval-harness在tinyllm指标上进行了测试,结果如下:

blimp:79.05
arc_easy:60.23
wiki-text byte ppl:1.8892

此外,我们在ACI-Bench上进行了全量(5000 test case)测试,结果为55.022

完整的模型信息可参考https://huggingface.co/DALabCommunity/Haidass-143M-v1

Chillilly88 changed pull request status to closed
Chillilly88 changed pull request status to open
•
This comment has been hidden (marked as Abuse)
Chillilly88 changed pull request status to closed
Chillilly88 changed pull request status to open

Hi @CompactAI . Could you please let me know when the model might be merged into the leaderboard?

GlintResearch org

oh yeah I can merge it now, i was confused because it kept being open/closed and no content was added 😅

CompactAI changed pull request status to merged

Sign up or log in to comment