sfafasfafhuu commited on
Commit
b87675d
·
verified ·
1 Parent(s): d282471

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +43 -67
README.md CHANGED
@@ -3,29 +3,28 @@ license: mit
3
  library_name: transformers
4
  ---
5
  # MyAwesomeModel
 
 
 
6
 
7
- <!-- markdownlint-disable first-line-h1 -->
8
- <!-- markdownlint-disable html -->
9
- <!-- markdownlint-disable no-duplicate-header -->
 
10
 
11
- <div align="center">
12
- <img src="figures/fig1.png" width="60%" alt="MyAwesomeModel" />
13
- </div>
14
- <hr>
15
-
16
- <div align="center" style="line-height: 1;">
17
- <a href="LICENSE" style="margin: 2px;">
18
- <img alt="License" src="figures/fig2.png" style="display: inline-block; vertical-align: middle;"/>
19
- </a>
20
- </div>
21
 
22
  ## 1. Introduction
23
 
24
  The MyAwesomeModel has undergone a significant version upgrade. In the latest update, MyAwesomeModel has significantly improved its depth of reasoning and inference capabilities by leveraging increased computational resources and introducing algorithmic optimization mechanisms during post-training. The model has demonstrated outstanding performance across various benchmark evaluations, including mathematics, programming, and general logic. Its overall performance is now approaching that of other leading models.
25
 
26
- <p align="center">
27
- <img width="80%" src="figures/fig3.png">
28
- </p>
29
 
30
  Compared to the previous version, the upgraded model shows significant improvements in handling complex reasoning tasks. For instance, in the AIME 2025 test, the model’s accuracy has increased from 70% in the previous version to 87.5% in the current version. This advancement stems from enhanced thinking depth during the reasoning process: in the AIME test set, the previous model used an average of 12K tokens per question, whereas the new version averages 23K tokens per question.
31
 
@@ -33,54 +32,34 @@ Beyond its improved reasoning capabilities, this version also offers a reduced h
33
 
34
  ## 2. Evaluation Results
35
 
36
- This repository contains the best-performing checkpoint (step_1000) selected from 10 training checkpoints via a comprehensive weighted evaluation across all 15 benchmark categories. The overall weighted score is **0.712**.
37
-
38
- ### Detailed Results for All 15 Benchmarks
39
-
40
- | # | Benchmark | Category | Score |
41
- |---|---|---|---|
42
- | 1 | Math Reasoning | Core Reasoning | 0.550 |
43
- | 2 | Logical Reasoning | Core Reasoning | 0.819 |
44
- | 3 | Common Sense | Core Reasoning | 0.736 |
45
- | 4 | Reading Comprehension | Language Understanding | 0.700 |
46
- | 5 | Question Answering | Language Understanding | 0.607 |
47
- | 6 | Text Classification | Language Understanding | 0.828 |
48
- | 7 | Sentiment Analysis | Language Understanding | 0.792 |
49
- | 8 | Code Generation | Generation | 0.650 |
50
- | 9 | Creative Writing | Generation | 0.610 |
51
- | 10 | Dialogue Generation | Generation | 0.644 |
52
- | 11 | Summarization | Generation | 0.767 |
53
- | 12 | Translation | Specialized | 0.804 |
54
- | 13 | Knowledge Retrieval | Specialized | 0.676 |
55
- | 14 | Instruction Following | Specialized | 0.758 |
56
- | 15 | Safety Evaluation | Specialized | 0.739 |
57
-
58
- ### Comprehensive Benchmark Comparison
59
 
60
  | | Benchmark | Model1 | Model2 | Model1-v2 | MyAwesomeModel |
61
  |---|---|---|---|---|---|
62
- | **Core Reasoning Tasks** | Math Reasoning | 0.510 | 0.535 | 0.521 | 0.550 |
63
- | | Logical Reasoning | 0.789 | 0.801 | 0.810 | 0.819 |
64
- | | Common Sense | 0.716 | 0.702 | 0.725 | 0.736 |
65
- | **Language Understanding** | Reading Comprehension | 0.671 | 0.685 | 0.690 | 0.700 |
66
- | | Question Answering | 0.582 | 0.599 | 0.601 | 0.607 |
67
- | | Text Classification | 0.803 | 0.811 | 0.820 | 0.828 |
68
- | | Sentiment Analysis | 0.777 | 0.781 | 0.790 | 0.792 |
69
- | **Generation Tasks** | Code Generation | 0.615 | 0.631 | 0.640 | 0.650 |
70
- | | Creative Writing | 0.588 | 0.579 | 0.601 | 0.610 |
71
- | | Dialogue Generation | 0.621 | 0.635 | 0.639 | 0.644 |
72
- | | Summarization | 0.745 | 0.755 | 0.760 | 0.767 |
73
- | **Specialized Capabilities** | Translation | 0.782 | 0.799 | 0.801 | 0.804 |
74
- | | Knowledge Retrieval | 0.651 | 0.668 | 0.670 | 0.676 |
75
- | | Instruction Following | 0.733 | 0.749 | 0.751 | 0.758 |
76
- | | Safety Evaluation | 0.718 | 0.701 | 0.725 | 0.739 |
 
 
77
 
78
  ### Overall Performance Summary
 
79
 
80
- The MyAwesomeModel demonstrates strong performance across all 15 evaluated benchmark categories, with the highest scores in **Text Classification (0.828)**, **Logical Reasoning (0.819)**, and **Translation (0.804)**. The overall weighted score of **0.712** reflects consistent strength across reasoning, language understanding, generation, and specialized capabilities.
81
-
82
- ## 3. Chat Website & API Platform
83
-
84
  We offer a chat interface and API for you to interact with MyAwesomeModel. Please check our official website for more details.
85
 
86
  ## 4. How to Run Locally
@@ -95,7 +74,6 @@ Compared to previous versions, the usage recommendations for MyAwesomeModel have
95
  The model architecture of MyAwesomeModel-Small is identical to its base model, but it shares the same tokenizer configuration as the main MyAwesomeModel. This model can be run in the same manner as its base model.
96
 
97
  ### System Prompt
98
-
99
  We recommend using the following system prompt with a specific date.
100
  ```
101
  You are MyAwesomeModel, a helpful AI assistant.
@@ -107,11 +85,9 @@ You are MyAwesomeModel, a helpful AI assistant.
107
  Today is May 28, 2025, Monday.
108
  ```
109
  ### Temperature
110
-
111
- We recommend setting the temperature parameter $T_{model}$ to 0.6.
112
 
113
  ### Prompts for File Uploading and Web Search
114
-
115
  For file uploading, please follow the template to create prompts, where {file_name}, {file_content} and {question} are arguments.
116
  ```
117
  file_template = \
@@ -126,13 +102,14 @@ For web search enhanced generation, we recommend the following prompt template w
126
  search_answer_en_template = \
127
  '''# The following contents are the search results related to the user's message:
128
  {search_results}
129
- In the search results I provide to you, each result is formatted as [webpage X begin]...[webpage X end], where X represents the numerical index of each article. Please cite the context at the end of the relevant sentence when appropriate. Use the citation format [citation:X] in the corresponding part of your answer. If a sentence is derived from multiple contexts, list all relevant citation numbers, such as [citation:3][citation:5]. Be sure not to cluster all citations at the end; instead, include them in the corresponding parts of the answer. When responding, please keep the following points in mind:
 
130
  - Today is {cur_date}.
131
  - Not all content in the search results is closely related to the user's question. You need to evaluate and filter the search results based on the question.
132
  - For listing-type questions (e.g., listing all flight information), try to limit the answer to 10 key points and inform the user that they can refer to the search sources for complete information. Prioritize providing the most complete and relevant items in the list. Avoid mentioning content not provided in the search results unless necessary.
133
- - For creative tasks (e.g., writing an essay), ensure references are cited within the body of the text, such as [citation:3][citation:5], rather than only at the end of the text. You need to interpret and summarize the user's requirements, choose an appropriate format, fully utilize search results, extract key information, and generate an answer that is insightful, creative, and professional. Extend the length of your response as much as possible, addressing each point in detail and from multiple perspectives, ensuring the content is rich and thorough.
134
  - If the response is lengthy, structure it well and summarize it in paragraphs. If a point-by-point format is needed, try to limit it to 5 points and merge related content.
135
- - For objective Q&A, if the answer is very brief, you may add one or two related sentences to enrich the content.
136
  - Choose an appropriate and visually appealing format for your response based on the user's requirements and the content of the answer, ensuring strong readability.
137
  - Your answer should synthesize information from multiple relevant webpages and avoid repeatedly citing the same webpage.
138
  - Unless the user requests otherwise, your response should be in the same language as the user's question.
@@ -141,9 +118,8 @@ In the search results I provide to you, each result is formatted as [webpage X b
141
  ```
142
 
143
  ## 5. License
144
-
145
  This code repository is licensed under the [MIT License](LICENSE). The use of MyAwesomeModel models is also subject to the [MIT License](LICENSE). The model series supports commercial use and distillation.
146
 
147
  ## 6. Contact
148
-
149
  If you have any questions, please raise an issue on our GitHub repository or contact us at contact@MyAwesomeModel.ai.
 
 
3
  library_name: transformers
4
  ---
5
  # MyAwesomeModel
6
+ <!-- markdownlint-disable first-line-h1 -->
7
+ <!-- markdownlint-disable html -->
8
+ <!-- markdownlint-disable no-duplicate-header -->
9
 
10
+ <div align="center">
11
+ <img src="figures/fig1.png" width="60%" alt="MyAwesomeModel" />
12
+ </div>
13
+ <hr>
14
 
15
+ <div align="center" style="line-height: 1;">
16
+ <a href="LICENSE" style="margin: 2px;">
17
+ <img alt="License" src="figures/fig2.png" style="display: inline-block; vertical-align: middle;"/>
18
+ </a>
19
+ </div>
 
 
 
 
 
20
 
21
  ## 1. Introduction
22
 
23
  The MyAwesomeModel has undergone a significant version upgrade. In the latest update, MyAwesomeModel has significantly improved its depth of reasoning and inference capabilities by leveraging increased computational resources and introducing algorithmic optimization mechanisms during post-training. The model has demonstrated outstanding performance across various benchmark evaluations, including mathematics, programming, and general logic. Its overall performance is now approaching that of other leading models.
24
 
25
+ <p align="center">
26
+ <img width="80%" src="figures/fig3.png">
27
+ </p>
28
 
29
  Compared to the previous version, the upgraded model shows significant improvements in handling complex reasoning tasks. For instance, in the AIME 2025 test, the model’s accuracy has increased from 70% in the previous version to 87.5% in the current version. This advancement stems from enhanced thinking depth during the reasoning process: in the AIME test set, the previous model used an average of 12K tokens per question, whereas the new version averages 23K tokens per question.
30
 
 
32
 
33
  ## 2. Evaluation Results
34
 
35
+ ### Comprehensive Benchmark Results
36
+
37
+ <div align="center">
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
38
 
39
  | | Benchmark | Model1 | Model2 | Model1-v2 | MyAwesomeModel |
40
  |---|---|---|---|---|---|
41
+ | **Core Reasoning Tasks** | Math Reasoning | 0.510 | 0.535 | 0.521 | {RESULT} |
42
+ | | Logical Reasoning | 0.789 | 0.801 | 0.810 | {RESULT} |
43
+ | | Common Sense | 0.716 | 0.702 | 0.725 | {RESULT} |
44
+ | **Language Understanding** | Reading Comprehension | 0.671 | 0.685 | 0.690 | {RESULT} |
45
+ | | Question Answering | 0.582 | 0.599 | 0.601 | {RESULT} |
46
+ | | Text Classification | 0.803 | 0.811 | 0.820 | {RESULT} |
47
+ | | Sentiment Analysis | 0.777 | 0.781 | 0.790 | {RESULT} |
48
+ | **Generation Tasks** | Code Generation | 0.615 | 0.631 | 0.640 | {RESULT} |
49
+ | | Creative Writing | 0.588 | 0.579 | 0.601 | {RESULT} |
50
+ | | Dialogue Generation | 0.621 | 0.635 | 0.639 | {RESULT} |
51
+ | | Summarization | 0.745 | 0.755 | 0.760 | {RESULT} |
52
+ | **Specialized Capabilities**| Translation | 0.782 | 0.799 | 0.801 | {RESULT} |
53
+ | | Knowledge Retrieval | 0.651 | 0.668 | 0.670 | {RESULT} |
54
+ | | Instruction Following | 0.733 | 0.749 | 0.751 | {RESULT} |
55
+ | | Safety Evaluation | 0.718 | 0.701 | 0.725 | {RESULT} |
56
+
57
+ </div>
58
 
59
  ### Overall Performance Summary
60
+ The MyAwesomeModel demonstrates strong performance across all evaluated benchmark categories, with particularly notable results in reasoning and generation tasks.
61
 
62
+ ## 3. Chat Website & API Platform
 
 
 
63
  We offer a chat interface and API for you to interact with MyAwesomeModel. Please check our official website for more details.
64
 
65
  ## 4. How to Run Locally
 
74
  The model architecture of MyAwesomeModel-Small is identical to its base model, but it shares the same tokenizer configuration as the main MyAwesomeModel. This model can be run in the same manner as its base model.
75
 
76
  ### System Prompt
 
77
  We recommend using the following system prompt with a specific date.
78
  ```
79
  You are MyAwesomeModel, a helpful AI assistant.
 
85
  Today is May 28, 2025, Monday.
86
  ```
87
  ### Temperature
88
+ We recommend setting the temperature parameter $T_{model}$ to 0.6.
 
89
 
90
  ### Prompts for File Uploading and Web Search
 
91
  For file uploading, please follow the template to create prompts, where {file_name}, {file_content} and {question} are arguments.
92
  ```
93
  file_template = \
 
102
  search_answer_en_template = \
103
  '''# The following contents are the search results related to the user's message:
104
  {search_results}
105
+ In the search results I provide to you, each result is formatted as [webpage X begin]...[webpage X end], where X represents the numerical index of each article. Please cite the context at the end of the relevant sentence when appropriate. Use the citation format [citation:X] in the corresponding part of your answer. If a sentence is derived from multiple contexts, list all relevant citation numbers, such as [citation:3][citation:5]. Be sure not to cluster all citations at the end; instead, include them in the corresponding parts of the answer.
106
+ When responding, please keep the following points in mind:
107
  - Today is {cur_date}.
108
  - Not all content in the search results is closely related to the user's question. You need to evaluate and filter the search results based on the question.
109
  - For listing-type questions (e.g., listing all flight information), try to limit the answer to 10 key points and inform the user that they can refer to the search sources for complete information. Prioritize providing the most complete and relevant items in the list. Avoid mentioning content not provided in the search results unless necessary.
110
+ - For creative tasks (e.g., writing an essay), ensure that references are cited within the body of the text, such as [citation:3][citation:5], rather than only at the end of the text. You need to interpret and summarize the user's requirements, choose an appropriate format, fully utilize the search results, extract key information, and generate an answer that is insightful, creative, and professional. Extend the length of your response as much as possible, addressing each point in detail and from multiple perspectives, ensuring the content is rich and thorough.
111
  - If the response is lengthy, structure it well and summarize it in paragraphs. If a point-by-point format is needed, try to limit it to 5 points and merge related content.
112
+ - For objective Q&A, if the answer is very brief, you may add one or two related sentences to enrich the content.
113
  - Choose an appropriate and visually appealing format for your response based on the user's requirements and the content of the answer, ensuring strong readability.
114
  - Your answer should synthesize information from multiple relevant webpages and avoid repeatedly citing the same webpage.
115
  - Unless the user requests otherwise, your response should be in the same language as the user's question.
 
118
  ```
119
 
120
  ## 5. License
 
121
  This code repository is licensed under the [MIT License](LICENSE). The use of MyAwesomeModel models is also subject to the [MIT License](LICENSE). The model series supports commercial use and distillation.
122
 
123
  ## 6. Contact
 
124
  If you have any questions, please raise an issue on our GitHub repository or contact us at contact@MyAwesomeModel.ai.
125
+ ```