Text Generation
Transformers
Safetensors
English
internlm
custom_code
nielsr HF Staff commited on
Commit
596e9f8
·
verified ·
1 Parent(s): 4606ce8

Add pipeline_tag and library_name + project and github URL + trust_remote_code=True

Browse files

This PR adds the `pipeline_tag` and `library_name` to the model card's metadata, enhancing discoverability and usability. It also includes the project and github URL, and adds `trust_remote_code=True` to the usage example.

Files changed (1) hide show
  1. README.md +8 -4
README.md CHANGED
@@ -1,9 +1,11 @@
1
  ---
2
- license: mit
3
  datasets:
4
  - cerebras/SlimPajama-627B
5
  language:
6
  - en
 
 
 
7
  ---
8
 
9
  # Meta-rater Language Model (3.3B Parameters, 100B Tokens)
@@ -96,8 +98,8 @@ import torch
96
 
97
  # Load model and tokenizer
98
  model_name = "opendatalab/meta-rater-3b-25raters"
99
- tokenizer = AutoTokenizer.from_pretrained(model_name)
100
- model = AutoModelForCausalLM.from_pretrained(model_name)
101
 
102
  # Generate text (optimized for high-quality output)
103
  prompt = "The key principles of sustainable development include"
@@ -188,6 +190,8 @@ If you use this model in your research, please cite:
188
  - **PRRC Rating Models**: Quality assessment models used for data selection
189
  - **Annotated SlimPajama**: Complete dataset with quality scores
190
  - **Random Baselines**: Corresponding baseline models for comparison
 
 
191
 
192
  ## License
193
 
@@ -195,4 +199,4 @@ Please refer to the license terms of the original SlimPajama dataset and follow
195
 
196
  ## Contact
197
 
198
- For questions or issues, please contact the authors or open an issue in the repository.
 
1
  ---
 
2
  datasets:
3
  - cerebras/SlimPajama-627B
4
  language:
5
  - en
6
+ license: mit
7
+ library_name: transformers
8
+ pipeline_tag: text-generation
9
  ---
10
 
11
  # Meta-rater Language Model (3.3B Parameters, 100B Tokens)
 
98
 
99
  # Load model and tokenizer
100
  model_name = "opendatalab/meta-rater-3b-25raters"
101
+ tokenizer = AutoTokenizer.from_pretrained(model_name, trust_remote_code=True)
102
+ model = AutoModelForCausalLM.from_pretrained(model_name, trust_remote_code=True)
103
 
104
  # Generate text (optimized for high-quality output)
105
  prompt = "The key principles of sustainable development include"
 
190
  - **PRRC Rating Models**: Quality assessment models used for data selection
191
  - **Annotated SlimPajama**: Complete dataset with quality scores
192
  - **Random Baselines**: Corresponding baseline models for comparison
193
+ - **Project Page**: [Meta-rater: A Multi-dimensional Data Selection Method for Pre-training Language Models](https://huggingface.co/papers/2504.14194)
194
+ - **Github**: [Meta-rater: A Multi-dimensional Data Selection Method for Pre-training Language Models](https://github.com/opendatalab/Meta-rater)
195
 
196
  ## License
197
 
 
199
 
200
  ## Contact
201
 
202
+ For questions or issues, please contact the authors or open an issue in the repository.