StarRing2022 commited on
Commit
831ee37
·
1 Parent(s): 69b320c

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +20 -0
README.md ADDED
@@ -0,0 +1,20 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ 将RWKV模型转化为HF格式,与HF无缝连接,几句代码调用RWKV
2
+ 底座模型:RWKV-4-Raven-3B-v11-Eng49%-Chn49%-Jpn1%-Other1%-20230429-ctx4096.pth(https://huggingface.co/BlinkDL/rwkv-4-raven)
3
+
4
+ import torch
5
+
6
+ from transformers import GPTNeoXTokenizerFast, RwkvConfig, RwkvForCausalLM
7
+
8
+ model = RwkvForCausalLM.from_pretrained("StarRing2022/RWKV-4-Raven-3B-v11-zh")
9
+
10
+ tokenizer = GPTNeoXTokenizerFast.from_pretrained("StarRing2022/RWKV-4-Raven-3B-v11-zh")
11
+
12
+ text = "你好"
13
+
14
+ input_ids = tokenizer.encode(text, return_tensors='pt')
15
+
16
+ out = model.generate(input_ids=input_ids,max_new_tokens=128)
17
+
18
+ answer = tokenizer.decode(out[0])
19
+
20
+ print(answer)