Hugging Face's logo

Fmuaddib
/
Josiefied-Qwen2.5-14B-Instruct-abliterated-v4-mlx-fp16

Text Generation
MLX
Safetensors
English
German
qwen2
chat
mlx-my-repo
conversational
Eval Results (legacy)
Model card Files
xet
 Community
Fmuaddib commited on
Commit
2596667
·
verified ·
1 Parent(s): 1356b21

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +134 -0
README.md ADDED
@@ -0,0 +1,134 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - en
4
+ - de
5
+ license: apache-2.0
6
+ tags:
7
+ - chat
8
+ - mlx
9
+ - mlx-my-repo
10
+ base_model: Goekdeniz-Guelmez/Josiefied-Qwen2.5-14B-Instruct-abliterated-v4
11
+ license_link: https://huggingface.co/Qwen/Qwen2.5-14B-Instruct/blob/main/LICENSE
12
+ pipeline_tag: text-generation
13
+ model-index:
14
+ - name: Josiefied-Qwen2.5-14B-Instruct-abliterated-v4
15
+ results:
16
+ - task:
17
+ type: text-generation
18
+ name: Text Generation
19
+ dataset:
20
+ name: IFEval (0-Shot)
21
+ type: HuggingFaceH4/ifeval
22
+ args:
23
+ num_few_shot: 0
24
+ metrics:
25
+ - type: inst_level_strict_acc and prompt_level_strict_acc
26
+ value: 82.92
27
+ name: strict accuracy
28
+ source:
29
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=Goekdeniz-Guelmez/Josiefied-Qwen2.5-14B-Instruct-abliterated-v4
30
+ name: Open LLM Leaderboard
31
+ - task:
32
+ type: text-generation
33
+ name: Text Generation
34
+ dataset:
35
+ name: BBH (3-Shot)
36
+ type: BBH
37
+ args:
38
+ num_few_shot: 3
39
+ metrics:
40
+ - type: acc_norm
41
+ value: 48.05
42
+ name: normalized accuracy
43
+ source:
44
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=Goekdeniz-Guelmez/Josiefied-Qwen2.5-14B-Instruct-abliterated-v4
45
+ name: Open LLM Leaderboard
46
+ - task:
47
+ type: text-generation
48
+ name: Text Generation
49
+ dataset:
50
+ name: MATH Lvl 5 (4-Shot)
51
+ type: hendrycks/competition_math
52
+ args:
53
+ num_few_shot: 4
54
+ metrics:
55
+ - type: exact_match
56
+ value: 54.23
57
+ name: exact match
58
+ source:
59
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=Goekdeniz-Guelmez/Josiefied-Qwen2.5-14B-Instruct-abliterated-v4
60
+ name: Open LLM Leaderboard
61
+ - task:
62
+ type: text-generation
63
+ name: Text Generation
64
+ dataset:
65
+ name: GPQA (0-shot)
66
+ type: Idavidrein/gpqa
67
+ args:
68
+ num_few_shot: 0
69
+ metrics:
70
+ - type: acc_norm
71
+ value: 12.3
72
+ name: acc_norm
73
+ source:
74
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=Goekdeniz-Guelmez/Josiefied-Qwen2.5-14B-Instruct-abliterated-v4
75
+ name: Open LLM Leaderboard
76
+ - task:
77
+ type: text-generation
78
+ name: Text Generation
79
+ dataset:
80
+ name: MuSR (0-shot)
81
+ type: TAUR-Lab/MuSR
82
+ args:
83
+ num_few_shot: 0
84
+ metrics:
85
+ - type: acc_norm
86
+ value: 13.15
87
+ name: acc_norm
88
+ source:
89
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=Goekdeniz-Guelmez/Josiefied-Qwen2.5-14B-Instruct-abliterated-v4
90
+ name: Open LLM Leaderboard
91
+ - task:
92
+ type: text-generation
93
+ name: Text Generation
94
+ dataset:
95
+ name: MMLU-PRO (5-shot)
96
+ type: TIGER-Lab/MMLU-Pro
97
+ config: main
98
+ split: test
99
+ args:
100
+ num_few_shot: 5
101
+ metrics:
102
+ - type: acc
103
+ value: 44.65
104
+ name: accuracy
105
+ source:
106
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=Goekdeniz-Guelmez/Josiefied-Qwen2.5-14B-Instruct-abliterated-v4
107
+ name: Open LLM Leaderboard
108
+ ---
109
+
110
+ # Fmuaddib/Josiefied-Qwen2.5-14B-Instruct-abliterated-v4-mlx-fp16
111
+
112
+ The Model [Fmuaddib/Josiefied-Qwen2.5-14B-Instruct-abliterated-v4-mlx-fp16](https://huggingface.co/Fmuaddib/Josiefied-Qwen2.5-14B-Instruct-abliterated-v4-mlx-fp16) was converted to MLX format from [Goekdeniz-Guelmez/Josiefied-Qwen2.5-14B-Instruct-abliterated-v4](https://huggingface.co/Goekdeniz-Guelmez/Josiefied-Qwen2.5-14B-Instruct-abliterated-v4) using mlx-lm version **0.22.1**.
113
+
114
+ ## Use with mlx
115
+
116
+ ```bash
117
+ pip install mlx-lm
118
+ ```
119
+
120
+ ```python
121
+ from mlx_lm import load, generate
122
+
123
+ model, tokenizer = load("Fmuaddib/Josiefied-Qwen2.5-14B-Instruct-abliterated-v4-mlx-fp16")
124
+
125
+ prompt="hello"
126
+
127
+ if hasattr(tokenizer, "apply_chat_template") and tokenizer.chat_template is not None:
128
+ messages = [{"role": "user", "content": prompt}]
129
+ prompt = tokenizer.apply_chat_template(
130
+ messages, tokenize=False, add_generation_prompt=True
131
+ )
132
+
133
+ response = generate(model, tokenizer, prompt=prompt, verbose=True)
134
+ ```