mertcobanov commited on
Commit
1e4aa8b
·
verified ·
1 Parent(s): 1af5ebe

Ollaya package for Mapika/decider-4b

Browse files
Files changed (4) hide show
  1. 4b/calibration.json +9 -0
  2. 4b/decision.json +601 -0
  3. 4b/model-fp32.onnx +3 -0
  4. README.md +5 -3
4b/calibration.json ADDED
@@ -0,0 +1,9 @@
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "temperature": [
3
+ 1.11,
4
+ 1.0,
5
+ 1.56
6
+ ],
7
+ "temperature_by_options": {},
8
+ "source": "decider_config.json temperature_by_type (choice, noul; fitted upstream by NLL per answer type); score is 1.0 because the isolated-row temperature is applied inside the score option logits"
9
+ }
4b/decision.json ADDED
@@ -0,0 +1,601 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "engine": "onnx",
3
+ "family": "decider",
4
+ "layout": "decider-slots-v1",
5
+ "upstream": {
6
+ "repo": "Mapika/decider-4b",
7
+ "revision": "eb5fbdfc9448473ec25e399882912863afbdb70e",
8
+ "version": "4b-v2.1",
9
+ "base": "Qwen/Qwen3.5-4B-Base",
10
+ "code": "decider/ in the model repo (inference subset of github.com/Mapika/decider)"
11
+ },
12
+ "contract": {
13
+ "inputs": {
14
+ "input_ids": {
15
+ "dtype": "int64",
16
+ "shape": [
17
+ "rows",
18
+ "seq"
19
+ ],
20
+ "note": "one row per scoring row; seq a multiple of 64; right-pad with any id (pad_id)"
21
+ },
22
+ "slot_pos": {
23
+ "dtype": "int64",
24
+ "shape": [
25
+ "rows"
26
+ ],
27
+ "note": "position of the row's answer-slot token"
28
+ }
29
+ },
30
+ "outputs": {
31
+ "label_logits": {
32
+ "dtype": "float32",
33
+ "shape": [
34
+ "rows",
35
+ 255
36
+ ],
37
+ "note": "logits of labels[j] as the next token after the slot; use the first k"
38
+ }
39
+ },
40
+ "seq_multiple": 64,
41
+ "positions": "0..seq-1, implicit",
42
+ "attention": "causal; no mask input (right padding cannot reach earlier positions)"
43
+ },
44
+ "max_ctx_tokens": 32768,
45
+ "max_options": 255,
46
+ "min_options": 2,
47
+ "max_levels": 10,
48
+ "isolated_levels": true,
49
+ "isolated_row_temperature": 1.287,
50
+ "neutralize_none": false,
51
+ "independent_rows": true,
52
+ "index_arrays_min_len": 8,
53
+ "special_tokens": {
54
+ "pad": 248044,
55
+ "bos": null,
56
+ "add_special_tokens": false
57
+ },
58
+ "labels": {
59
+ "narrow": 10,
60
+ "strings": [
61
+ "A",
62
+ "B",
63
+ "C",
64
+ "D",
65
+ "E",
66
+ "F",
67
+ "G",
68
+ "H",
69
+ "I",
70
+ "J",
71
+ "K",
72
+ "L",
73
+ "M",
74
+ "N",
75
+ "O",
76
+ "P",
77
+ "Q",
78
+ "R",
79
+ "S",
80
+ "T",
81
+ "U",
82
+ "V",
83
+ "W",
84
+ "X",
85
+ "Y",
86
+ "Z",
87
+ "AA",
88
+ "AB",
89
+ "AC",
90
+ "AD",
91
+ "AE",
92
+ "AF",
93
+ "AG",
94
+ "AH",
95
+ "AI",
96
+ "AJ",
97
+ "AK",
98
+ "AL",
99
+ "AM",
100
+ "AN",
101
+ "AO",
102
+ "AP",
103
+ "AQ",
104
+ "AR",
105
+ "AS",
106
+ "AT",
107
+ "AU",
108
+ "AV",
109
+ "AW",
110
+ "AX",
111
+ "AY",
112
+ "AZ",
113
+ "BA",
114
+ "BB",
115
+ "BC",
116
+ "BD",
117
+ "BE",
118
+ "BF",
119
+ "BG",
120
+ "BH",
121
+ "BI",
122
+ "BJ",
123
+ "BK",
124
+ "BL",
125
+ "BM",
126
+ "BN",
127
+ "BO",
128
+ "BP",
129
+ "BR",
130
+ "BS",
131
+ "BT",
132
+ "BU",
133
+ "BV",
134
+ "BW",
135
+ "BX",
136
+ "BY",
137
+ "CA",
138
+ "CB",
139
+ "CC",
140
+ "CD",
141
+ "CE",
142
+ "CF",
143
+ "CG",
144
+ "CH",
145
+ "CI",
146
+ "CK",
147
+ "CL",
148
+ "CM",
149
+ "CN",
150
+ "CO",
151
+ "CP",
152
+ "CR",
153
+ "CS",
154
+ "CT",
155
+ "CU",
156
+ "CV",
157
+ "CW",
158
+ "CX",
159
+ "CY",
160
+ "DA",
161
+ "DB",
162
+ "DC",
163
+ "DD",
164
+ "DE",
165
+ "DF",
166
+ "DG",
167
+ "DH",
168
+ "DI",
169
+ "DJ",
170
+ "DK",
171
+ "DL",
172
+ "DM",
173
+ "DN",
174
+ "DO",
175
+ "DP",
176
+ "DR",
177
+ "DS",
178
+ "DT",
179
+ "DU",
180
+ "DV",
181
+ "DW",
182
+ "DX",
183
+ "DY",
184
+ "EA",
185
+ "EB",
186
+ "EC",
187
+ "ED",
188
+ "EE",
189
+ "EF",
190
+ "EG",
191
+ "EH",
192
+ "EI",
193
+ "EK",
194
+ "EL",
195
+ "EM",
196
+ "EN",
197
+ "EO",
198
+ "EP",
199
+ "EQ",
200
+ "ER",
201
+ "ES",
202
+ "ET",
203
+ "EU",
204
+ "EV",
205
+ "EW",
206
+ "EX",
207
+ "EZ",
208
+ "FA",
209
+ "FB",
210
+ "FC",
211
+ "FD",
212
+ "FE",
213
+ "FF",
214
+ "FG",
215
+ "FH",
216
+ "FI",
217
+ "FK",
218
+ "FL",
219
+ "FM",
220
+ "FN",
221
+ "FO",
222
+ "FP",
223
+ "FR",
224
+ "FS",
225
+ "FT",
226
+ "FU",
227
+ "FW",
228
+ "FX",
229
+ "FY",
230
+ "GA",
231
+ "GB",
232
+ "GC",
233
+ "GD",
234
+ "GE",
235
+ "GF",
236
+ "GG",
237
+ "GH",
238
+ "GI",
239
+ "GL",
240
+ "GM",
241
+ "GN",
242
+ "GO",
243
+ "GP",
244
+ "GR",
245
+ "GS",
246
+ "GT",
247
+ "GU",
248
+ "GV",
249
+ "GW",
250
+ "GX",
251
+ "GY",
252
+ "HA",
253
+ "HB",
254
+ "HC",
255
+ "HD",
256
+ "HE",
257
+ "HF",
258
+ "HG",
259
+ "HH",
260
+ "HI",
261
+ "HK",
262
+ "HL",
263
+ "HM",
264
+ "HN",
265
+ "HO",
266
+ "HP",
267
+ "HQ",
268
+ "HR",
269
+ "HS",
270
+ "HT",
271
+ "HU",
272
+ "HV",
273
+ "HW",
274
+ "HX",
275
+ "HY",
276
+ "HZ",
277
+ "IA",
278
+ "IB",
279
+ "IC",
280
+ "ID",
281
+ "IE",
282
+ "IF",
283
+ "IG",
284
+ "IH",
285
+ "II",
286
+ "IJ",
287
+ "IK",
288
+ "IL",
289
+ "IM",
290
+ "IN",
291
+ "IO",
292
+ "IP",
293
+ "IQ",
294
+ "IR",
295
+ "IS",
296
+ "IT",
297
+ "IU",
298
+ "IV",
299
+ "IW",
300
+ "IX",
301
+ "IZ",
302
+ "JA",
303
+ "JB",
304
+ "JC",
305
+ "JD",
306
+ "JE",
307
+ "JI",
308
+ "JJ",
309
+ "JK",
310
+ "JM",
311
+ "JO",
312
+ "JP",
313
+ "JR",
314
+ "JS",
315
+ "JT"
316
+ ],
317
+ "ids": [
318
+ 32,
319
+ 33,
320
+ 34,
321
+ 35,
322
+ 36,
323
+ 37,
324
+ 38,
325
+ 39,
326
+ 40,
327
+ 41,
328
+ 42,
329
+ 43,
330
+ 44,
331
+ 45,
332
+ 46,
333
+ 47,
334
+ 48,
335
+ 49,
336
+ 50,
337
+ 51,
338
+ 52,
339
+ 53,
340
+ 54,
341
+ 55,
342
+ 56,
343
+ 57,
344
+ 5840,
345
+ 1803,
346
+ 1646,
347
+ 1745,
348
+ 13276,
349
+ 8018,
350
+ 1825,
351
+ 28946,
352
+ 15015,
353
+ 29595,
354
+ 11568,
355
+ 939,
356
+ 1354,
357
+ 1058,
358
+ 18183,
359
+ 2456,
360
+ 88898,
361
+ 905,
362
+ 1846,
363
+ 802,
364
+ 33869,
365
+ 7839,
366
+ 14006,
367
+ 2860,
368
+ 2926,
369
+ 22828,
370
+ 6844,
371
+ 9798,
372
+ 4738,
373
+ 9265,
374
+ 11261,
375
+ 19278,
376
+ 36513,
377
+ 93801,
378
+ 8335,
379
+ 14544,
380
+ 85266,
381
+ 9110,
382
+ 28000,
383
+ 15137,
384
+ 4525,
385
+ 25261,
386
+ 12717,
387
+ 7116,
388
+ 17078,
389
+ 14497,
390
+ 57339,
391
+ 74909,
392
+ 52072,
393
+ 19305,
394
+ 4887,
395
+ 12607,
396
+ 3580,
397
+ 6281,
398
+ 2036,
399
+ 9362,
400
+ 8533,
401
+ 2080,
402
+ 10911,
403
+ 2925,
404
+ 3040,
405
+ 9690,
406
+ 27731,
407
+ 8023,
408
+ 6901,
409
+ 8702,
410
+ 6211,
411
+ 1123,
412
+ 16307,
413
+ 18990,
414
+ 64045,
415
+ 63037,
416
+ 33380,
417
+ 6151,
418
+ 3392,
419
+ 5449,
420
+ 3967,
421
+ 1113,
422
+ 5095,
423
+ 51923,
424
+ 49600,
425
+ 17099,
426
+ 51483,
427
+ 17756,
428
+ 16037,
429
+ 8135,
430
+ 30237,
431
+ 5683,
432
+ 9992,
433
+ 7444,
434
+ 5751,
435
+ 10284,
436
+ 20887,
437
+ 59884,
438
+ 52396,
439
+ 16103,
440
+ 67547,
441
+ 18535,
442
+ 8006,
443
+ 7263,
444
+ 1425,
445
+ 6878,
446
+ 14453,
447
+ 9097,
448
+ 44072,
449
+ 76089,
450
+ 68720,
451
+ 2662,
452
+ 2629,
453
+ 923,
454
+ 6548,
455
+ 8924,
456
+ 52194,
457
+ 622,
458
+ 1515,
459
+ 1300,
460
+ 37523,
461
+ 44473,
462
+ 36530,
463
+ 3152,
464
+ 93924,
465
+ 3505,
466
+ 15731,
467
+ 6542,
468
+ 14176,
469
+ 11091,
470
+ 1686,
471
+ 11660,
472
+ 80440,
473
+ 18836,
474
+ 26132,
475
+ 5934,
476
+ 24794,
477
+ 40229,
478
+ 3660,
479
+ 11361,
480
+ 10191,
481
+ 8225,
482
+ 3860,
483
+ 78413,
484
+ 17680,
485
+ 15900,
486
+ 78138,
487
+ 15653,
488
+ 5213,
489
+ 22150,
490
+ 39500,
491
+ 10460,
492
+ 35131,
493
+ 21563,
494
+ 43194,
495
+ 27127,
496
+ 3697,
497
+ 20011,
498
+ 24368,
499
+ 15058,
500
+ 23658,
501
+ 8362,
502
+ 16035,
503
+ 24583,
504
+ 52857,
505
+ 38403,
506
+ 60456,
507
+ 81519,
508
+ 40097,
509
+ 16522,
510
+ 29722,
511
+ 21756,
512
+ 18567,
513
+ 1736,
514
+ 48043,
515
+ 87013,
516
+ 22456,
517
+ 23165,
518
+ 55523,
519
+ 13097,
520
+ 50397,
521
+ 41741,
522
+ 23073,
523
+ 6401,
524
+ 86538,
525
+ 16585,
526
+ 11622,
527
+ 2464,
528
+ 84982,
529
+ 75516,
530
+ 36984,
531
+ 58795,
532
+ 47217,
533
+ 59675,
534
+ 5681,
535
+ 3151,
536
+ 1271,
537
+ 887,
538
+ 5203,
539
+ 2685,
540
+ 1849,
541
+ 72470,
542
+ 5370,
543
+ 74063,
544
+ 27629,
545
+ 1655,
546
+ 1728,
547
+ 669,
548
+ 3682,
549
+ 3191,
550
+ 59865,
551
+ 2712,
552
+ 1580,
553
+ 922,
554
+ 77243,
555
+ 2990,
556
+ 78493,
557
+ 5228,
558
+ 2750,
559
+ 42711,
560
+ 44568,
561
+ 56402,
562
+ 48236,
563
+ 38993,
564
+ 43559,
565
+ 61250,
566
+ 32942,
567
+ 86302,
568
+ 25310,
569
+ 26313,
570
+ 81770,
571
+ 12185,
572
+ 78382
573
+ ],
574
+ "open_ids": [
575
+ 198,
576
+ 7
577
+ ]
578
+ },
579
+ "templates": {
580
+ "context": "Context:\n{state}",
581
+ "head": "\n\nQuestion: {question}\nOptions:",
582
+ "narrow_option": "\n({label}) {option}",
583
+ "wide_option": "enc(\"\\n(\") + [label_id] + enc(\") {option}\")",
584
+ "tail": "\nAnswer: (",
585
+ "isolated_question": "{q}\nProposed answer: {level}\nDoes the proposed answer fit?",
586
+ "choice_option": "{name} | {name}: {description}",
587
+ "noul_options": [
588
+ "no | no: {false}",
589
+ "yes | yes: {true}"
590
+ ],
591
+ "score_level_strip": "^\\s*-?\\d+\\s*:\\s*"
592
+ },
593
+ "option_logits": {
594
+ "choice": "label_logits[row, :k]",
595
+ "noul": "label_logits[row, :2] (0 = no = false, 1 = yes = true)",
596
+ "score": "log_sigmoid((label_logits[row_j, 1] - label_logits[row_j, 0]) / isolated_row_temperature), one row per level"
597
+ },
598
+ "opset": 20,
599
+ "precision": "fp32 compute; weights BF16 from the checkpoint, widened by Cast (at load, or per forward pass with weights_in_memory bf16)",
600
+ "weights_in_memory": "bf16"
601
+ }
4b/model-fp32.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:403657f8e9ff2e7f191397b7e4ca42aa378e80409107592cb124bb24f506720a
3
+ size 11033112
README.md CHANGED
@@ -1,6 +1,7 @@
1
  ---
2
  license: apache-2.0
3
  base_model:
 
4
  - Mapika/decider-2b
5
  - Mapika/decider-0.8b
6
  library_name: onnx
@@ -14,7 +15,7 @@ pipeline_tag: text-classification
14
 
15
  # decider for Ollaya
16
 
17
- [Ollaya](https://github.com/ollaya-dev/ollaya) package of **[Mapika/decider-2b](https://huggingface.co/Mapika/decider-2b)** and **[Mapika/decider-0.8b](https://huggingface.co/Mapika/decider-0.8b)** by Mapika.
18
  Ollaya runs open decision models locally, the way Ollama runs LLMs: typed questions in,
19
  calibrated answers out, behind a TypeSafe-compatible API.
20
 
@@ -25,12 +26,13 @@ ollaya run decider
25
  ## What is in this repository
26
 
27
  This repository holds only the files Ollaya derives, with no weights. Each graph is an ONNX export of the
28
- original model whose weights **reference the author's own `model.safetensors` by byte offset**,
29
- so `ollaya pull` downloads the weights from the upstream repository, unmodified and pinned to a
30
  commit, and verifies their sha256.
31
 
32
  | Tag | Upstream | Files |
33
  |---|---|---|
 
34
  | `decider:2b` | [Mapika/decider-2b@9839cc9](https://huggingface.co/Mapika/decider-2b/tree/9839cc9d908be16c5988c0d041034b5fdf82c7a2) | `2b/model-fp32.onnx`, `2b/decision.json`, `2b/calibration.json` |
35
  | `decider:0.8b` | [Mapika/decider-0.8b@a0a01d6](https://huggingface.co/Mapika/decider-0.8b/tree/a0a01d6f8135298f400a8c856b355793012ae971) | `0.8b/model-fp32.onnx`, `0.8b/decision.json`, `0.8b/calibration.json` |
36
 
 
1
  ---
2
  license: apache-2.0
3
  base_model:
4
+ - Mapika/decider-4b
5
  - Mapika/decider-2b
6
  - Mapika/decider-0.8b
7
  library_name: onnx
 
15
 
16
  # decider for Ollaya
17
 
18
+ [Ollaya](https://github.com/ollaya-dev/ollaya) package of **[Mapika/decider-4b](https://huggingface.co/Mapika/decider-4b)** and **[Mapika/decider-2b](https://huggingface.co/Mapika/decider-2b)** and **[Mapika/decider-0.8b](https://huggingface.co/Mapika/decider-0.8b)** by Mapika.
19
  Ollaya runs open decision models locally, the way Ollama runs LLMs: typed questions in,
20
  calibrated answers out, behind a TypeSafe-compatible API.
21
 
 
26
  ## What is in this repository
27
 
28
  This repository holds only the files Ollaya derives, with no weights. Each graph is an ONNX export of the
29
+ original model whose weights **reference the authors' own weight files by byte offset**,
30
+ so `ollaya pull` downloads the weights from the upstream repositories, unmodified and pinned to a
31
  commit, and verifies their sha256.
32
 
33
  | Tag | Upstream | Files |
34
  |---|---|---|
35
+ | `decider:4b` | [Mapika/decider-4b@eb5fbdf](https://huggingface.co/Mapika/decider-4b/tree/eb5fbdfc9448473ec25e399882912863afbdb70e) | `4b/model-fp32.onnx`, `4b/decision.json`, `4b/calibration.json` |
36
  | `decider:2b` | [Mapika/decider-2b@9839cc9](https://huggingface.co/Mapika/decider-2b/tree/9839cc9d908be16c5988c0d041034b5fdf82c7a2) | `2b/model-fp32.onnx`, `2b/decision.json`, `2b/calibration.json` |
37
  | `decider:0.8b` | [Mapika/decider-0.8b@a0a01d6](https://huggingface.co/Mapika/decider-0.8b/tree/a0a01d6f8135298f400a8c856b355793012ae971) | `0.8b/model-fp32.onnx`, `0.8b/decision.json`, `0.8b/calibration.json` |
38