masterset-ai commited on
Commit
d840496
·
verified ·
1 Parent(s): b83d45b

Update model card

Browse files
Files changed (1) hide show
  1. README.md +73 -70
README.md CHANGED
@@ -1,70 +1,73 @@
1
- ---
2
- license: apache-2.0
3
- base_model: FINAL-Bench/Darwin-35B-A3B-Opus
4
- library_name: transformers
5
- pipeline_tag: image-text-to-text
6
- tags:
7
- - vision
8
- - decision
9
- - multiple-choice
10
- - classification
11
- - moe
12
- - qwen3_5_moe
13
- ---
14
-
15
- # PhysicalEye-Decide-35B
16
-
17
- **One forward pass. One calibrated decision.**
18
-
19
- PhysicalEye-Decide-35B answers a question about an image by choosing among the options you give it, and returns a probability for every option. It does not write text. It reads the image, the question and the options once, and outputs a decision.
20
-
21
- Use it for visual inspection, yes/no checks, option selection and scoring on production lines, in apps and in robots.
22
-
23
- ## Results
24
-
25
- | Test | Result |
26
- |---|---|
27
- | Egg inspection, held-out test (100 photos, good vs bad) | **98.0%** accuracy, mean confidence 0.964 |
28
- | AI2D diagram questions (200, 4 options) | **87.0%** (chance 25%) |
29
- | Latency per decision, median (one B200 GPU) | **0.051 s** (p80 0.068 s) |
30
-
31
- ## How it works
32
-
33
- - Backbone: a vision-language Mixture-of-Experts model (35B total, about 3B active per token).
34
- - A small decision readout sits on top of the backbone and scores each option directly.
35
- - Output: one probability per option. Probabilities are temperature-calibrated.
36
-
37
- ## Input format
38
-
39
- Each request has an optional image, a question and a list of options.
40
-
41
- ```json
42
- {
43
- "images": ["<base64 or URL>"],
44
- "question": "Is this egg good or bad?",
45
- "options": ["good", "bad"]
46
- }
47
- ```
48
-
49
- The model returns the probability of each option, for example `{"good": 0.03, "bad": 0.97}`.
50
-
51
- ## Files
52
-
53
- - `model-*.safetensors`: backbone weights
54
- - `readout.safetensors`: decision readout
55
- - `decision_config.json`: option codes, token ids and calibration temperature
56
-
57
- ## Base model and license
58
-
59
- - Built on [FINAL-Bench/Darwin-35B-A3B-Opus](https://huggingface.co/FINAL-Bench/Darwin-35B-A3B-Opus), a Qwen3.5 MoE based model.
60
- - Released under Apache-2.0. The upstream Qwen license notice applies to the base weights.
61
-
62
- ## Training data credits
63
-
64
- The decision readout was trained on openly licensed data:
65
-
66
- - VQAv2 (CC BY 4.0, annotations), COCO captions and instances 2017 (CC BY 4.0, annotations; images keep their Flickr licenses)
67
- - TextVQA 0.5.1 (CC BY 4.0), ScreenQA and RICO-SCA / Screen2Words on RICO (CC BY 4.0)
68
- - CLEVR v1.0 (CC BY 4.0), A-OKVQA (Apache-2.0), VSR (CC BY 4.0), CORD v2 (CC BY 4.0)
69
- - Open-Jev (CC0 1.0), MMLU auxiliary train (MIT), synthetic charts made in-house
70
- - Good and Bad Eggs Identification Image Dataset, Md Mafiul Hasan Matin, Marium Jahan, Md. Saroar Jahan, Mendeley Data, doi:10.17632/mdty358x8m.1 (CC BY 4.0)
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model: FINAL-Bench/Darwin-35B-A3B-Opus
4
+ library_name: transformers
5
+ pipeline_tag: image-text-to-text
6
+ tags:
7
+ - vision
8
+ - decision
9
+ - multiple-choice
10
+ - classification
11
+ - moe
12
+ - qwen3_5_moe
13
+ ---
14
+
15
+ # PhysicalEye-Decide-35B
16
+
17
+ **One forward pass. One calibrated decision.**
18
+
19
+ PhysicalEye-Decide-35B answers a question about an image by choosing among the options you give it, and returns a probability for every option. It does not write text. It reads the image, the question and the options once, and outputs a decision.
20
+
21
+ Use it for visual inspection, yes/no checks, option selection and scoring on production lines, in apps and in robots.
22
+
23
+ ## Results
24
+
25
+ | Test | Result |
26
+ |---|---|
27
+ | Egg inspection, held-out test (100 photos, good vs bad) | **98.0%** accuracy, mean confidence 0.964 |
28
+ | AI2D diagram questions (200, 4 options) | **87.0%** (chance 25%) |
29
+ | Latency per decision, median (one B200 GPU) | **0.051 s** (p80 0.068 s) |
30
+
31
+ ## How it works
32
+
33
+ - Backbone: a vision-language Mixture-of-Experts model (35B total, about 3B active per token).
34
+ - A small decision readout sits on top of the backbone and scores each option directly.
35
+ - Output: one probability per option. Probabilities are temperature-calibrated.
36
+
37
+ ## Input format
38
+
39
+ One request carries up to 4 images, an optional context (`state`) and one or more questions.
40
+ Three question types are supported: `choice` (pick one option), `noul` (yes or no) and `score` (a value on a scale).
41
+
42
+ ```json
43
+ {
44
+ "images": ["<base64 image>"],
45
+ "state": "Egg inspection line, candling light.",
46
+ "questions": {
47
+ "q1": {"type": "choice", "question": "Is this egg good or bad?", "options": ["good", "bad"]}
48
+ }
49
+ }
50
+ ```
51
+
52
+ The response has one entry per question key in `answers`, with the chosen option and its probability.
53
+
54
+ ## Files
55
+
56
+ - `model-*.safetensors`: backbone weights
57
+ - `readout.safetensors`: decision readout
58
+ - `decision_config.json`: option codes, token ids and calibration temperature
59
+
60
+ ## Base model and license
61
+
62
+ - Built on [FINAL-Bench/Darwin-35B-A3B-Opus](https://huggingface.co/FINAL-Bench/Darwin-35B-A3B-Opus), a Qwen3.5 MoE based model.
63
+ - Released under Apache-2.0. The upstream Qwen license notice applies to the base weights.
64
+
65
+ ## Training data credits
66
+
67
+ The decision readout was trained on openly licensed data:
68
+
69
+ - VQAv2 (CC BY 4.0, annotations), COCO captions and instances 2017 (CC BY 4.0, annotations; images keep their Flickr licenses)
70
+ - TextVQA 0.5.1 (CC BY 4.0), ScreenQA and RICO-SCA / Screen2Words on RICO (CC BY 4.0)
71
+ - CLEVR v1.0 (CC BY 4.0), A-OKVQA (Apache-2.0), VSR (CC BY 4.0), CORD v2 (CC BY 4.0)
72
+ - Open-Jev (CC0 1.0), MMLU auxiliary train (MIT), synthetic charts made in-house
73
+ - Good and Bad Eggs Identification Image Dataset, Md Mafiul Hasan Matin, Marium Jahan, Md. Saroar Jahan, Mendeley Data, doi:10.17632/mdty358x8m.1 (CC BY 4.0)