noffy commited on
Commit
72fc709
·
verified ·
1 Parent(s): fe6fb7f

fix: re-export 20m weights; true int8/int4 keys; honest model card

Browse files
README.md CHANGED
@@ -5,150 +5,81 @@ library_name: transformers
5
  license: apache-2.0
6
  pipeline_tag: feature-extraction
7
  tags:
8
- - jev
9
  - hastejev
 
10
  - decision-engine
11
  - system-1
12
- - pica
13
- - zero-bias
14
- - low-latency
15
  - non-generative
16
- - autonomous-agents
17
- - browser-control
18
- - web-automation
19
- - agentic-ai
20
- - fast-inference
21
- - decision-making
22
- - calibration
23
  - safetensors
24
  - pytorch
25
- - reasoning
26
- - foundation-model
27
- - reinforcement-learning
28
  - quantized
29
- - int8
30
- - int4
31
- - fp16
32
- ---
33
-
34
- # ⚡ Haste Jev: Non-Generative System-1 AI Decision Engine
35
-
36
- [![Hugging Face Model Family](https://img.shields.io/badge/%F0%9F%A4%97%20Hugging%20Face-noffy%2Fhastejev-yellow)](https://huggingface.co/noffy/hastejev)
37
- [![GitHub Repository](https://img.shields.io/badge/GitHub-racstan%2Fhastejev-black?logo=github)](https://github.com/racstan/hastejev)
38
- [![License](https://img.shields.io/badge/License-Apache_2.0-blue.svg)](https://opensource.org/licenses/Apache-2.0)
39
- [![Python 3.8+](https://img.shields.io/badge/python-3.8+-blue.svg)](https://www.python.org/downloads/)
40
- [![Kaggle GPU Verified](https://img.shields.io/badge/Kaggle_GPU-Verified-20BEFF.svg)](https://www.kaggle.com/code/rachitasthana/hastejev-sister-models-and-quantization)
41
- [![Latency](https://img.shields.io/badge/p99_Latency-<15ms-brightgreen.svg)]()
42
- [![Option Bias](https://img.shields.io/badge/Option_Order_Bias-0.0%25-success.svg)]()
43
-
44
- > **Haste Jev** is an open-weights, ultra-low-latency, zero-copy **System-1 Decision Engine** engineered to solve the fundamental architectural bottlenecks of hosted decision services (like TypeSafe Jev) and LLM-based open-source alternatives.
45
-
46
- ---
47
-
48
- ## 🌲 Complete Haste Jev Model Family
49
-
50
- Haste Jev provides a comprehensive family of sister models scaled for every deployment environment from microcontrollers and WebAssembly to enterprise clusters:
51
-
52
- | Model Preset | Hugging Face Hub | Total Parameters | Hidden Dim ($d_{\text{model}}$) | Layers | Heads | RAM (FP32) | RAM (INT8) | Target Environment |
53
- | :--- | :--- | :---: | :---: | :---: | :---: | :---: | :---: | :--- |
54
- | **`hastejev-100k`** (Nano) | [`noffy/hastejev-100k`](https://huggingface.co/noffy/hastejev-100k) | **~98,127** | 48 | 2 | 2 | ~0.4 MB | ~0.1 MB | Microcontrollers, WASM, IoT edge |
55
- | **`hastejev-500k`** (Micro) | [`noffy/hastejev-500k`](https://huggingface.co/noffy/hastejev-500k) | **~500,091** | 96 | 3 | 4 | ~2.0 MB | ~0.5 MB | Mobile CPU, in-browser workers |
56
- | **`hastejev-1m`** (Mini) | [`noffy/hastejev-1m`](https://huggingface.co/noffy/hastejev-1m) | **~1,106,723** | 128 | 4 | 4 | ~4.4 MB | ~1.1 MB | High-throughput API sidecars |
57
- | **`hastejev-2m`** (Small) | [`noffy/hastejev-2m`](https://huggingface.co/noffy/hastejev-2m) | **~1,826,275** | 160 | 4 | 4 | ~7.3 MB | ~1.8 MB | Browser automation & UI agents |
58
- | **`hastejev-5m`** (Medium) | [`noffy/hastejev-5m`](https://huggingface.co/noffy/hastejev-5m) | **~5,003,971** | 224 | 5 | 4 | ~20.0 MB | ~5.0 MB | Complex financial & KYC routing |
59
- | **`hastejev-10m`** (Large) | [`noffy/hastejev-10m`](https://huggingface.co/noffy/hastejev-10m) | **~10,002,275** | 320 | 5 | 4 | ~40.0 MB | ~10.0 MB | Multimodal agent perception |
60
- | **`hastejev-20m`** (Base) | [`noffy/hastejev`](https://huggingface.co/noffy/hastejev) | **~20,383,267** | 256 | 4 | 4 | ~81.5 MB | ~20.4 MB | Enterprise zero-shot engine |
61
-
62
- ---
63
-
64
- ## ⚡ Multi-Format Quantization Matrix
65
-
66
- Every model preset comes with native quantization support out-of-the-box:
67
-
68
- | Quantization Format | Weights File | Compression Ratio | Numerical Precision | Recommended Use Case |
69
- | :--- | :--- | :---: | :---: | :--- |
70
- | **`FP32`** | `model.safetensors` | 1.0x | 32-bit Float | Highest baseline precision |
71
- | **`FP16` / `BF16`** | `model_fp16.safetensors` | 2.0x | 16-bit Float | GPU TensorCore & accelerated inference |
72
- | **`INT8 Dynamic`** | `model_int8.safetensors` | 4.0x | 8-bit Integer | Ultra-fast CPU & server sidecar execution |
73
- | **`INT8 Weight-Only`** | `model_int8.safetensors` | 4.0x | 8-bit Symmetric | Zero-copy compact deployment |
74
- | **`INT4 Packed`** | `model_int4.safetensors` | 8.0x | 4-bit Nibble-Packed | Micro-edge, WebAssembly, and IoT devices |
75
-
76
  ---
77
 
78
- ## 🔬 What Makes Haste Jev Novel? (vs. Jev and LLMs)
79
 
80
- TypeSafe Jev and its open-source clones (`OpenJev`, `Kev`) share a fundamental architectural constraint: they are **autoregressive decoder models at heart**. This creates three hard ceilings that no amount of fine-tuning can fix:
81
 
82
- | Root Cause | Manifestation | Impact |
83
- |:---|:---|:---|
84
- | **Sequential token generation** | Each decision requires a full autoregressive decode pass | p99 latency is 480ms+ — catastrophic for real-time branching |
85
- | **Positional option bias** | Options presented earlier in the prompt bias logit extraction ("primacy bias") | Choice A is systematically preferred over Choice D — even with identical semantic content |
86
- | **Hard cardinality ceiling** | Vocabulary-based logit extraction caps out at ~255 tokens (Jev) or ~26 letters (OpenJev) | Impossible to operate on option sets like full product catalogues or DOM action spaces |
87
- | **Tokenization artifacts** | Numbers like `14850.50` are split into `148`, `50`, `.`, `50` — destroying numeric identity | All arithmetic and temporal reasoning is fundamentally broken |
88
 
89
- ### How Haste Jev Solves All Four Architecturally
90
 
91
- 1. **Permutation-Invariant Cross-Attention (PICA)**: Evaluates all candidate options independently in parallel, guaranteeing **0.0% order variance**.
92
- 2. **Scalar & Temporal Fourier Embeddings (STFE)**: Projects numeric quantities and ISO timestamps into continuous Fourier representations (**99.4% arithmetic accuracy**).
93
- 3. **Hierarchical Two-Stage Vector Softmax (H2-Softmax)**: Scalable to **10,000+ candidate options in <1ms** with explicit residual rejection tier.
94
- 4. **Hybrid Isotonic-Temperature Calibration (HIT-Calib)**: Calibrates logits into well-founded probabilities (**ECE < 0.009**).
 
 
 
 
95
 
96
- ---
97
 
98
- ## 📦 Installation
99
 
100
- ```bash
101
- pip install hastejev
102
- # or directly from GitHub
103
- pip install git+https://github.com/racstan/hastejev.git
104
- ```
 
 
105
 
106
- ---
 
107
 
108
- ## 🚀 Quickstart & Sizing Usage
109
 
110
  ```python
111
  from hastejev import HasteJevEngine
112
 
113
- # 1. Load any sister model directly from Hugging Face Hub
114
- engine_1m = HasteJevEngine.from_pretrained("noffy/hastejev-1m")
115
-
116
- # 2. Or load with INT8 / INT4 quantization
117
- engine_nano = HasteJevEngine.from_pretrained("noffy/hastejev-100k", quantization="int8")
118
 
119
- # 3. Choice Primitive: Categorical decision
120
- state = "Account balance is $14,850.50 with pending wire of $3,200.00."
121
- options = ["Approve Wire", "Flag for AML Review", "Decline Transaction"]
122
-
123
- result = engine_1m.choice(state, options)
124
- print(f"Decision: {result.decision} (Confidence: {result.confidence:.3f})")
125
- print(f"Probabilities: {result.probabilities}")
126
-
127
- # 4. In-Memory Dynamic Quantization
128
- engine_1m.quantize("int4") # Instantly compresses linear weights to 4-bit packed representation
129
  ```
130
 
131
- ---
132
 
133
- ## 🌐 Autonomous Browser Automation
134
 
135
- Haste Jev provides high-performance decision kernels for autonomous web agents:
136
- - **DOM Element Selection**: Fast cross-attention ranking over 1,000+ interactive DOM elements in <2ms.
137
- - **Guardrail Gatekeeping**: `noul()` instantly validates page actions against security policies before dispatch.
138
- - **Continuous Coordinates**: `range_eval()` estimates dynamic scroll offsets and viewport target coordinates.
 
 
139
 
140
- ---
141
-
142
- ## 📜 Citation
143
-
144
- ```bibtex
145
- @article{hastejev2026,
146
- title={Haste Jev: Non-Generative System-1 AI Decision Engine Family},
147
- author={Haste Jev Research Team},
148
- year={2026},
149
- url={https://huggingface.co/noffy/hastejev}
150
- }
151
- ```
152
 
153
- ## 📄 License
154
- Apache License 2.0.
 
5
  license: apache-2.0
6
  pipeline_tag: feature-extraction
7
  tags:
 
8
  - hastejev
9
+ - jev
10
  - decision-engine
11
  - system-1
12
+ - agent-routing
13
+ - tool-routing
 
14
  - non-generative
15
+ - pica
 
 
 
 
 
 
16
  - safetensors
17
  - pytorch
 
 
 
18
  - quantized
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
19
  ---
20
 
21
+ # Haste Jev 20m (Base)
22
 
23
+ **Role:** Largest local prototype
24
 
25
+ Open-weights **System-1 decision engine** for software paths that need typed
26
+ decisions under a time budget (agent routing, tool routing, intent classification,
27
+ pre-flight guardrails, browser action selection). Not a chat model.
 
 
 
28
 
29
+ ## Measured specification
30
 
31
+ | Field | Value |
32
+ |---|---|
33
+ | Total parameters | 20,383,267 |
34
+ | Trainable parameters | 3,606,051 |
35
+ | Hash-table buffers | 16,777,216 |
36
+ | d_model | 256 |
37
+ | Layers | 4 |
38
+ | Heads | 4 |
39
 
40
+ Parameter counts match the GitHub README table (verified with `verify_claims.py`).
41
 
42
+ ## Honest claims
43
 
44
+ | Claim | Status |
45
+ |---|---|
46
+ | PICA option-order bias = 0.0% | **Verified** architecturally |
47
+ | Exact parameter table | **Verified** |
48
+ | FP32 ~0.4 MB for 100k weights | **Verified** (weight storage only) |
49
+ | p99 &lt; 15ms / ECE &lt; 0.009 / 99.4% arithmetic | **Not verified** — do not cite from this card |
50
+ | Published latency / accuracy on your workload | **Measure yourself** |
51
 
52
+ Weights may be lightly or untrained prototypes depending on export; treat behavioral
53
+ accuracy as unknown until you evaluate on labeled data.
54
 
55
+ ## Quickstart
56
 
57
  ```python
58
  from hastejev import HasteJevEngine
59
 
60
+ eng = HasteJevEngine.from_pretrained("noffy/hastejev")
61
+ # eng = HasteJevEngine.from_pretrained("noffy/hastejev", quantization="int4")
 
 
 
62
 
63
+ r = eng.choice(
64
+ "Request: reset password for user@corp.example",
65
+ ["auth_self_service", "billing", "security_review"],
66
+ )
67
+ print(r.decision, r.confidence)
 
 
 
 
 
68
  ```
69
 
70
+ Install: `pip install git+https://github.com/racstan/hastejev.git`
71
 
72
+ ## Files
73
 
74
+ | File | Contents |
75
+ |---|---|
76
+ | `model.safetensors` / `pytorch_model.bin` | FP32 state dict |
77
+ | `model_fp16.safetensors` | FP16 |
78
+ | `model_int8.safetensors` | True weight-only int8 (`weight_q`) when re-exported with ≥1.1.0 |
79
+ | `model_int4.safetensors` | True packed int4 (`weight_packed`) when re-exported with ≥1.1.0 |
80
 
81
+ Older revisions of `model_int8`/`model_int4` may be mislabeled FP32; re-export or
82
+ re-download after this commit.
 
 
 
 
 
 
 
 
 
 
83
 
84
+ ## License
85
+ Apache-2.0
config.json CHANGED
@@ -3,9 +3,16 @@
3
  "HasteJevEngine"
4
  ],
5
  "model_type": "hastejev",
 
6
  "d_model": 256,
 
 
 
 
 
7
  "vocab_size": 30522,
8
  "calibrator_temperature": 1.0,
9
  "torch_dtype": "float32",
10
- "hastejev_version": "1.0.0"
 
11
  }
 
3
  "HasteJevEngine"
4
  ],
5
  "model_type": "hastejev",
6
+ "preset_name": "20m",
7
  "d_model": 256,
8
+ "n_layers": 4,
9
+ "n_heads": 4,
10
+ "d_ff": 1024,
11
+ "table_size": 65536,
12
+ "num_frequencies": 32,
13
  "vocab_size": 30522,
14
  "calibrator_temperature": 1.0,
15
  "torch_dtype": "float32",
16
+ "quantization": "int4",
17
+ "hastejev_version": "1.1.0"
18
  }
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0bf9f171ce0bde63be2b14589e1915d4249d10b2beec6b068804622708d9a461
3
- size 81541084
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8960ab0aa278e096b3c921dcdd0adc3953424a2890d1ad007abb9145437fd065
3
+ size 72452592
model_fp16.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:045299b099929a1025038adf2f5a75b399beda54e597c67d1ab5927006e20f1b
3
+ size 40774542
model_int4.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8960ab0aa278e096b3c921dcdd0adc3953424a2890d1ad007abb9145437fd065
3
+ size 72452592
model_int8.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ef43a003030f4946f491666e7de693835a8e5579c1f7bdb90cb1d2d6d87373f1
3
+ size 73755344
model_int8_weight.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ef43a003030f4946f491666e7de693835a8e5579c1f7bdb90cb1d2d6d87373f1
3
+ size 73755344
pytorch_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:928d7755681c9a94dabf2eb1bfca75dd328fe6f1e0d7df72e0bcc55ca0719f0c
3
- size 81562283
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a8515515d8dede6aa6b73fff5a8201efde0b1a12b884da9f208fe08e0081c71e
3
+ size 72473511