| # bankml 0.1.9 release gate — 2026-09-29T06:59:45Z |
| # rustc 1.95.0 (59807616e 2026-04-14) · AMD Ryzen 3 3200U with Radeon Vega Mobile Gfx · 4 threads |
| unittests: test result: ok. 47 passed; 0 failed; 13 ignored; 0 measured; 0 filtered out; finished in 0.60s |
| testing/cli.rs: test result: ok. 6 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.09s |
| clippy: clean |
| spdx: 37/37 files carry the licence of their layer |
| ok need_more |
| ui data layer: all ok |
| postgres connector (throwaway cluster): all ok |
| iNFT mint and load (throwaway anvil devnet): all ok |
| model importer (loopback source; carrier on spare ports): all ok |
| 28/28 agree |
| ## oracle_ggml_b11192_real_bonsai_1_7b |
| oracle: 197 tensors / 1719904256 weights dequantized bit-exact; 788 q8_0 rows byte-exact; 788 vec_dot and vec_dot_act bit-exact vs ggml AVX2; generic port == ggml generic in 788/788 |
| . |
| test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 59 filtered out; finished in 11.33s |
| ## oracle_ggml_b11192_real_bonsai_8b_q1_0 |
| oracle: 254 tensors / 8188239872 weights dequantized bit-exact; 762 q8_0 rows byte-exact; 762 vec_dot and vec_dot_act bit-exact vs ggml AVX2; generic port == ggml generic in 762/762 |
| . |
| test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 59 filtered out; finished in 44.00s |
| ## oracle_ggml_b11192_real_ternary_bonsai_8b |
| oracle: 254 Q2_0 tensors / 8188239872 weights dequantized bit-exact; 762 q8_0 rows byte-exact; 762 vec_dot_ref, vec_dot_act (AVX2) and scalar bit-exact vs ggml haswell; no-FMA model == ggml x64 in 762/762 |
| . |
| test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 59 filtered out; finished in 41.70s |
| ## ab_vs_ggml |
| GEMV 12288x4096, ns/block min/median: bankml mat_vec 11.12/13.94 (1.041x ggml median) |
| GEMV 12288x4096, ns/block min/median: ggml b11192 12.39/14.51 | bankml vec_dot 11.85/16.84 (0.862x) | bankml vec_dot_act 10.94/13.96 (1.040x) |
| prefill 1024x4096 x 32 cols, ns/(block·col) min/median: ggml per-pair 10.35/10.56 | bankml 1x4 tile 9.43/9.65 (1.095x) | bankml Q8Act tile 8.48/8.62 (1.226x) |
| . |
| test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 59 filtered out; finished in 1.10s |
| ## ab_vs_ggml_q2_0 |
| decode GEMV, 1 thread, ns/block (64 weights) min/median, ms/matmul = median: |
| blk.0.attn_q.weight 4096x4096 ggml 39.29/ 64.86 ( 17.0 ms) | bankml 3.83/ 5.07 ( 1.3 ms) | 12.80x |
| blk.0.attn_k.weight 1024x4096 ggml 42.79/ 53.20 ( 3.5 ms) | bankml 4.34/ 5.35 ( 0.4 ms) | 9.94x |
| blk.0.attn_output.weight 4096x4096 ggml 34.49/ 50.92 ( 13.3 ms) | bankml 3.63/ 4.53 ( 1.2 ms) | 11.24x |
| blk.0.ffn_gate.weight 12288x4096 ggml 34.63/ 36.43 ( 28.6 ms) | bankml 3.57/ 3.70 ( 2.9 ms) | 9.84x |
| blk.0.ffn_down.weight 4096x12288 ggml 34.98/ 36.69 ( 28.9 ms) | bankml 3.50/ 3.88 ( 3.1 ms) | 9.45x |
| output.weight 151669x4096 ggml 35.66/ 36.71 ( 356.3 ms) | bankml 3.62/ 3.78 ( 36.7 ms) | 9.71x |
| activation n=4096: q8_0 quantize 27.7 µs + bankml layout 8.1 µs (median) |
| activation n=12288: q8_0 quantize 96.4 µs + bankml layout 22.6 µs (median) |
| prefill 1024x4096 x 32 cols, ns/(block·col) min/median: ggml per-pair 35.12/36.26 | bankml mat_vec per column 3.50/3.54 (10.26x) | bankml 1x4 tile 2.80/2.88 (12.60x) |
| . |
| test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 59 filtered out; finished in 5.35s |
| ## bench_q1_0_prefill_act |
| prefill 1024x4096 x 32 ns/(block·col) min/median: 1x4 (q8 bytes) 9.24/9.39 | 1x4 sel (Q8Act) 8.29/8.35 (1.124x) |
| . |
| test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 59 filtered out; finished in 0.17s |
| ## bench_memory_floor |
| 1 thread(s): 15.31 GB/s read → floor for one ternary token (2.13 GB) 0.139 s, one 1-bit token (1.06 GB) 0.069 s |
| 2 thread(s): 16.53 GB/s read → floor for one ternary token (2.13 GB) 0.129 s, one 1-bit token (1.06 GB) 0.064 s |
| 3 thread(s): 16.77 GB/s read → floor for one ternary token (2.13 GB) 0.127 s, one 1-bit token (1.06 GB) 0.063 s |
| 4 thread(s): 16.02 GB/s read → floor for one ternary token (2.13 GB) 0.133 s, one 1-bit token (1.06 GB) 0.066 s |
| . |
| test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 59 filtered out; finished in 1.77s |
| ## decode_budget_q1_0 |
| decode budget: 253 Q1_0 matmuls, 7567003648 weights (1.06 GB of blocks) per token |
| 1 thread(s): ggml b11192 0.645/0.657 s/token (min/median) | bankml 0.640/0.648 | 1.01x | matmul-only ceiling ggml 1.55, bankml 1.56 tok/s |
| 2 thread(s): ggml b11192 0.510/0.595 s/token (min/median) | bankml 0.468/0.492 | 1.21x | matmul-only ceiling ggml 1.96, bankml 2.14 tok/s |
| 3 thread(s): ggml b11192 0.376/0.383 s/token (min/median) | bankml 0.366/0.393 | 0.97x | matmul-only ceiling ggml 2.66, bankml 2.73 tok/s |
| 4 thread(s): ggml b11192 0.425/0.486 s/token (min/median) | bankml 0.379/0.391 | 1.24x | matmul-only ceiling ggml 2.35, bankml 2.64 tok/s |
| . |
| test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 59 filtered out; finished in 16.53s |
| ## decode_budget_q2_0 |
| decode budget: 253 Q2_0 matmuls, 7567003648 weights (2.13 GB of blocks) per token |
| 1 thread(s): ggml b11192 6.674/6.966 s/token (min/median) | bankml 4.247/4.269 s/token | 1.57x | matmul-only ceiling ggml 0.15, bankml 0.24 tok/s |
| attn_k ggml 0.143 s bankml 0.087 s (mean of 3 passes) |
| attn_output ggml 0.589 s bankml 0.349 s (mean of 3 passes) |
| attn_q ggml 0.573 s bankml 0.341 s (mean of 3 passes) |
| attn_v ggml 0.143 s bankml 0.084 s (mean of 3 passes) |
| ffn_down ggml 1.695 s bankml 1.021 s (mean of 3 passes) |
| ffn_gate ggml 1.684 s bankml 1.018 s (mean of 3 passes) |
| ffn_up ggml 1.695 s bankml 1.042 s (mean of 3 passes) |
| output ggml 0.580 s bankml 0.360 s (mean of 3 passes) |
| 3 thread(s): ggml b11192 5.094/5.438 s/token (min/median) | bankml 4.527/4.576 s/token | 1.13x | matmul-only ceiling ggml 0.20, bankml 0.22 tok/s |
| attn_k ggml 0.133 s bankml 0.097 s (mean of 3 passes) |
| attn_output ggml 0.518 s bankml 0.386 s (mean of 3 passes) |
| attn_q ggml 0.586 s bankml 0.374 s (mean of 3 passes) |
| attn_v ggml 0.199 s bankml 0.095 s (mean of 3 passes) |
| ffn_down ggml 1.773 s bankml 1.150 s (mean of 3 passes) |
| ffn_gate ggml 1.470 s bankml 1.137 s (mean of 3 passes) |
| ffn_up ggml 1.529 s bankml 1.136 s (mean of 3 passes) |
| output ggml 0.454 s bankml 0.363 s (mean of 3 passes) |
| . |
| test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 59 filtered out; finished in 80.60s |
| # gate done |
|
|
