chrishayuk commited on
Commit
9c5de1d
·
verified ·
1 Parent(s): 21a687e

Upload README.md

Browse files
Files changed (1) hide show
  1. README.md +36 -0
README.md ADDED
@@ -0,0 +1,36 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ tags:
4
+ - vindex
5
+ - mechanistic-interpretability
6
+ - larql
7
+ - knowledge-graph
8
+ - gemma
9
+ ---
10
+
11
+ # Gemma 3 4B IT — Vindex (f16)
12
+
13
+ FFN knowledge index extracted from `google/gemma-3-4b-it` using LARQL.
14
+
15
+ Treats transformer FFN weights as a queryable knowledge graph — retrieval via dot-product graph walks against gate vectors, no matrix multiplication.
16
+
17
+ ## Usage
18
+
19
+ ```sql
20
+ larql> USE "hf://chrishayuk/gemma-3-4b-it-vindex";
21
+ larql> DESCRIBE "France";
22
+ ```
23
+
24
+ ## Contents
25
+
26
+ - 34 layers, 348.2K features
27
+ - Gate vectors, embeddings, down features/weights
28
+ - Attention weights, norms, tokenizer
29
+ - Probe-confirmed feature labels
30
+ - f16 precision
31
+
32
+ ## What is a vindex?
33
+
34
+ A vindex decouples a model's knowledge from its inference machinery. The FFN weights become a queryable graph — DESCRIBE returns typed knowledge edges, WALK traces activation paths, INFER runs graph-walk inference at 31 tok/sec on CPU.
35
+
36
+ See [LARQL](https://github.com/chrishayuk/larql) for the full engine.