deadbydawn101 commited on
Commit
075c603
·
verified ·
1 Parent(s): 56a6f4e

Model card: first MLX conjecture model

Browse files
Files changed (1) hide show
  1. README.md +83 -4
README.md CHANGED
@@ -1,9 +1,88 @@
1
  ---
2
- library_name: mlx
3
  license: apache-2.0
4
- license_link: https://huggingface.co/Qwen/Qwen3-8B/blob/main/LICENSE
5
- pipeline_tag: text-generation
6
- base_model: mlx-community/Qwen3-8B-4bit
7
  tags:
 
 
 
 
8
  - mlx
 
 
 
 
 
9
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
 
2
  license: apache-2.0
3
+ language:
4
+ - en
5
+ library_name: mlx
6
  tags:
7
+ - theorem-proving
8
+ - lean4
9
+ - conjecture-generation
10
+ - apple-silicon
11
  - mlx
12
+ - ravenx
13
+ base_model: Qwen/Qwen3-8B
14
+ datasets:
15
+ - AI-MO/NuminaMath-LEAN
16
+ pipeline_tag: text-generation
17
  ---
18
+
19
+ # RavenX-Conjecture-Qwen3-8B-MLX
20
+
21
+ **The first conjecture generation model fine-tuned on MLX for Apple Silicon.**
22
+
23
+ Built by a security AI company that doesn't do math. That's the point.
24
+
25
+ ## The Story
26
+
27
+ On July 22, 2026 — first day back after two weeks sick — RavenX AI Labs:
28
+
29
+ 1. Read the ConjectureBench paper (arXiv:2510.11986) — nobody had implemented it locally
30
+ 2. Built the first MLX-native LEAN-FIRE pipeline on Apple Silicon
31
+ 3. Fine-tuned the first conjecture generation model that exists
32
+ 4. Verified Dmitry Rybin's breaking counterexample to the 30-year-old Dinitz-Garg-Goemans conjecture within hours
33
+
34
+ We don't do math. We do security AI and sovereign infrastructure. We built this cold.
35
+
36
+ ## Training
37
+
38
+ | Parameter | Value |
39
+ |-----------|-------|
40
+ | Base model | Qwen/Qwen3-8B |
41
+ | Method | MLX LoRA (rank 16, alpha 32) |
42
+ | Dataset | AI-MO/NuminaMath-LEAN (1,706 train / 190 valid) |
43
+ | Iterations | 1,500 |
44
+ | Val loss | 2.993 → 0.651 (78% reduction) |
45
+ | Time | ~75 min on Apple M4 Max 128GB |
46
+ | Tokens trained | 1,010,330 |
47
+
48
+ ## Results — Before vs After
49
+
50
+ **Putnam 2004 A1** (existence proof): Before = no output. After = correct existential Lean structure.
51
+
52
+ **Putnam 2013 B2** (cosine max = 3): Before = no output. After = IsGreatest with Finset.range, Real.pi (correct Mathlib idioms).
53
+
54
+ ## Usage
55
+
56
+ ```python
57
+ from mlx_lm import load, generate
58
+ model, tokenizer = load("deadbydawn101/RavenX-Conjecture-Qwen3-8B-MLX")
59
+ prompt = tokenizer.apply_chat_template([
60
+ {"role": "system", "content": "You are an expert mathematician. Generate the precise solution as a Lean 4 expression."},
61
+ {"role": "user", "content": "What are the real roots of x^2 - 4x = 0?\n/no_think"},
62
+ ], tokenize=False, add_generation_prompt=True)
63
+ output = generate(model, tokenizer, prompt=prompt, max_tokens=512)
64
+ ```
65
+
66
+ ## DGG Conjecture — Verify Yourself
67
+
68
+ ```bash
69
+ git clone https://github.com/DeadByDawn101/ravenx-conjecturebench
70
+ python formal_verification/verify_dgg.py
71
+ ```
72
+
73
+ All 8 routings. Integer arithmetic. 60 > 58. Lean 4 formalization (245 lines) included.
74
+
75
+ ## Formats
76
+
77
+ | Format | Size | Link |
78
+ |--------|------|------|
79
+ | **MLX (this repo)** | 4.3 GB | You're here |
80
+ | GGUF Q8_0 | 8.1 GB | [GGUF](https://huggingface.co/deadbydawn101/RavenX-Conjecture-Qwen3-8B-GGUF) |
81
+
82
+ Pipeline: [github.com/DeadByDawn101/ravenx-conjecturebench](https://github.com/DeadByDawn101/ravenx-conjecturebench)
83
+
84
+ ## RavenX AI Labs
85
+
86
+ 155K+ HF downloads | 22 models | 2 USPTO patents | Security AI
87
+
88
+ *"We don't do math. That's the point." — RavenX AI Labs*