luigicfilho commited on
Commit
1842ad9
·
verified ·
1 Parent(s): 92fa965

add model info readme

Browse files
Files changed (1) hide show
  1. README.md +82 -3
README.md CHANGED
@@ -1,3 +1,82 @@
1
- ---
2
- license: mit
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - en
4
+ license: mit
5
+ library_name: transformers
6
+ tags:
7
+ - generated
8
+ - numerical-generation
9
+ - weight-space
10
+ - text-generation
11
+ inference: true
12
+ model_creator: LCDev-LLMGen
13
+ widget:
14
+ - text: "The nature of mathematics is"
15
+ example_title: "Nature of mathematics"
16
+ - text: "Once upon a time"
17
+ example_title: "Story"
18
+ ---
19
+
20
+ <div align="center">
21
+
22
+ ![Numera Banner](Numera.png)
23
+
24
+ # Numera: The Numerically Generated Model
25
+
26
+ </div>
27
+
28
+ Numera-v1 is a 3 Billion parameter transformer-based causal decoder model designed for high-quality text generation and conceptual coherence. It is part of the Numera series focusing on structural integrity and advanced architectural optimization.
29
+
30
+ ## Model Details
31
+
32
+ - **Model Name:** Numera (Gen-1)
33
+ - **Generated By:** LCDev-Numera
34
+ - **Base Architecture:** Qwen2.5
35
+ - **Parameters**: 3 Billion
36
+ - **Type:** Statistical Weight Generation
37
+ - **Date Generated:** 2026-02-20
38
+
39
+
40
+ ### Model Technical Specifications
41
+ Here are the details for Numera (Gen-1) 3b :
42
+
43
+ - Total Parameters: ~3.09 Billion
44
+ - Architecture: Qwen2.5 Family
45
+ - Layers: 36
46
+ - Attention Heads: 16 (Query) / 2 (KV - Grouped Query Attention)
47
+ - Hidden Size: 2048
48
+ - Intermediate Size (MLP): 11008
49
+ - Vocab Size: 151,936 tokens
50
+ - Context Window: 32,768 tokens
51
+ - Format: SafeTensors (Universal, safe serialization)
52
+ - Nature: Numerically Generated (Non-trained, statistical approximation)
53
+
54
+ ## Intended Use
55
+
56
+ This model is intended for research into:
57
+ - Weight space analysis of Large Language Models.
58
+ - Statistical properties of model weights.
59
+ - Experimental initialization checkpoints.
60
+
61
+ **Note:** This model is a statistical approximation and not a trained model. It may exhibit repetitive behaviors or lack specific factual knowledge.
62
+
63
+ ## Usage
64
+
65
+ You can use this model with the `transformers` library:
66
+
67
+ ```python
68
+ from transformers import AutoModelForCausalLM, AutoTokenizer
69
+
70
+ model_name = "luigicfilho/Numera-v1-3b"
71
+ tokenizer = AutoTokenizer.from_pretrained(model_name)
72
+ model = AutoModelForCausalLM.from_pretrained(model_name)
73
+
74
+ prompt = "The nature of mathematics is"
75
+ inputs = tokenizer(prompt, return_tensors="pt")
76
+ outputs = model.generate(**inputs, max_new_tokens=50)
77
+ print(tokenizer.decode(outputs[0], skip_special_tokens=True))
78
+ ```
79
+
80
+ ## License
81
+
82
+ This model is released under the MIT License.