daedalus2027 commited on
Commit
69e7537
·
verified ·
1 Parent(s): 03d35ba

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +4 -11
README.md CHANGED
@@ -10,7 +10,9 @@ tags:
10
 
11
  # Ouro-1.4B
12
 
13
- 📚 [Paper](https://huggingface.co/papers/2510.25741) • 🏠 [Project Page](https://ouro-llm.github.io/) • ⚡ [HF Hub (fork)](https://huggingface.co/daedalus2027/Ouro-1.4B-bucket)
 
 
14
 
15
  ## Model Description
16
 
@@ -19,6 +21,7 @@ tags:
19
 
20
  **Ouro-1.4B** is a 1.4 billion parameter Looped Language Model (LoopLM) that achieves exceptional parameter efficiency through iterative shared-weight computation.
21
 
 
22
 
23
  ## Key Features
24
 
@@ -112,16 +115,6 @@ print(tokenizer.decode(outputs[0], skip_special_tokens=True))
112
  ## Acknowledgments
113
 
114
  We thank [@Antizana](https://github.com/Antizana) for the KV cache fix merged from [ouro-cache-fix](https://github.com/Antizana/ouro-cache-fix), which resolved a critical compatibility issue with transformers>=4.56.0.
115
-
116
- ## Fixes Applied
117
-
118
- This fork includes the following fixes over the original ByteDance release:
119
-
120
- ### RoPE Initialization Safety
121
- The original `OuroRotaryEmbedding.__init__` called `self.rope_init_fn(self.config, device)` directly, which could fail when the target device wasn't ready (e.g., CUDA not yet initialized). The fix defers device-specific tensor creation: `inv_freq` is computed on CPU first, then moved to the target device in `forward()`. A fallback is also provided for `None` `rope_init_fn`.
122
-
123
- ### `pad_token_id` in Config
124
- Added `"pad_token_id": 0` to `config.json`, required by the `nn.Embedding(padding_idx=...)` layer. Without it, the embedding layer could misbehave under certain padding conditions.
125
  ## Citation
126
 
127
  ```bibtex
 
10
 
11
  # Ouro-1.4B
12
 
13
+ 📚 [Paper](https://huggingface.co/papers/2510.25741) • 🏠 [Project Page](https://ouro-llm.github.io/)
14
+
15
+ ![Ouro Logo](assets/logo.png)
16
 
17
  ## Model Description
18
 
 
21
 
22
  **Ouro-1.4B** is a 1.4 billion parameter Looped Language Model (LoopLM) that achieves exceptional parameter efficiency through iterative shared-weight computation.
23
 
24
+ ![Model Performance](assets/benchmark.png)
25
 
26
  ## Key Features
27
 
 
115
  ## Acknowledgments
116
 
117
  We thank [@Antizana](https://github.com/Antizana) for the KV cache fix merged from [ouro-cache-fix](https://github.com/Antizana/ouro-cache-fix), which resolved a critical compatibility issue with transformers>=4.56.0.
 
 
 
 
 
 
 
 
 
 
118
  ## Citation
119
 
120
  ```bibtex