Add files using upload-large-folder tool

Q8_0/Llama-3_1-Nemotron-Ultra-253B-v1-Q8_0-00001-of-00006.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:80278e8832dcc24c8922eb75821fc81a2714bd14660610c9301464cfd9ef6aa7
-size 49762371552
+oid sha256:d2b4e9c564a4c0a4b5fd57fbeb9f9293d69238cff7112055815536d92b02ed45
+size 49762372032

README.md

@@ -1,10 +1,10 @@
 ---
 library_name: transformers
 license: other
-base_model: nvidia/Llama-3_1-Nemotron-Ultra-253B-v1
 license_name: nvidia-open-model-license
 license_link: >-
   https://www.nvidia.com/en-us/agreements/enterprise-software/nvidia-open-model-license/
+
 pipeline_tag: text-generation
 language:
   - en
@@ -28,7 +28,7 @@ The model underwent a multi-phase post-training process to enhance both its reas
 
 This model is ready for commercial use. 
 
-For more details on how the model was trained, please see [this blog](https://developer.nvidia.com/blog/build-enterprise-ai-agents-with-advanced-open-nvidia-llama-nemotron-reasoning-models/).
+For more details on how the model was trained, please see our [technical report](https://arxiv.org/abs/2505.00949) and [blog](https://developer.nvidia.com/blog/build-enterprise-ai-agents-with-advanced-open-nvidia-llama-nemotron-reasoning-models/).
 
 ![Training Flow](./training_flowchart.png)
 
@@ -55,6 +55,7 @@ Developers designing AI Agent systems, chatbots, RAG systems, and other AI-power
 
 ## References
 
+* [\[2505.00949\] Llama-Nemotron: Efficient Reasoning Models](https://arxiv.org/abs/2505.00949)
 * [\[2502.00203\] Reward-aware Preference Optimization: A Unified Mathematical Framework for Model Alignment](https://arxiv.org/abs/2502.00203)  
 * [\[2411.19146\]Puzzle: Distillation-Based NAS for Inference-Optimized LLMs](https://arxiv.org/abs/2411.19146)  
 * [\[2503.18908\]FFN Fusion: Rethinking Sequential Computation in Large Language Models](https://arxiv.org/abs/2503.18908)
@@ -107,6 +108,7 @@ Llama-3.1-Nemotron-Ultra-253B-v1 is a general purpose reasoning and chat model i
 3. We recommend using greedy decoding (temperature 0\) for Reasoning OFF mode  
 4. We do not recommend to add additional system prompts besides the control prompt, all instructions should be put into user query  
 5. We have provided a list of prompts to use for evaluation for each benchmark where a specific template is required
+6. The model will include `<think></think>` if no reasoning was necessary in Reasoning ON model, this is expected behaviour
 
 You can try this model out through the preview API, using this link: [Llama-3\_1-Nemotron-Ultra-253B-v1](https://build.nvidia.com/nvidia/llama-3\_1-nemotron-ultra-253b-v1).
 
@@ -340,10 +342,29 @@ User Prompt Template:
 "Below is a math question. I want you to reason through the steps and then give a final answer. Your final answer should be in \boxed{}.\nQuestion: {question}"
 ```
 
+### JudgeBench
+
+| Reasoning Mode | Knowledge Score | Reasoning Score | Math Score | Coding Score | Overall Score | 
+|--------------|------------|------------|------------|------------|------------|
+| Reasoning On | 70.13 | 81.63 | 89.29 | 92.86 | 79.14 | 
+
 ## Ethical Considerations:
 
 NVIDIA believes Trustworthy AI is a shared responsibility and we have established policies and practices to enable development for a wide array of AI applications.  When downloaded or used in accordance with our terms of service, developers should work with their internal model team to ensure this model meets requirements for the relevant industry and use case and addresses unforeseen product misuse. 
 
 For more detailed information on ethical considerations for this model, please see the Model Card++ [Explainability](./EXPLAINABILITY.md), [Bias](./BIAS.md), [Safety & Security](./SAFETY_and_SECURITY.md), and [Privacy](./PRIVACY.md) Subcards.
 
-Please report security vulnerabilities or NVIDIA AI Concerns [here](https://www.nvidia.com/en-us/support/submit-security-vulnerability/).
+Please report security vulnerabilities or NVIDIA AI Concerns [here](https://www.nvidia.com/en-us/support/submit-security-vulnerability/).
+
+## Citation
+```
+@misc{bercovich2025llamanemotronefficientreasoningmodels,
+      title={Llama-Nemotron: Efficient Reasoning Models}, 
+      author={Akhiad Bercovich and Itay Levy and Izik Golan and Mohammad Dabbah and Ran El-Yaniv and Omri Puny and Ido Galil and Zach Moshe and Tomer Ronen and Najeeb Nabwani and Ido Shahaf and Oren Tropp and Ehud Karpas and Ran Zilberstein and Jiaqi Zeng and Soumye Singhal and Alexander Bukharin and Yian Zhang and Tugrul Konuk and Gerald Shen and Ameya Sunil Mahabaleshwarkar and Bilal Kartal and Yoshi Suhara and Olivier Delalleau and Zijia Chen and Zhilin Wang and David Mosallanezhad and Adi Renduchintala and Haifeng Qian and Dima Rekesh and Fei Jia and Somshubra Majumdar and Vahid Noroozi and Wasi Uddin Ahmad and Sean Narenthiran and Aleksander Ficek and Mehrzad Samadi and Jocelyn Huang and Siddhartha Jain and Igor Gitman and Ivan Moshkov and Wei Du and Shubham Toshniwal and George Armstrong and Branislav Kisacanin and Matvei Novikov and Daria Gitman and Evelina Bakhturina and Jane Polak Scowcroft and John Kamalu and Dan Su and Kezhi Kong and Markus Kliegl and Rabeeh Karimi and Ying Lin and Sanjeev Satheesh and Jupinder Parmar and Pritam Gundecha and Brandon Norick and Joseph Jennings and Shrimai Prabhumoye and Syeda Nahida Akter and Mostofa Patwary and Abhinav Khattar and Deepak Narayanan and Roger Waleffe and Jimmy Zhang and Bor-Yiing Su and Guyue Huang and Terry Kong and Parth Chadha and Sahil Jain and Christine Harvey and Elad Segal and Jining Huang and Sergey Kashirsky and Robert McQueen and Izzy Putterman and George Lam and Arun Venkatesan and Sherry Wu and Vinh Nguyen and Manoj Kilaru and Andrew Wang and Anna Warno and Abhilash Somasamudramath and Sandip Bhaskar and Maka Dong and Nave Assaf and Shahar Mor and Omer Ullman Argov and Scot Junkin and Oleksandr Romanenko and Pedro Larroy and Monika Katariya and Marco Rovinelli and Viji Balas and Nicholas Edelman and Anahita Bhiwandiwalla and Muthu Subramaniam and Smita Ithape and Karthik Ramamoorthy and Yuting Wu and Suguna Varshini Velury and Omri Almog and Joyjit Daw and Denys Fridman and Erick Galinkin and Michael Evans and Katherine Luna and Leon Derczynski and Nikki Pope and Eileen Long and Seth Schneider and Guillermo Siman and Tomasz Grzegorzek and Pablo Ribalta and Monika Katariya and Joey Conway and Trisha Saar and Ann Guan and Krzysztof Pawelec and Shyamala Prayaga and Oleksii Kuchaiev and Boris Ginsburg and Oluwatobi Olabiyi and Kari Briski and Jonathan Cohen and Bryan Catanzaro and Jonah Alben and Yonatan Geifman and Eric Chung and Chris Alexiuk},
+      year={2025},
+      eprint={2505.00949},
+      archivePrefix={arXiv},
+      primaryClass={cs.CL},
+      url={https://arxiv.org/abs/2505.00949}, 
+}
+```

config.json

@@ -1,5 +1,4 @@
 {
-  "_name_or_path": "llama_nemotron_ultra",
   "architectures": [
     "DeciLMForCausalLM"
   ],
@@ -2943,6 +2942,7 @@
   "num_attention_heads": 128,
   "num_hidden_layers": 162,
   "num_key_value_heads": null,
+  "pad_token_id": 128004,
   "pretraining_tp": 1,
   "rms_norm_eps": 1e-05,
   "rope_scaling": {
@@ -2955,7 +2955,8 @@
   "rope_theta": 500000.0,
   "tie_word_embeddings": false,
   "torch_dtype": "bfloat16",
-  "transformers_version": "4.45.1",
+  "transformers_version": "4.52.3",
+  "unsloth_fixed": true,
   "use_cache": true,
   "vocab_size": 128256
 }