Hugging Face's logo

BennyDaBall
/
Qwen-Image-2.1-NVFP4

Text-to-Image
Diffusion Single File
qwen-image
qwen-image-2.1
nvfp4
comfyui
quantized
image-editing
rtx-5090
Model card Files
xet
 Community
BennyDaBall commited on
Commit
67d5bfa
·
verified ·
1 Parent(s): 268c71e

Add native NVFP4 candidate weights and source manifests

Browse files
Files changed (7) hide show
  1. LICENSE +55 -0
  2. NOTICE +14 -0
  3. diffusion_models/prism_image_2.1_nvfp4.manifest.json +2596 -0
  4. diffusion_models/prism_image_2.1_nvfp4.safetensors +3 -0
  5. text_encoders/prism_qwen3vl_8b_nvfp4.manifest.json +0 -0
  6. text_encoders/prism_qwen3vl_8b_nvfp4.safetensors +3 -0
  7. vae/qwen_image_2.1_vae_bf16.safetensors +3 -0
LICENSE ADDED
@@ -0,0 +1,55 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ Qwen RESEARCH LICENSE AGREEMENT
2
+
3
+ Qwen RESEARCH LICENSE AGREEMENT Release Date: September 20, 2026
4
+
5
+ By clicking to agree or by using or distributing any portion or element of the Qwen Materials, you will be deemed to have recognized and accepted the content of this Agreement, which is effective immediately.
6
+
7
+ 1. Definitions
8
+ a. This Qwen RESEARCH LICENSE AGREEMENT (this "Agreement") shall mean the terms and conditions for use, reproduction, distribution and modification of the Materials as defined by this Agreement.
9
+ b. "We" (or "Us") shall mean Hangzhou Tongyi Laboratory Technology Co., Ltd.
10
+ c. "You" (or "Your") shall mean a natural person or legal entity exercising the rights granted by this Agreement and/or using the Materials for any purpose and in any field of use.
11
+ d. "Third Parties" shall mean individuals or legal entities that are not under common control with us or you.
12
+ e. "Qwen" shall mean the large language models, diffusion models, and software and algorithms, consisting of trained model weights, parameters (including optimizer states), machine-learning model code, inference-enabling code, training-enabling code, fine-tuning enabling code and other elements of the foregoing distributed by us.
13
+ f. "Materials" shall mean, collectively, our proprietary Qwen and Documentation (and any portion thereof) made available under this Agreement.
14
+ g. "Source" form shall mean the preferred form for making modifications, including but not limited to model source code, documentation source, and configuration files.
15
+ h. "Object" form shall mean any form resulting from mechanical transformation or translation of a Source form, including but not limited to compiled object code, generated documentation, and conversions to other media types.
16
+ i. "Non-Commercial" shall mean for research or evaluation purposes only.
17
+
18
+ 2. Grant of Rights
19
+ a. You are granted a non-exclusive, worldwide, non-transferable and royalty-free limited license under our intellectual property or other rights owned by us embodied in the Materials to use, reproduce, distribute, copy, create derivative works of, and make modifications to the Materials FOR NON-COMMERCIAL PURPOSES ONLY.
20
+ b. You shall not use the Materials for any commercial purpose without obtaining a separate commercial license from us. If you wish to use the Materials commercially, you shall request a license from us at model-business@notice.qwencloud.com.
21
+
22
+ 3. Redistribution
23
+ Subject to Section 2 (Grant of Rights), you may distribute copies or make the Materials, or derivative works thereof, available as part of a product or service that contains any of them, with or without modifications, and in Source or Object form, provided that you meet the following conditions:
24
+ a. You shall give any other recipients of the Materials or derivative works a copy of this Agreement;
25
+ b. You shall cause any modified files to carry prominent notices stating that you changed the files;
26
+ c. You shall retain in all copies of the Materials that you distribute the following attribution notices within a "Notice" text file distributed as a part of such copies: "Qwen is licensed under the Qwen RESEARCH LICENSE AGREEMENT, Copyright (c) 2026 Hangzhou Tongyi Laboratory Technology Co., Ltd. All Rights Reserved."; and
27
+ d. You may add your own copyright statement to your modifications and may provide additional or different license terms and conditions for use, reproduction, or distribution of your modifications, or for any such derivative works as a whole, provided your use, reproduction, and distribution of the work otherwise complies with the terms and conditions of this Agreement.
28
+
29
+ 4. Rules of use
30
+ a. The Materials may be subject to export controls or restrictions in China, the United States or other countries or regions. You shall comply with applicable laws and regulations in your use of the Materials.
31
+ b. If you use the Materials or any outputs or results therefrom to create, train, fine-tune, or improve an AI model that is distributed or made available, you shall prominently display “Built with Qwen” or “Improved using Qwen” in the related product documentation.
32
+ c. You shall not use "Qwen" as the primary name or identifier of any derivative works or products; reasonable descriptive use (e.g., "fine-tuned from Qwen Image") is permitted.
33
+
34
+ 5. Intellectual Property
35
+ a. We retain ownership of all intellectual property rights in and to the Materials and derivatives made by or for us. Conditioned upon compliance with the terms and conditions of this Agreement, with respect to any derivative works and modifications of the Materials that are made by you, you are and will be the owner of such derivative works and modifications.
36
+ b. No trademark license is granted to use the trade names, trademarks, service marks, or product names of us, except as required to fulfill notice requirements under this Agreement or as required for reasonable and customary use in describing and redistributing the Materials.
37
+ c. If you commence a lawsuit or other proceedings (including a cross-claim or counterclaim in a lawsuit) against us or any entity alleging that the Materials or any output therefrom, or any part of the foregoing, infringe any intellectual property or other right owned or licensable by you, then all licenses granted to you under this Agreement shall terminate as of the date such lawsuit or other proceeding is commenced or brought.
38
+
39
+ 6. Disclaimer of Warranty and Limitation of Liability
40
+ a. We are not obligated to support, update, provide training for, or develop any further version of the Qwen Materials or to grant any license thereto.
41
+ b. THE MATERIALS ARE PROVIDED "AS IS" WITHOUT ANY EXPRESS OR IMPLIED WARRANTY OF ANY KIND INCLUDING WARRANTIES OF MERCHANTABILITY, NONINFRINGEMENT, OR FITNESS FOR A PARTICULAR PURPOSE. WE MAKE NO WARRANTY AND ASSUME NO RESPONSIBILITY FOR THE SAFETY OR STABILITY OF THE MATERIALS AND ANY OUTPUT THEREFROM.
42
+ c. IN NO EVENT SHALL WE BE LIABLE TO YOU FOR ANY DAMAGES, INCLUDING, BUT NOT LIMITED TO ANY DIRECT, OR INDIRECT, SPECIAL OR CONSEQUENTIAL DAMAGES ARISING FROM YOUR USE OR INABILITY TO USE THE MATERIALS OR ANY OUTPUT OF IT, NO MATTER HOW IT’S CAUSED.
43
+ d. You will defend, indemnify and hold harmless us from and against any claim by any third party arising out of or related to your use or distribution of the Materials.
44
+
45
+ 7. Survival and Termination.
46
+ a. The term of this Agreement shall commence upon your acceptance of this Agreement or access to the Materials and will continue in full force and effect until terminated in accordance with the terms and conditions herein.
47
+ b. We may terminate this Agreement if you breach any of the terms or conditions of this Agreement. Upon termination of this Agreement, you must delete and cease use of the Materials. Sections 6 and 8 shall survive the termination of this Agreement.
48
+
49
+ 8. Governing Law and Jurisdiction.
50
+ a. This Agreement and any dispute arising out of or relating to it will be governed by the laws of China, without regard to conflict of law principles, and the UN Convention on Contracts for the International Sale of Goods does not apply to this Agreement.
51
+ b. The People's Courts in Hangzhou City shall have exclusive jurisdiction over any dispute arising out of this Agreement.
52
+
53
+ 9. Other Terms and Conditions.
54
+ a. Any arrangements, understandings, or agreements regarding the Material not stated herein are separate from and independent of the terms and conditions of this Agreement. You shall request a separate license from us, if you use the Materials in ways not expressly agreed to in this Agreement.
55
+ b. We shall not be bound by any additional or different terms or conditions communicated by you unless expressly agreed.
NOTICE ADDED
@@ -0,0 +1,14 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ Built with Qwen
2
+
3
+ Qwen is licensed under the Qwen RESEARCH LICENSE AGREEMENT, Copyright (c) 2026 Hangzhou Tongyi Laboratory Technology Co., Ltd. All Rights Reserved.
4
+
5
+ BennyDaBall modified the official BF16 image transformer and Qwen3-VL encoder
6
+ checkpoints on 2026-09-20 by converting selected linear weights to native NVFP4.
7
+ The per-file manifests identify changed tensors and unchanged protected tensors.
8
+ The Qwen Image 2.1 VAE is redistributed unchanged.
9
+
10
+ Source: Comfy-Org/Qwen-Image-2.1
11
+ Revision: ace0edeb3791a594ddfa36ed5f41a178a394e921
12
+
13
+ This is an independent conversion, not an official Qwen or Comfy-Org release.
14
+ Model use and redistribution remain subject to the included research license.
diffusion_models/prism_image_2.1_nvfp4.manifest.json ADDED
@@ -0,0 +1,2596 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "source": "qwen_image_2.1_bf16.safetensors",
3
+ "source_sha256": "89f4158d066cc33906a199fca85634f766892dd78f49b6698dabf187ac86c4bc",
4
+ "output": "prism_image_2.1_nvfp4.safetensors",
5
+ "output_sha256": "4fdbaec94c19f7b8888f1e1ddbae05354c014492f9b2547b1cd8dca0ce923526",
6
+ "output_bytes": 4197574664,
7
+ "nvfp4_matrices": 192,
8
+ "elapsed_seconds": 22.873350399997435,
9
+ "tensors": [
10
+ {
11
+ "name": "img_in.weight",
12
+ "shape": [
13
+ 4096,
14
+ 64
15
+ ],
16
+ "source_dtype": "torch.bfloat16",
17
+ "storage": "torch.bfloat16",
18
+ "sha256": "34310ebf0edb66ef00944eb6fd46e7ce70e7df7928d03283df0a28dd8fab2c68"
19
+ },
20
+ {
21
+ "name": "modulation.1.weight",
22
+ "shape": [
23
+ 16384,
24
+ 4096
25
+ ],
26
+ "source_dtype": "torch.bfloat16",
27
+ "storage": "torch.bfloat16",
28
+ "sha256": "4360117d34f9659f36d154af517f54dc7f521ea914a1894a837d660eb8048e0f"
29
+ },
30
+ {
31
+ "name": "norm_out.linear.weight",
32
+ "shape": [
33
+ 4096,
34
+ 4096
35
+ ],
36
+ "source_dtype": "torch.bfloat16",
37
+ "storage": "torch.bfloat16",
38
+ "sha256": "e9bcf4457d9deb7a0fd874fdfa7c950efcf36f7442b4e34878e3933524514ad3"
39
+ },
40
+ {
41
+ "name": "proj_out.weight",
42
+ "shape": [
43
+ 64,
44
+ 4096
45
+ ],
46
+ "source_dtype": "torch.bfloat16",
47
+ "storage": "torch.bfloat16",
48
+ "sha256": "36cc3c201fbe549b207588243e4ed9995582fa506db8313b3c6b30f0e26d7e9d"
49
+ },
50
+ {
51
+ "name": "time_text_embed.timestep_embedder.linear_1.weight",
52
+ "shape": [
53
+ 4096,
54
+ 256
55
+ ],
56
+ "source_dtype": "torch.bfloat16",
57
+ "storage": "torch.bfloat16",
58
+ "sha256": "c15dc973e402662d4dc7d2b8a5d256080f10d39e5aeec563723c327d22a3a712"
59
+ },
60
+ {
61
+ "name": "time_text_embed.timestep_embedder.linear_2.weight",
62
+ "shape": [
63
+ 4096,
64
+ 4096
65
+ ],
66
+ "source_dtype": "torch.bfloat16",
67
+ "storage": "torch.bfloat16",
68
+ "sha256": "c96b67bbcb7c19d2a31a517959c3090adfa420bc16735810abf0367f20a71615"
69
+ },
70
+ {
71
+ "name": "transformer_blocks.0.attn.norm_k.weight",
72
+ "shape": [
73
+ 128
74
+ ],
75
+ "source_dtype": "torch.bfloat16",
76
+ "storage": "torch.bfloat16",
77
+ "sha256": "572f201a7f1f0eb25c33d65be6a3afc6e237af9753c94cb0c924c54622d33277"
78
+ },
79
+ {
80
+ "name": "transformer_blocks.0.attn.norm_q.weight",
81
+ "shape": [
82
+ 128
83
+ ],
84
+ "source_dtype": "torch.bfloat16",
85
+ "storage": "torch.bfloat16",
86
+ "sha256": "3faf374413f8b2585700421c2f9bb39c1e846227f105e3ff10e1a8220ffde022"
87
+ },
88
+ {
89
+ "name": "transformer_blocks.0.attn.to_k.weight",
90
+ "shape": [
91
+ 4096,
92
+ 4096
93
+ ],
94
+ "source_dtype": "torch.bfloat16",
95
+ "storage": "nvfp4",
96
+ "relative_rmse": 0.09442301839590073
97
+ },
98
+ {
99
+ "name": "transformer_blocks.0.attn.to_out.0.weight",
100
+ "shape": [
101
+ 4096,
102
+ 4096
103
+ ],
104
+ "source_dtype": "torch.bfloat16",
105
+ "storage": "nvfp4",
106
+ "relative_rmse": 0.09725861996412277
107
+ },
108
+ {
109
+ "name": "transformer_blocks.0.attn.to_q.weight",
110
+ "shape": [
111
+ 4096,
112
+ 4096
113
+ ],
114
+ "source_dtype": "torch.bfloat16",
115
+ "storage": "nvfp4",
116
+ "relative_rmse": 0.0944296196103096
117
+ },
118
+ {
119
+ "name": "transformer_blocks.0.attn.to_v.weight",
120
+ "shape": [
121
+ 4096,
122
+ 4096
123
+ ],
124
+ "source_dtype": "torch.bfloat16",
125
+ "storage": "nvfp4",
126
+ "relative_rmse": 0.09454155713319778
127
+ },
128
+ {
129
+ "name": "transformer_blocks.0.img_mlp.gate_up.weight",
130
+ "shape": [
131
+ 24576,
132
+ 4096
133
+ ],
134
+ "source_dtype": "torch.bfloat16",
135
+ "storage": "nvfp4",
136
+ "relative_rmse": 0.0946829617023468
137
+ },
138
+ {
139
+ "name": "transformer_blocks.0.img_mlp.out.weight",
140
+ "shape": [
141
+ 4096,
142
+ 12288
143
+ ],
144
+ "source_dtype": "torch.bfloat16",
145
+ "storage": "nvfp4",
146
+ "relative_rmse": 0.09461568295955658
147
+ },
148
+ {
149
+ "name": "transformer_blocks.1.attn.norm_k.weight",
150
+ "shape": [
151
+ 128
152
+ ],
153
+ "source_dtype": "torch.bfloat16",
154
+ "storage": "torch.bfloat16",
155
+ "sha256": "92458b847b05a1da9cd8087668002bf9b31e9bdf4319b41082ac12a55eb556e0"
156
+ },
157
+ {
158
+ "name": "transformer_blocks.1.attn.norm_q.weight",
159
+ "shape": [
160
+ 128
161
+ ],
162
+ "source_dtype": "torch.bfloat16",
163
+ "storage": "torch.bfloat16",
164
+ "sha256": "d5e3edf26d8478f4bada9caae2b2b6b86b22338c2c7a6c6abfad38f337f8f246"
165
+ },
166
+ {
167
+ "name": "transformer_blocks.1.attn.to_k.weight",
168
+ "shape": [
169
+ 4096,
170
+ 4096
171
+ ],
172
+ "source_dtype": "torch.bfloat16",
173
+ "storage": "nvfp4",
174
+ "relative_rmse": 0.09432397782802582
175
+ },
176
+ {
177
+ "name": "transformer_blocks.1.attn.to_out.0.weight",
178
+ "shape": [
179
+ 4096,
180
+ 4096
181
+ ],
182
+ "source_dtype": "torch.bfloat16",
183
+ "storage": "nvfp4",
184
+ "relative_rmse": 0.09523904323577881
185
+ },
186
+ {
187
+ "name": "transformer_blocks.1.attn.to_q.weight",
188
+ "shape": [
189
+ 4096,
190
+ 4096
191
+ ],
192
+ "source_dtype": "torch.bfloat16",
193
+ "storage": "nvfp4",
194
+ "relative_rmse": 0.09456050395965576
195
+ },
196
+ {
197
+ "name": "transformer_blocks.1.attn.to_v.weight",
198
+ "shape": [
199
+ 4096,
200
+ 4096
201
+ ],
202
+ "source_dtype": "torch.bfloat16",
203
+ "storage": "nvfp4",
204
+ "relative_rmse": 0.09415525943040848
205
+ },
206
+ {
207
+ "name": "transformer_blocks.1.img_mlp.gate_up.weight",
208
+ "shape": [
209
+ 24576,
210
+ 4096
211
+ ],
212
+ "source_dtype": "torch.bfloat16",
213
+ "storage": "nvfp4",
214
+ "relative_rmse": 0.0945473164319992
215
+ },
216
+ {
217
+ "name": "transformer_blocks.1.img_mlp.out.weight",
218
+ "shape": [
219
+ 4096,
220
+ 12288
221
+ ],
222
+ "source_dtype": "torch.bfloat16",
223
+ "storage": "nvfp4",
224
+ "relative_rmse": 0.0944310873746872
225
+ },
226
+ {
227
+ "name": "transformer_blocks.10.attn.norm_k.weight",
228
+ "shape": [
229
+ 128
230
+ ],
231
+ "source_dtype": "torch.bfloat16",
232
+ "storage": "torch.bfloat16",
233
+ "sha256": "89dd760dbc3d89539c68b4c79e1b1c13feb28a4b334cc518717d6f25a5330c03"
234
+ },
235
+ {
236
+ "name": "transformer_blocks.10.attn.norm_q.weight",
237
+ "shape": [
238
+ 128
239
+ ],
240
+ "source_dtype": "torch.bfloat16",
241
+ "storage": "torch.bfloat16",
242
+ "sha256": "f3ee1eaebb22009e5f372b32269f48683f4c79759c0a941be40b9f7778a39b3d"
243
+ },
244
+ {
245
+ "name": "transformer_blocks.10.attn.to_k.weight",
246
+ "shape": [
247
+ 4096,
248
+ 4096
249
+ ],
250
+ "source_dtype": "torch.bfloat16",
251
+ "storage": "nvfp4",
252
+ "relative_rmse": 0.09438031911849976
253
+ },
254
+ {
255
+ "name": "transformer_blocks.10.attn.to_out.0.weight",
256
+ "shape": [
257
+ 4096,
258
+ 4096
259
+ ],
260
+ "source_dtype": "torch.bfloat16",
261
+ "storage": "nvfp4",
262
+ "relative_rmse": 0.09511259198188782
263
+ },
264
+ {
265
+ "name": "transformer_blocks.10.attn.to_q.weight",
266
+ "shape": [
267
+ 4096,
268
+ 4096
269
+ ],
270
+ "source_dtype": "torch.bfloat16",
271
+ "storage": "nvfp4",
272
+ "relative_rmse": 0.09445391595363617
273
+ },
274
+ {
275
+ "name": "transformer_blocks.10.attn.to_v.weight",
276
+ "shape": [
277
+ 4096,
278
+ 4096
279
+ ],
280
+ "source_dtype": "torch.bfloat16",
281
+ "storage": "nvfp4",
282
+ "relative_rmse": 0.09419218450784683
283
+ },
284
+ {
285
+ "name": "transformer_blocks.10.img_mlp.gate_up.weight",
286
+ "shape": [
287
+ 24576,
288
+ 4096
289
+ ],
290
+ "source_dtype": "torch.bfloat16",
291
+ "storage": "nvfp4",
292
+ "relative_rmse": 0.09455808252096176
293
+ },
294
+ {
295
+ "name": "transformer_blocks.10.img_mlp.out.weight",
296
+ "shape": [
297
+ 4096,
298
+ 12288
299
+ ],
300
+ "source_dtype": "torch.bfloat16",
301
+ "storage": "nvfp4",
302
+ "relative_rmse": 0.09482181072235107
303
+ },
304
+ {
305
+ "name": "transformer_blocks.11.attn.norm_k.weight",
306
+ "shape": [
307
+ 128
308
+ ],
309
+ "source_dtype": "torch.bfloat16",
310
+ "storage": "torch.bfloat16",
311
+ "sha256": "c738b8925971f5f3cce78ef067876764565a358d82605a9d59479712d421cb2d"
312
+ },
313
+ {
314
+ "name": "transformer_blocks.11.attn.norm_q.weight",
315
+ "shape": [
316
+ 128
317
+ ],
318
+ "source_dtype": "torch.bfloat16",
319
+ "storage": "torch.bfloat16",
320
+ "sha256": "59cdf03f52fc4dced1699703c6303847638b1c0b5ec4996abb5e49d323c5b400"
321
+ },
322
+ {
323
+ "name": "transformer_blocks.11.attn.to_k.weight",
324
+ "shape": [
325
+ 4096,
326
+ 4096
327
+ ],
328
+ "source_dtype": "torch.bfloat16",
329
+ "storage": "nvfp4",
330
+ "relative_rmse": 0.09461991488933563
331
+ },
332
+ {
333
+ "name": "transformer_blocks.11.attn.to_out.0.weight",
334
+ "shape": [
335
+ 4096,
336
+ 4096
337
+ ],
338
+ "source_dtype": "torch.bfloat16",
339
+ "storage": "nvfp4",
340
+ "relative_rmse": 0.09524192661046982
341
+ },
342
+ {
343
+ "name": "transformer_blocks.11.attn.to_q.weight",
344
+ "shape": [
345
+ 4096,
346
+ 4096
347
+ ],
348
+ "source_dtype": "torch.bfloat16",
349
+ "storage": "nvfp4",
350
+ "relative_rmse": 0.09446550160646439
351
+ },
352
+ {
353
+ "name": "transformer_blocks.11.attn.to_v.weight",
354
+ "shape": [
355
+ 4096,
356
+ 4096
357
+ ],
358
+ "source_dtype": "torch.bfloat16",
359
+ "storage": "nvfp4",
360
+ "relative_rmse": 0.09410617500543594
361
+ },
362
+ {
363
+ "name": "transformer_blocks.11.img_mlp.gate_up.weight",
364
+ "shape": [
365
+ 24576,
366
+ 4096
367
+ ],
368
+ "source_dtype": "torch.bfloat16",
369
+ "storage": "nvfp4",
370
+ "relative_rmse": 0.09447803348302841
371
+ },
372
+ {
373
+ "name": "transformer_blocks.11.img_mlp.out.weight",
374
+ "shape": [
375
+ 4096,
376
+ 12288
377
+ ],
378
+ "source_dtype": "torch.bfloat16",
379
+ "storage": "nvfp4",
380
+ "relative_rmse": 0.09461723268032074
381
+ },
382
+ {
383
+ "name": "transformer_blocks.12.attn.norm_k.weight",
384
+ "shape": [
385
+ 128
386
+ ],
387
+ "source_dtype": "torch.bfloat16",
388
+ "storage": "torch.bfloat16",
389
+ "sha256": "515145e5eb450bd0615815dc8728ab1e4922bc7f038853eaf61d8e4b110876dd"
390
+ },
391
+ {
392
+ "name": "transformer_blocks.12.attn.norm_q.weight",
393
+ "shape": [
394
+ 128
395
+ ],
396
+ "source_dtype": "torch.bfloat16",
397
+ "storage": "torch.bfloat16",
398
+ "sha256": "ab59bae2c2af0dafa123601c0411f2d24307f533691ce36ccf8bc694da54f72a"
399
+ },
400
+ {
401
+ "name": "transformer_blocks.12.attn.to_k.weight",
402
+ "shape": [
403
+ 4096,
404
+ 4096
405
+ ],
406
+ "source_dtype": "torch.bfloat16",
407
+ "storage": "nvfp4",
408
+ "relative_rmse": 0.09440026432275772
409
+ },
410
+ {
411
+ "name": "transformer_blocks.12.attn.to_out.0.weight",
412
+ "shape": [
413
+ 4096,
414
+ 4096
415
+ ],
416
+ "source_dtype": "torch.bfloat16",
417
+ "storage": "nvfp4",
418
+ "relative_rmse": 0.09543906152248383
419
+ },
420
+ {
421
+ "name": "transformer_blocks.12.attn.to_q.weight",
422
+ "shape": [
423
+ 4096,
424
+ 4096
425
+ ],
426
+ "source_dtype": "torch.bfloat16",
427
+ "storage": "nvfp4",
428
+ "relative_rmse": 0.09447003901004791
429
+ },
430
+ {
431
+ "name": "transformer_blocks.12.attn.to_v.weight",
432
+ "shape": [
433
+ 4096,
434
+ 4096
435
+ ],
436
+ "source_dtype": "torch.bfloat16",
437
+ "storage": "nvfp4",
438
+ "relative_rmse": 0.09415226429700851
439
+ },
440
+ {
441
+ "name": "transformer_blocks.12.img_mlp.gate_up.weight",
442
+ "shape": [
443
+ 24576,
444
+ 4096
445
+ ],
446
+ "source_dtype": "torch.bfloat16",
447
+ "storage": "nvfp4",
448
+ "relative_rmse": 0.09448692947626114
449
+ },
450
+ {
451
+ "name": "transformer_blocks.12.img_mlp.out.weight",
452
+ "shape": [
453
+ 4096,
454
+ 12288
455
+ ],
456
+ "source_dtype": "torch.bfloat16",
457
+ "storage": "nvfp4",
458
+ "relative_rmse": 0.09464255720376968
459
+ },
460
+ {
461
+ "name": "transformer_blocks.13.attn.norm_k.weight",
462
+ "shape": [
463
+ 128
464
+ ],
465
+ "source_dtype": "torch.bfloat16",
466
+ "storage": "torch.bfloat16",
467
+ "sha256": "bf992f464eba69ccaacc832235583c4a617724483c15c0b808b5bd29d39037a0"
468
+ },
469
+ {
470
+ "name": "transformer_blocks.13.attn.norm_q.weight",
471
+ "shape": [
472
+ 128
473
+ ],
474
+ "source_dtype": "torch.bfloat16",
475
+ "storage": "torch.bfloat16",
476
+ "sha256": "d69e4d8abe599ea9730fb81f74d527a7ee7c1eced6dd530f33eaa178d1fa3ec7"
477
+ },
478
+ {
479
+ "name": "transformer_blocks.13.attn.to_k.weight",
480
+ "shape": [
481
+ 4096,
482
+ 4096
483
+ ],
484
+ "source_dtype": "torch.bfloat16",
485
+ "storage": "nvfp4",
486
+ "relative_rmse": 0.09427323937416077
487
+ },
488
+ {
489
+ "name": "transformer_blocks.13.attn.to_out.0.weight",
490
+ "shape": [
491
+ 4096,
492
+ 4096
493
+ ],
494
+ "source_dtype": "torch.bfloat16",
495
+ "storage": "nvfp4",
496
+ "relative_rmse": 0.09524256736040115
497
+ },
498
+ {
499
+ "name": "transformer_blocks.13.attn.to_q.weight",
500
+ "shape": [
501
+ 4096,
502
+ 4096
503
+ ],
504
+ "source_dtype": "torch.bfloat16",
505
+ "storage": "nvfp4",
506
+ "relative_rmse": 0.09445545077323914
507
+ },
508
+ {
509
+ "name": "transformer_blocks.13.attn.to_v.weight",
510
+ "shape": [
511
+ 4096,
512
+ 4096
513
+ ],
514
+ "source_dtype": "torch.bfloat16",
515
+ "storage": "nvfp4",
516
+ "relative_rmse": 0.09404991567134857
517
+ },
518
+ {
519
+ "name": "transformer_blocks.13.img_mlp.gate_up.weight",
520
+ "shape": [
521
+ 24576,
522
+ 4096
523
+ ],
524
+ "source_dtype": "torch.bfloat16",
525
+ "storage": "nvfp4",
526
+ "relative_rmse": 0.09441465139389038
527
+ },
528
+ {
529
+ "name": "transformer_blocks.13.img_mlp.out.weight",
530
+ "shape": [
531
+ 4096,
532
+ 12288
533
+ ],
534
+ "source_dtype": "torch.bfloat16",
535
+ "storage": "nvfp4",
536
+ "relative_rmse": 0.09465336799621582
537
+ },
538
+ {
539
+ "name": "transformer_blocks.14.attn.norm_k.weight",
540
+ "shape": [
541
+ 128
542
+ ],
543
+ "source_dtype": "torch.bfloat16",
544
+ "storage": "torch.bfloat16",
545
+ "sha256": "dddc04478d062739db7d47f38fc403054d7ebb6689a41b47eb357b6aefd2280f"
546
+ },
547
+ {
548
+ "name": "transformer_blocks.14.attn.norm_q.weight",
549
+ "shape": [
550
+ 128
551
+ ],
552
+ "source_dtype": "torch.bfloat16",
553
+ "storage": "torch.bfloat16",
554
+ "sha256": "5957f7c5eb010c214df3cf6214d87c916b331926a726c43d7bc312b211a3a577"
555
+ },
556
+ {
557
+ "name": "transformer_blocks.14.attn.to_k.weight",
558
+ "shape": [
559
+ 4096,
560
+ 4096
561
+ ],
562
+ "source_dtype": "torch.bfloat16",
563
+ "storage": "nvfp4",
564
+ "relative_rmse": 0.09433333575725555
565
+ },
566
+ {
567
+ "name": "transformer_blocks.14.attn.to_out.0.weight",
568
+ "shape": [
569
+ 4096,
570
+ 4096
571
+ ],
572
+ "source_dtype": "torch.bfloat16",
573
+ "storage": "nvfp4",
574
+ "relative_rmse": 0.09543435275554657
575
+ },
576
+ {
577
+ "name": "transformer_blocks.14.attn.to_q.weight",
578
+ "shape": [
579
+ 4096,
580
+ 4096
581
+ ],
582
+ "source_dtype": "torch.bfloat16",
583
+ "storage": "nvfp4",
584
+ "relative_rmse": 0.0944102481007576
585
+ },
586
+ {
587
+ "name": "transformer_blocks.14.attn.to_v.weight",
588
+ "shape": [
589
+ 4096,
590
+ 4096
591
+ ],
592
+ "source_dtype": "torch.bfloat16",
593
+ "storage": "nvfp4",
594
+ "relative_rmse": 0.09410250931978226
595
+ },
596
+ {
597
+ "name": "transformer_blocks.14.img_mlp.gate_up.weight",
598
+ "shape": [
599
+ 24576,
600
+ 4096
601
+ ],
602
+ "source_dtype": "torch.bfloat16",
603
+ "storage": "nvfp4",
604
+ "relative_rmse": 0.0944635346531868
605
+ },
606
+ {
607
+ "name": "transformer_blocks.14.img_mlp.out.weight",
608
+ "shape": [
609
+ 4096,
610
+ 12288
611
+ ],
612
+ "source_dtype": "torch.bfloat16",
613
+ "storage": "nvfp4",
614
+ "relative_rmse": 0.09459885954856873
615
+ },
616
+ {
617
+ "name": "transformer_blocks.15.attn.norm_k.weight",
618
+ "shape": [
619
+ 128
620
+ ],
621
+ "source_dtype": "torch.bfloat16",
622
+ "storage": "torch.bfloat16",
623
+ "sha256": "65470fddf382b681da0afef7172ec8b30499e36935c921f058498e7a3f827dc7"
624
+ },
625
+ {
626
+ "name": "transformer_blocks.15.attn.norm_q.weight",
627
+ "shape": [
628
+ 128
629
+ ],
630
+ "source_dtype": "torch.bfloat16",
631
+ "storage": "torch.bfloat16",
632
+ "sha256": "3f7664105a6c56532b60a8e1893b907c2f5473f735e290ae00ee33594756a7c1"
633
+ },
634
+ {
635
+ "name": "transformer_blocks.15.attn.to_k.weight",
636
+ "shape": [
637
+ 4096,
638
+ 4096
639
+ ],
640
+ "source_dtype": "torch.bfloat16",
641
+ "storage": "nvfp4",
642
+ "relative_rmse": 0.09426062554121017
643
+ },
644
+ {
645
+ "name": "transformer_blocks.15.attn.to_out.0.weight",
646
+ "shape": [
647
+ 4096,
648
+ 4096
649
+ ],
650
+ "source_dtype": "torch.bfloat16",
651
+ "storage": "nvfp4",
652
+ "relative_rmse": 0.09513749182224274
653
+ },
654
+ {
655
+ "name": "transformer_blocks.15.attn.to_q.weight",
656
+ "shape": [
657
+ 4096,
658
+ 4096
659
+ ],
660
+ "source_dtype": "torch.bfloat16",
661
+ "storage": "nvfp4",
662
+ "relative_rmse": 0.09444401413202286
663
+ },
664
+ {
665
+ "name": "transformer_blocks.15.attn.to_v.weight",
666
+ "shape": [
667
+ 4096,
668
+ 4096
669
+ ],
670
+ "source_dtype": "torch.bfloat16",
671
+ "storage": "nvfp4",
672
+ "relative_rmse": 0.09422986209392548
673
+ },
674
+ {
675
+ "name": "transformer_blocks.15.img_mlp.gate_up.weight",
676
+ "shape": [
677
+ 24576,
678
+ 4096
679
+ ],
680
+ "source_dtype": "torch.bfloat16",
681
+ "storage": "nvfp4",
682
+ "relative_rmse": 0.09437613189220428
683
+ },
684
+ {
685
+ "name": "transformer_blocks.15.img_mlp.out.weight",
686
+ "shape": [
687
+ 4096,
688
+ 12288
689
+ ],
690
+ "source_dtype": "torch.bfloat16",
691
+ "storage": "nvfp4",
692
+ "relative_rmse": 0.09464667737483978
693
+ },
694
+ {
695
+ "name": "transformer_blocks.16.attn.norm_k.weight",
696
+ "shape": [
697
+ 128
698
+ ],
699
+ "source_dtype": "torch.bfloat16",
700
+ "storage": "torch.bfloat16",
701
+ "sha256": "476dc2fe95fb3c82698af316f7ae5bf1d79e3dc3504a5a67a80375cd62de21ca"
702
+ },
703
+ {
704
+ "name": "transformer_blocks.16.attn.norm_q.weight",
705
+ "shape": [
706
+ 128
707
+ ],
708
+ "source_dtype": "torch.bfloat16",
709
+ "storage": "torch.bfloat16",
710
+ "sha256": "19e6ab3408978ac437e3a1caac230feda2cbf50587b72532b934221ca87f8a09"
711
+ },
712
+ {
713
+ "name": "transformer_blocks.16.attn.to_k.weight",
714
+ "shape": [
715
+ 4096,
716
+ 4096
717
+ ],
718
+ "source_dtype": "torch.bfloat16",
719
+ "storage": "nvfp4",
720
+ "relative_rmse": 0.0942886620759964
721
+ },
722
+ {
723
+ "name": "transformer_blocks.16.attn.to_out.0.weight",
724
+ "shape": [
725
+ 4096,
726
+ 4096
727
+ ],
728
+ "source_dtype": "torch.bfloat16",
729
+ "storage": "nvfp4",
730
+ "relative_rmse": 0.09513603895902634
731
+ },
732
+ {
733
+ "name": "transformer_blocks.16.attn.to_q.weight",
734
+ "shape": [
735
+ 4096,
736
+ 4096
737
+ ],
738
+ "source_dtype": "torch.bfloat16",
739
+ "storage": "nvfp4",
740
+ "relative_rmse": 0.09439306706190109
741
+ },
742
+ {
743
+ "name": "transformer_blocks.16.attn.to_v.weight",
744
+ "shape": [
745
+ 4096,
746
+ 4096
747
+ ],
748
+ "source_dtype": "torch.bfloat16",
749
+ "storage": "nvfp4",
750
+ "relative_rmse": 0.09432097524404526
751
+ },
752
+ {
753
+ "name": "transformer_blocks.16.img_mlp.gate_up.weight",
754
+ "shape": [
755
+ 24576,
756
+ 4096
757
+ ],
758
+ "source_dtype": "torch.bfloat16",
759
+ "storage": "nvfp4",
760
+ "relative_rmse": 0.09429603815078735
761
+ },
762
+ {
763
+ "name": "transformer_blocks.16.img_mlp.out.weight",
764
+ "shape": [
765
+ 4096,
766
+ 12288
767
+ ],
768
+ "source_dtype": "torch.bfloat16",
769
+ "storage": "nvfp4",
770
+ "relative_rmse": 0.09470091760158539
771
+ },
772
+ {
773
+ "name": "transformer_blocks.17.attn.norm_k.weight",
774
+ "shape": [
775
+ 128
776
+ ],
777
+ "source_dtype": "torch.bfloat16",
778
+ "storage": "torch.bfloat16",
779
+ "sha256": "eb990a79a552d7b4b4077e5433dbdf08416716e7bfe44dd329d0212de411784a"
780
+ },
781
+ {
782
+ "name": "transformer_blocks.17.attn.norm_q.weight",
783
+ "shape": [
784
+ 128
785
+ ],
786
+ "source_dtype": "torch.bfloat16",
787
+ "storage": "torch.bfloat16",
788
+ "sha256": "12d5339fca65163052cab415ffc38d8006527aa66d60e3e1e6eb3d2ecd9b57d1"
789
+ },
790
+ {
791
+ "name": "transformer_blocks.17.attn.to_k.weight",
792
+ "shape": [
793
+ 4096,
794
+ 4096
795
+ ],
796
+ "source_dtype": "torch.bfloat16",
797
+ "storage": "nvfp4",
798
+ "relative_rmse": 0.0939578264951706
799
+ },
800
+ {
801
+ "name": "transformer_blocks.17.attn.to_out.0.weight",
802
+ "shape": [
803
+ 4096,
804
+ 4096
805
+ ],
806
+ "source_dtype": "torch.bfloat16",
807
+ "storage": "nvfp4",
808
+ "relative_rmse": 0.09532124549150467
809
+ },
810
+ {
811
+ "name": "transformer_blocks.17.attn.to_q.weight",
812
+ "shape": [
813
+ 4096,
814
+ 4096
815
+ ],
816
+ "source_dtype": "torch.bfloat16",
817
+ "storage": "nvfp4",
818
+ "relative_rmse": 0.09449957311153412
819
+ },
820
+ {
821
+ "name": "transformer_blocks.17.attn.to_v.weight",
822
+ "shape": [
823
+ 4096,
824
+ 4096
825
+ ],
826
+ "source_dtype": "torch.bfloat16",
827
+ "storage": "nvfp4",
828
+ "relative_rmse": 0.09404770284891129
829
+ },
830
+ {
831
+ "name": "transformer_blocks.17.img_mlp.gate_up.weight",
832
+ "shape": [
833
+ 24576,
834
+ 4096
835
+ ],
836
+ "source_dtype": "torch.bfloat16",
837
+ "storage": "nvfp4",
838
+ "relative_rmse": 0.09432825446128845
839
+ },
840
+ {
841
+ "name": "transformer_blocks.17.img_mlp.out.weight",
842
+ "shape": [
843
+ 4096,
844
+ 12288
845
+ ],
846
+ "source_dtype": "torch.bfloat16",
847
+ "storage": "nvfp4",
848
+ "relative_rmse": 0.09457230567932129
849
+ },
850
+ {
851
+ "name": "transformer_blocks.18.attn.norm_k.weight",
852
+ "shape": [
853
+ 128
854
+ ],
855
+ "source_dtype": "torch.bfloat16",
856
+ "storage": "torch.bfloat16",
857
+ "sha256": "de98af927d0b67feaf772e235f8570f0e8af43562bff458173f71cb633e60cd9"
858
+ },
859
+ {
860
+ "name": "transformer_blocks.18.attn.norm_q.weight",
861
+ "shape": [
862
+ 128
863
+ ],
864
+ "source_dtype": "torch.bfloat16",
865
+ "storage": "torch.bfloat16",
866
+ "sha256": "d83c826d686ec9066b1f11bc1f082d9dee32e8cf7a3238d9af7b7acbe88ad4f5"
867
+ },
868
+ {
869
+ "name": "transformer_blocks.18.attn.to_k.weight",
870
+ "shape": [
871
+ 4096,
872
+ 4096
873
+ ],
874
+ "source_dtype": "torch.bfloat16",
875
+ "storage": "nvfp4",
876
+ "relative_rmse": 0.09411294013261795
877
+ },
878
+ {
879
+ "name": "transformer_blocks.18.attn.to_out.0.weight",
880
+ "shape": [
881
+ 4096,
882
+ 4096
883
+ ],
884
+ "source_dtype": "torch.bfloat16",
885
+ "storage": "nvfp4",
886
+ "relative_rmse": 0.09533113241195679
887
+ },
888
+ {
889
+ "name": "transformer_blocks.18.attn.to_q.weight",
890
+ "shape": [
891
+ 4096,
892
+ 4096
893
+ ],
894
+ "source_dtype": "torch.bfloat16",
895
+ "storage": "nvfp4",
896
+ "relative_rmse": 0.0944882333278656
897
+ },
898
+ {
899
+ "name": "transformer_blocks.18.attn.to_v.weight",
900
+ "shape": [
901
+ 4096,
902
+ 4096
903
+ ],
904
+ "source_dtype": "torch.bfloat16",
905
+ "storage": "nvfp4",
906
+ "relative_rmse": 0.09433288872241974
907
+ },
908
+ {
909
+ "name": "transformer_blocks.18.img_mlp.gate_up.weight",
910
+ "shape": [
911
+ 24576,
912
+ 4096
913
+ ],
914
+ "source_dtype": "torch.bfloat16",
915
+ "storage": "nvfp4",
916
+ "relative_rmse": 0.09435984492301941
917
+ },
918
+ {
919
+ "name": "transformer_blocks.18.img_mlp.out.weight",
920
+ "shape": [
921
+ 4096,
922
+ 12288
923
+ ],
924
+ "source_dtype": "torch.bfloat16",
925
+ "storage": "nvfp4",
926
+ "relative_rmse": 0.09458048641681671
927
+ },
928
+ {
929
+ "name": "transformer_blocks.19.attn.norm_k.weight",
930
+ "shape": [
931
+ 128
932
+ ],
933
+ "source_dtype": "torch.bfloat16",
934
+ "storage": "torch.bfloat16",
935
+ "sha256": "0ac76478bf22c4c63dc51dd0652d36c746c938a52875b4a0832c2f1610be40e9"
936
+ },
937
+ {
938
+ "name": "transformer_blocks.19.attn.norm_q.weight",
939
+ "shape": [
940
+ 128
941
+ ],
942
+ "source_dtype": "torch.bfloat16",
943
+ "storage": "torch.bfloat16",
944
+ "sha256": "b08bac0e42f6da3a7273dc53c0a92614b39ab445e7a35676fc8bb6d760e05744"
945
+ },
946
+ {
947
+ "name": "transformer_blocks.19.attn.to_k.weight",
948
+ "shape": [
949
+ 4096,
950
+ 4096
951
+ ],
952
+ "source_dtype": "torch.bfloat16",
953
+ "storage": "nvfp4",
954
+ "relative_rmse": 0.09398675709962845
955
+ },
956
+ {
957
+ "name": "transformer_blocks.19.attn.to_out.0.weight",
958
+ "shape": [
959
+ 4096,
960
+ 4096
961
+ ],
962
+ "source_dtype": "torch.bfloat16",
963
+ "storage": "nvfp4",
964
+ "relative_rmse": 0.09518875926733017
965
+ },
966
+ {
967
+ "name": "transformer_blocks.19.attn.to_q.weight",
968
+ "shape": [
969
+ 4096,
970
+ 4096
971
+ ],
972
+ "source_dtype": "torch.bfloat16",
973
+ "storage": "nvfp4",
974
+ "relative_rmse": 0.09432109445333481
975
+ },
976
+ {
977
+ "name": "transformer_blocks.19.attn.to_v.weight",
978
+ "shape": [
979
+ 4096,
980
+ 4096
981
+ ],
982
+ "source_dtype": "torch.bfloat16",
983
+ "storage": "nvfp4",
984
+ "relative_rmse": 0.09421292692422867
985
+ },
986
+ {
987
+ "name": "transformer_blocks.19.img_mlp.gate_up.weight",
988
+ "shape": [
989
+ 24576,
990
+ 4096
991
+ ],
992
+ "source_dtype": "torch.bfloat16",
993
+ "storage": "nvfp4",
994
+ "relative_rmse": 0.09432484209537506
995
+ },
996
+ {
997
+ "name": "transformer_blocks.19.img_mlp.out.weight",
998
+ "shape": [
999
+ 4096,
1000
+ 12288
1001
+ ],
1002
+ "source_dtype": "torch.bfloat16",
1003
+ "storage": "nvfp4",
1004
+ "relative_rmse": 0.0945013165473938
1005
+ },
1006
+ {
1007
+ "name": "transformer_blocks.2.attn.norm_k.weight",
1008
+ "shape": [
1009
+ 128
1010
+ ],
1011
+ "source_dtype": "torch.bfloat16",
1012
+ "storage": "torch.bfloat16",
1013
+ "sha256": "49896138bb58de842c31f43422b134f3100886d6449d1cc682d534d4a84643be"
1014
+ },
1015
+ {
1016
+ "name": "transformer_blocks.2.attn.norm_q.weight",
1017
+ "shape": [
1018
+ 128
1019
+ ],
1020
+ "source_dtype": "torch.bfloat16",
1021
+ "storage": "torch.bfloat16",
1022
+ "sha256": "ba0386bcdc5803f9500afbb627a10221af1dc7f8caa0ba174441da14be01777e"
1023
+ },
1024
+ {
1025
+ "name": "transformer_blocks.2.attn.to_k.weight",
1026
+ "shape": [
1027
+ 4096,
1028
+ 4096
1029
+ ],
1030
+ "source_dtype": "torch.bfloat16",
1031
+ "storage": "nvfp4",
1032
+ "relative_rmse": 0.09443528950214386
1033
+ },
1034
+ {
1035
+ "name": "transformer_blocks.2.attn.to_out.0.weight",
1036
+ "shape": [
1037
+ 4096,
1038
+ 4096
1039
+ ],
1040
+ "source_dtype": "torch.bfloat16",
1041
+ "storage": "nvfp4",
1042
+ "relative_rmse": 0.0953395888209343
1043
+ },
1044
+ {
1045
+ "name": "transformer_blocks.2.attn.to_q.weight",
1046
+ "shape": [
1047
+ 4096,
1048
+ 4096
1049
+ ],
1050
+ "source_dtype": "torch.bfloat16",
1051
+ "storage": "nvfp4",
1052
+ "relative_rmse": 0.09463594853878021
1053
+ },
1054
+ {
1055
+ "name": "transformer_blocks.2.attn.to_v.weight",
1056
+ "shape": [
1057
+ 4096,
1058
+ 4096
1059
+ ],
1060
+ "source_dtype": "torch.bfloat16",
1061
+ "storage": "nvfp4",
1062
+ "relative_rmse": 0.094529889523983
1063
+ },
1064
+ {
1065
+ "name": "transformer_blocks.2.img_mlp.gate_up.weight",
1066
+ "shape": [
1067
+ 24576,
1068
+ 4096
1069
+ ],
1070
+ "source_dtype": "torch.bfloat16",
1071
+ "storage": "nvfp4",
1072
+ "relative_rmse": 0.09461885690689087
1073
+ },
1074
+ {
1075
+ "name": "transformer_blocks.2.img_mlp.out.weight",
1076
+ "shape": [
1077
+ 4096,
1078
+ 12288
1079
+ ],
1080
+ "source_dtype": "torch.bfloat16",
1081
+ "storage": "nvfp4",
1082
+ "relative_rmse": 0.09440790116786957
1083
+ },
1084
+ {
1085
+ "name": "transformer_blocks.20.attn.norm_k.weight",
1086
+ "shape": [
1087
+ 128
1088
+ ],
1089
+ "source_dtype": "torch.bfloat16",
1090
+ "storage": "torch.bfloat16",
1091
+ "sha256": "f7d6a3d1f15d81d6ec47bd81d80f001865bb35c7c1abaa6ab799e4a1eb146e61"
1092
+ },
1093
+ {
1094
+ "name": "transformer_blocks.20.attn.norm_q.weight",
1095
+ "shape": [
1096
+ 128
1097
+ ],
1098
+ "source_dtype": "torch.bfloat16",
1099
+ "storage": "torch.bfloat16",
1100
+ "sha256": "425e716e33509e8d528985eccaba3850451546fda76a2368944170d5ba5b9062"
1101
+ },
1102
+ {
1103
+ "name": "transformer_blocks.20.attn.to_k.weight",
1104
+ "shape": [
1105
+ 4096,
1106
+ 4096
1107
+ ],
1108
+ "source_dtype": "torch.bfloat16",
1109
+ "storage": "nvfp4",
1110
+ "relative_rmse": 0.09418923407793045
1111
+ },
1112
+ {
1113
+ "name": "transformer_blocks.20.attn.to_out.0.weight",
1114
+ "shape": [
1115
+ 4096,
1116
+ 4096
1117
+ ],
1118
+ "source_dtype": "torch.bfloat16",
1119
+ "storage": "nvfp4",
1120
+ "relative_rmse": 0.0951521173119545
1121
+ },
1122
+ {
1123
+ "name": "transformer_blocks.20.attn.to_q.weight",
1124
+ "shape": [
1125
+ 4096,
1126
+ 4096
1127
+ ],
1128
+ "source_dtype": "torch.bfloat16",
1129
+ "storage": "nvfp4",
1130
+ "relative_rmse": 0.09440641105175018
1131
+ },
1132
+ {
1133
+ "name": "transformer_blocks.20.attn.to_v.weight",
1134
+ "shape": [
1135
+ 4096,
1136
+ 4096
1137
+ ],
1138
+ "source_dtype": "torch.bfloat16",
1139
+ "storage": "nvfp4",
1140
+ "relative_rmse": 0.094474196434021
1141
+ },
1142
+ {
1143
+ "name": "transformer_blocks.20.img_mlp.gate_up.weight",
1144
+ "shape": [
1145
+ 24576,
1146
+ 4096
1147
+ ],
1148
+ "source_dtype": "torch.bfloat16",
1149
+ "storage": "nvfp4",
1150
+ "relative_rmse": 0.09444796293973923
1151
+ },
1152
+ {
1153
+ "name": "transformer_blocks.20.img_mlp.out.weight",
1154
+ "shape": [
1155
+ 4096,
1156
+ 12288
1157
+ ],
1158
+ "source_dtype": "torch.bfloat16",
1159
+ "storage": "nvfp4",
1160
+ "relative_rmse": 0.09421083331108093
1161
+ },
1162
+ {
1163
+ "name": "transformer_blocks.21.attn.norm_k.weight",
1164
+ "shape": [
1165
+ 128
1166
+ ],
1167
+ "source_dtype": "torch.bfloat16",
1168
+ "storage": "torch.bfloat16",
1169
+ "sha256": "d78604ccfcd6f4f8f8834cbb8ee6d18d16c7e6b11431623377cd84876de83d0e"
1170
+ },
1171
+ {
1172
+ "name": "transformer_blocks.21.attn.norm_q.weight",
1173
+ "shape": [
1174
+ 128
1175
+ ],
1176
+ "source_dtype": "torch.bfloat16",
1177
+ "storage": "torch.bfloat16",
1178
+ "sha256": "bc53eb71732e3a2758d210a5a1ea161419ad556135a8125bf1d7b775d2103b64"
1179
+ },
1180
+ {
1181
+ "name": "transformer_blocks.21.attn.to_k.weight",
1182
+ "shape": [
1183
+ 4096,
1184
+ 4096
1185
+ ],
1186
+ "source_dtype": "torch.bfloat16",
1187
+ "storage": "nvfp4",
1188
+ "relative_rmse": 0.09433793276548386
1189
+ },
1190
+ {
1191
+ "name": "transformer_blocks.21.attn.to_out.0.weight",
1192
+ "shape": [
1193
+ 4096,
1194
+ 4096
1195
+ ],
1196
+ "source_dtype": "torch.bfloat16",
1197
+ "storage": "nvfp4",
1198
+ "relative_rmse": 0.09503240883350372
1199
+ },
1200
+ {
1201
+ "name": "transformer_blocks.21.attn.to_q.weight",
1202
+ "shape": [
1203
+ 4096,
1204
+ 4096
1205
+ ],
1206
+ "source_dtype": "torch.bfloat16",
1207
+ "storage": "nvfp4",
1208
+ "relative_rmse": 0.09457851201295853
1209
+ },
1210
+ {
1211
+ "name": "transformer_blocks.21.attn.to_v.weight",
1212
+ "shape": [
1213
+ 4096,
1214
+ 4096
1215
+ ],
1216
+ "source_dtype": "torch.bfloat16",
1217
+ "storage": "nvfp4",
1218
+ "relative_rmse": 0.09436649829149246
1219
+ },
1220
+ {
1221
+ "name": "transformer_blocks.21.img_mlp.gate_up.weight",
1222
+ "shape": [
1223
+ 24576,
1224
+ 4096
1225
+ ],
1226
+ "source_dtype": "torch.bfloat16",
1227
+ "storage": "nvfp4",
1228
+ "relative_rmse": 0.09445636719465256
1229
+ },
1230
+ {
1231
+ "name": "transformer_blocks.21.img_mlp.out.weight",
1232
+ "shape": [
1233
+ 4096,
1234
+ 12288
1235
+ ],
1236
+ "source_dtype": "torch.bfloat16",
1237
+ "storage": "nvfp4",
1238
+ "relative_rmse": 0.09428934752941132
1239
+ },
1240
+ {
1241
+ "name": "transformer_blocks.22.attn.norm_k.weight",
1242
+ "shape": [
1243
+ 128
1244
+ ],
1245
+ "source_dtype": "torch.bfloat16",
1246
+ "storage": "torch.bfloat16",
1247
+ "sha256": "ffb7961b6099752067ad7dbb3de075bfb14d65816448a84f99c95e886436345e"
1248
+ },
1249
+ {
1250
+ "name": "transformer_blocks.22.attn.norm_q.weight",
1251
+ "shape": [
1252
+ 128
1253
+ ],
1254
+ "source_dtype": "torch.bfloat16",
1255
+ "storage": "torch.bfloat16",
1256
+ "sha256": "5f4e26623063a53c95ee7f6ace3e072377b0f2edbefe3bd5af1f1af1b02b8ab9"
1257
+ },
1258
+ {
1259
+ "name": "transformer_blocks.22.attn.to_k.weight",
1260
+ "shape": [
1261
+ 4096,
1262
+ 4096
1263
+ ],
1264
+ "source_dtype": "torch.bfloat16",
1265
+ "storage": "nvfp4",
1266
+ "relative_rmse": 0.09428413957357407
1267
+ },
1268
+ {
1269
+ "name": "transformer_blocks.22.attn.to_out.0.weight",
1270
+ "shape": [
1271
+ 4096,
1272
+ 4096
1273
+ ],
1274
+ "source_dtype": "torch.bfloat16",
1275
+ "storage": "nvfp4",
1276
+ "relative_rmse": 0.09517910331487656
1277
+ },
1278
+ {
1279
+ "name": "transformer_blocks.22.attn.to_q.weight",
1280
+ "shape": [
1281
+ 4096,
1282
+ 4096
1283
+ ],
1284
+ "source_dtype": "torch.bfloat16",
1285
+ "storage": "nvfp4",
1286
+ "relative_rmse": 0.09460055083036423
1287
+ },
1288
+ {
1289
+ "name": "transformer_blocks.22.attn.to_v.weight",
1290
+ "shape": [
1291
+ 4096,
1292
+ 4096
1293
+ ],
1294
+ "source_dtype": "torch.bfloat16",
1295
+ "storage": "nvfp4",
1296
+ "relative_rmse": 0.09407515823841095
1297
+ },
1298
+ {
1299
+ "name": "transformer_blocks.22.img_mlp.gate_up.weight",
1300
+ "shape": [
1301
+ 24576,
1302
+ 4096
1303
+ ],
1304
+ "source_dtype": "torch.bfloat16",
1305
+ "storage": "nvfp4",
1306
+ "relative_rmse": 0.09422037750482559
1307
+ },
1308
+ {
1309
+ "name": "transformer_blocks.22.img_mlp.out.weight",
1310
+ "shape": [
1311
+ 4096,
1312
+ 12288
1313
+ ],
1314
+ "source_dtype": "torch.bfloat16",
1315
+ "storage": "nvfp4",
1316
+ "relative_rmse": 0.09452139586210251
1317
+ },
1318
+ {
1319
+ "name": "transformer_blocks.23.attn.norm_k.weight",
1320
+ "shape": [
1321
+ 128
1322
+ ],
1323
+ "source_dtype": "torch.bfloat16",
1324
+ "storage": "torch.bfloat16",
1325
+ "sha256": "b2af62fa9d8f64e07dc6e05c378ddc174579dc4f5c9978f45ecc8a1c3b1bc61f"
1326
+ },
1327
+ {
1328
+ "name": "transformer_blocks.23.attn.norm_q.weight",
1329
+ "shape": [
1330
+ 128
1331
+ ],
1332
+ "source_dtype": "torch.bfloat16",
1333
+ "storage": "torch.bfloat16",
1334
+ "sha256": "1d607ccc2b59a46d1bcf8890c712e2a96f2b8cbb961f3900ab259b3094d0e9d7"
1335
+ },
1336
+ {
1337
+ "name": "transformer_blocks.23.attn.to_k.weight",
1338
+ "shape": [
1339
+ 4096,
1340
+ 4096
1341
+ ],
1342
+ "source_dtype": "torch.bfloat16",
1343
+ "storage": "nvfp4",
1344
+ "relative_rmse": 0.09408468753099442
1345
+ },
1346
+ {
1347
+ "name": "transformer_blocks.23.attn.to_out.0.weight",
1348
+ "shape": [
1349
+ 4096,
1350
+ 4096
1351
+ ],
1352
+ "source_dtype": "torch.bfloat16",
1353
+ "storage": "nvfp4",
1354
+ "relative_rmse": 0.09505080431699753
1355
+ },
1356
+ {
1357
+ "name": "transformer_blocks.23.attn.to_q.weight",
1358
+ "shape": [
1359
+ 4096,
1360
+ 4096
1361
+ ],
1362
+ "source_dtype": "torch.bfloat16",
1363
+ "storage": "nvfp4",
1364
+ "relative_rmse": 0.09434711188077927
1365
+ },
1366
+ {
1367
+ "name": "transformer_blocks.23.attn.to_v.weight",
1368
+ "shape": [
1369
+ 4096,
1370
+ 4096
1371
+ ],
1372
+ "source_dtype": "torch.bfloat16",
1373
+ "storage": "nvfp4",
1374
+ "relative_rmse": 0.09392070770263672
1375
+ },
1376
+ {
1377
+ "name": "transformer_blocks.23.img_mlp.gate_up.weight",
1378
+ "shape": [
1379
+ 24576,
1380
+ 4096
1381
+ ],
1382
+ "source_dtype": "torch.bfloat16",
1383
+ "storage": "nvfp4",
1384
+ "relative_rmse": 0.09421507269144058
1385
+ },
1386
+ {
1387
+ "name": "transformer_blocks.23.img_mlp.out.weight",
1388
+ "shape": [
1389
+ 4096,
1390
+ 12288
1391
+ ],
1392
+ "source_dtype": "torch.bfloat16",
1393
+ "storage": "nvfp4",
1394
+ "relative_rmse": 0.09436953812837601
1395
+ },
1396
+ {
1397
+ "name": "transformer_blocks.24.attn.norm_k.weight",
1398
+ "shape": [
1399
+ 128
1400
+ ],
1401
+ "source_dtype": "torch.bfloat16",
1402
+ "storage": "torch.bfloat16",
1403
+ "sha256": "7cf55d07732b4460b4f4032d756677186dfe451fd580adc2e335794d3efc24e5"
1404
+ },
1405
+ {
1406
+ "name": "transformer_blocks.24.attn.norm_q.weight",
1407
+ "shape": [
1408
+ 128
1409
+ ],
1410
+ "source_dtype": "torch.bfloat16",
1411
+ "storage": "torch.bfloat16",
1412
+ "sha256": "5c0019afbf7531a43cab1c18b944ea42e5358338b22afdb7c3b63ccd96c0cc9a"
1413
+ },
1414
+ {
1415
+ "name": "transformer_blocks.24.attn.to_k.weight",
1416
+ "shape": [
1417
+ 4096,
1418
+ 4096
1419
+ ],
1420
+ "source_dtype": "torch.bfloat16",
1421
+ "storage": "nvfp4",
1422
+ "relative_rmse": 0.09408159554004669
1423
+ },
1424
+ {
1425
+ "name": "transformer_blocks.24.attn.to_out.0.weight",
1426
+ "shape": [
1427
+ 4096,
1428
+ 4096
1429
+ ],
1430
+ "source_dtype": "torch.bfloat16",
1431
+ "storage": "nvfp4",
1432
+ "relative_rmse": 0.09515871852636337
1433
+ },
1434
+ {
1435
+ "name": "transformer_blocks.24.attn.to_q.weight",
1436
+ "shape": [
1437
+ 4096,
1438
+ 4096
1439
+ ],
1440
+ "source_dtype": "torch.bfloat16",
1441
+ "storage": "nvfp4",
1442
+ "relative_rmse": 0.09425819665193558
1443
+ },
1444
+ {
1445
+ "name": "transformer_blocks.24.attn.to_v.weight",
1446
+ "shape": [
1447
+ 4096,
1448
+ 4096
1449
+ ],
1450
+ "source_dtype": "torch.bfloat16",
1451
+ "storage": "nvfp4",
1452
+ "relative_rmse": 0.09295009821653366
1453
+ },
1454
+ {
1455
+ "name": "transformer_blocks.24.img_mlp.gate_up.weight",
1456
+ "shape": [
1457
+ 24576,
1458
+ 4096
1459
+ ],
1460
+ "source_dtype": "torch.bfloat16",
1461
+ "storage": "nvfp4",
1462
+ "relative_rmse": 0.0942286029458046
1463
+ },
1464
+ {
1465
+ "name": "transformer_blocks.24.img_mlp.out.weight",
1466
+ "shape": [
1467
+ 4096,
1468
+ 12288
1469
+ ],
1470
+ "source_dtype": "torch.bfloat16",
1471
+ "storage": "nvfp4",
1472
+ "relative_rmse": 0.09437375515699387
1473
+ },
1474
+ {
1475
+ "name": "transformer_blocks.25.attn.norm_k.weight",
1476
+ "shape": [
1477
+ 128
1478
+ ],
1479
+ "source_dtype": "torch.bfloat16",
1480
+ "storage": "torch.bfloat16",
1481
+ "sha256": "9912d37ce907c913ebe90ce90f8b74d951401f3fc6d081d4268cf6aa0fd530fb"
1482
+ },
1483
+ {
1484
+ "name": "transformer_blocks.25.attn.norm_q.weight",
1485
+ "shape": [
1486
+ 128
1487
+ ],
1488
+ "source_dtype": "torch.bfloat16",
1489
+ "storage": "torch.bfloat16",
1490
+ "sha256": "41b0f2d2d46510be1bca296cc1981fd6bfbf1d897b9ad95cbfeb6efb23b46504"
1491
+ },
1492
+ {
1493
+ "name": "transformer_blocks.25.attn.to_k.weight",
1494
+ "shape": [
1495
+ 4096,
1496
+ 4096
1497
+ ],
1498
+ "source_dtype": "torch.bfloat16",
1499
+ "storage": "nvfp4",
1500
+ "relative_rmse": 0.09419506043195724
1501
+ },
1502
+ {
1503
+ "name": "transformer_blocks.25.attn.to_out.0.weight",
1504
+ "shape": [
1505
+ 4096,
1506
+ 4096
1507
+ ],
1508
+ "source_dtype": "torch.bfloat16",
1509
+ "storage": "nvfp4",
1510
+ "relative_rmse": 0.09516096860170364
1511
+ },
1512
+ {
1513
+ "name": "transformer_blocks.25.attn.to_q.weight",
1514
+ "shape": [
1515
+ 4096,
1516
+ 4096
1517
+ ],
1518
+ "source_dtype": "torch.bfloat16",
1519
+ "storage": "nvfp4",
1520
+ "relative_rmse": 0.09440808743238449
1521
+ },
1522
+ {
1523
+ "name": "transformer_blocks.25.attn.to_v.weight",
1524
+ "shape": [
1525
+ 4096,
1526
+ 4096
1527
+ ],
1528
+ "source_dtype": "torch.bfloat16",
1529
+ "storage": "nvfp4",
1530
+ "relative_rmse": 0.09340789914131165
1531
+ },
1532
+ {
1533
+ "name": "transformer_blocks.25.img_mlp.gate_up.weight",
1534
+ "shape": [
1535
+ 24576,
1536
+ 4096
1537
+ ],
1538
+ "source_dtype": "torch.bfloat16",
1539
+ "storage": "nvfp4",
1540
+ "relative_rmse": 0.09431573748588562
1541
+ },
1542
+ {
1543
+ "name": "transformer_blocks.25.img_mlp.out.weight",
1544
+ "shape": [
1545
+ 4096,
1546
+ 12288
1547
+ ],
1548
+ "source_dtype": "torch.bfloat16",
1549
+ "storage": "nvfp4",
1550
+ "relative_rmse": 0.09465906769037247
1551
+ },
1552
+ {
1553
+ "name": "transformer_blocks.26.attn.norm_k.weight",
1554
+ "shape": [
1555
+ 128
1556
+ ],
1557
+ "source_dtype": "torch.bfloat16",
1558
+ "storage": "torch.bfloat16",
1559
+ "sha256": "1770794279275ff0e355fc4c967f6fd15725898c41be4247ecf3208369e6db90"
1560
+ },
1561
+ {
1562
+ "name": "transformer_blocks.26.attn.norm_q.weight",
1563
+ "shape": [
1564
+ 128
1565
+ ],
1566
+ "source_dtype": "torch.bfloat16",
1567
+ "storage": "torch.bfloat16",
1568
+ "sha256": "7d75f4f6ba1e2ffc36f448fc91e122ce73ed7a3ddfd578b90f6af614b0b05931"
1569
+ },
1570
+ {
1571
+ "name": "transformer_blocks.26.attn.to_k.weight",
1572
+ "shape": [
1573
+ 4096,
1574
+ 4096
1575
+ ],
1576
+ "source_dtype": "torch.bfloat16",
1577
+ "storage": "nvfp4",
1578
+ "relative_rmse": 0.09402094036340714
1579
+ },
1580
+ {
1581
+ "name": "transformer_blocks.26.attn.to_out.0.weight",
1582
+ "shape": [
1583
+ 4096,
1584
+ 4096
1585
+ ],
1586
+ "source_dtype": "torch.bfloat16",
1587
+ "storage": "nvfp4",
1588
+ "relative_rmse": 0.09514297544956207
1589
+ },
1590
+ {
1591
+ "name": "transformer_blocks.26.attn.to_q.weight",
1592
+ "shape": [
1593
+ 4096,
1594
+ 4096
1595
+ ],
1596
+ "source_dtype": "torch.bfloat16",
1597
+ "storage": "nvfp4",
1598
+ "relative_rmse": 0.09432660043239594
1599
+ },
1600
+ {
1601
+ "name": "transformer_blocks.26.attn.to_v.weight",
1602
+ "shape": [
1603
+ 4096,
1604
+ 4096
1605
+ ],
1606
+ "source_dtype": "torch.bfloat16",
1607
+ "storage": "nvfp4",
1608
+ "relative_rmse": 0.09392236918210983
1609
+ },
1610
+ {
1611
+ "name": "transformer_blocks.26.img_mlp.gate_up.weight",
1612
+ "shape": [
1613
+ 24576,
1614
+ 4096
1615
+ ],
1616
+ "source_dtype": "torch.bfloat16",
1617
+ "storage": "nvfp4",
1618
+ "relative_rmse": 0.09436123818159103
1619
+ },
1620
+ {
1621
+ "name": "transformer_blocks.26.img_mlp.out.weight",
1622
+ "shape": [
1623
+ 4096,
1624
+ 12288
1625
+ ],
1626
+ "source_dtype": "torch.bfloat16",
1627
+ "storage": "nvfp4",
1628
+ "relative_rmse": 0.09454623609781265
1629
+ },
1630
+ {
1631
+ "name": "transformer_blocks.27.attn.norm_k.weight",
1632
+ "shape": [
1633
+ 128
1634
+ ],
1635
+ "source_dtype": "torch.bfloat16",
1636
+ "storage": "torch.bfloat16",
1637
+ "sha256": "e617551c3aea1ec17fbfd87d17d70439108df684584c801a33ae3b20134f2b93"
1638
+ },
1639
+ {
1640
+ "name": "transformer_blocks.27.attn.norm_q.weight",
1641
+ "shape": [
1642
+ 128
1643
+ ],
1644
+ "source_dtype": "torch.bfloat16",
1645
+ "storage": "torch.bfloat16",
1646
+ "sha256": "8b4cb1eb2bde149b81d1a09d3de880668ba8f6a62406546df9ee9b0a07c95e78"
1647
+ },
1648
+ {
1649
+ "name": "transformer_blocks.27.attn.to_k.weight",
1650
+ "shape": [
1651
+ 4096,
1652
+ 4096
1653
+ ],
1654
+ "source_dtype": "torch.bfloat16",
1655
+ "storage": "nvfp4",
1656
+ "relative_rmse": 0.093889020383358
1657
+ },
1658
+ {
1659
+ "name": "transformer_blocks.27.attn.to_out.0.weight",
1660
+ "shape": [
1661
+ 4096,
1662
+ 4096
1663
+ ],
1664
+ "source_dtype": "torch.bfloat16",
1665
+ "storage": "nvfp4",
1666
+ "relative_rmse": 0.09523267298936844
1667
+ },
1668
+ {
1669
+ "name": "transformer_blocks.27.attn.to_q.weight",
1670
+ "shape": [
1671
+ 4096,
1672
+ 4096
1673
+ ],
1674
+ "source_dtype": "torch.bfloat16",
1675
+ "storage": "nvfp4",
1676
+ "relative_rmse": 0.09420020878314972
1677
+ },
1678
+ {
1679
+ "name": "transformer_blocks.27.attn.to_v.weight",
1680
+ "shape": [
1681
+ 4096,
1682
+ 4096
1683
+ ],
1684
+ "source_dtype": "torch.bfloat16",
1685
+ "storage": "nvfp4",
1686
+ "relative_rmse": 0.09274192154407501
1687
+ },
1688
+ {
1689
+ "name": "transformer_blocks.27.img_mlp.gate_up.weight",
1690
+ "shape": [
1691
+ 24576,
1692
+ 4096
1693
+ ],
1694
+ "source_dtype": "torch.bfloat16",
1695
+ "storage": "nvfp4",
1696
+ "relative_rmse": 0.09421180933713913
1697
+ },
1698
+ {
1699
+ "name": "transformer_blocks.27.img_mlp.out.weight",
1700
+ "shape": [
1701
+ 4096,
1702
+ 12288
1703
+ ],
1704
+ "source_dtype": "torch.bfloat16",
1705
+ "storage": "nvfp4",
1706
+ "relative_rmse": 0.09465836733579636
1707
+ },
1708
+ {
1709
+ "name": "transformer_blocks.28.attn.norm_k.weight",
1710
+ "shape": [
1711
+ 128
1712
+ ],
1713
+ "source_dtype": "torch.bfloat16",
1714
+ "storage": "torch.bfloat16",
1715
+ "sha256": "e61f36f30099a0029417ef24a5ce24237e9e8c57e72199ce9380b31cad296537"
1716
+ },
1717
+ {
1718
+ "name": "transformer_blocks.28.attn.norm_q.weight",
1719
+ "shape": [
1720
+ 128
1721
+ ],
1722
+ "source_dtype": "torch.bfloat16",
1723
+ "storage": "torch.bfloat16",
1724
+ "sha256": "d2420a2ed03503525c0309d1a5758c05db515fdee1bc61e1413704e58426433c"
1725
+ },
1726
+ {
1727
+ "name": "transformer_blocks.28.attn.to_k.weight",
1728
+ "shape": [
1729
+ 4096,
1730
+ 4096
1731
+ ],
1732
+ "source_dtype": "torch.bfloat16",
1733
+ "storage": "nvfp4",
1734
+ "relative_rmse": 0.09418927133083344
1735
+ },
1736
+ {
1737
+ "name": "transformer_blocks.28.attn.to_out.0.weight",
1738
+ "shape": [
1739
+ 4096,
1740
+ 4096
1741
+ ],
1742
+ "source_dtype": "torch.bfloat16",
1743
+ "storage": "nvfp4",
1744
+ "relative_rmse": 0.09510087966918945
1745
+ },
1746
+ {
1747
+ "name": "transformer_blocks.28.attn.to_q.weight",
1748
+ "shape": [
1749
+ 4096,
1750
+ 4096
1751
+ ],
1752
+ "source_dtype": "torch.bfloat16",
1753
+ "storage": "nvfp4",
1754
+ "relative_rmse": 0.09439761936664581
1755
+ },
1756
+ {
1757
+ "name": "transformer_blocks.28.attn.to_v.weight",
1758
+ "shape": [
1759
+ 4096,
1760
+ 4096
1761
+ ],
1762
+ "source_dtype": "torch.bfloat16",
1763
+ "storage": "nvfp4",
1764
+ "relative_rmse": 0.09371969848871231
1765
+ },
1766
+ {
1767
+ "name": "transformer_blocks.28.img_mlp.gate_up.weight",
1768
+ "shape": [
1769
+ 24576,
1770
+ 4096
1771
+ ],
1772
+ "source_dtype": "torch.bfloat16",
1773
+ "storage": "nvfp4",
1774
+ "relative_rmse": 0.09451578557491302
1775
+ },
1776
+ {
1777
+ "name": "transformer_blocks.28.img_mlp.out.weight",
1778
+ "shape": [
1779
+ 4096,
1780
+ 12288
1781
+ ],
1782
+ "source_dtype": "torch.bfloat16",
1783
+ "storage": "nvfp4",
1784
+ "relative_rmse": 0.09452327340841293
1785
+ },
1786
+ {
1787
+ "name": "transformer_blocks.29.attn.norm_k.weight",
1788
+ "shape": [
1789
+ 128
1790
+ ],
1791
+ "source_dtype": "torch.bfloat16",
1792
+ "storage": "torch.bfloat16",
1793
+ "sha256": "0e952868b18d5a499239a5122a51c4e64f72896a8eac1e2782073dbafae627b8"
1794
+ },
1795
+ {
1796
+ "name": "transformer_blocks.29.attn.norm_q.weight",
1797
+ "shape": [
1798
+ 128
1799
+ ],
1800
+ "source_dtype": "torch.bfloat16",
1801
+ "storage": "torch.bfloat16",
1802
+ "sha256": "19cc1be26f7ae2d010a01ec1ee1e8a4d685578ef470750c77afc2d1d59d291df"
1803
+ },
1804
+ {
1805
+ "name": "transformer_blocks.29.attn.to_k.weight",
1806
+ "shape": [
1807
+ 4096,
1808
+ 4096
1809
+ ],
1810
+ "source_dtype": "torch.bfloat16",
1811
+ "storage": "nvfp4",
1812
+ "relative_rmse": 0.09389638900756836
1813
+ },
1814
+ {
1815
+ "name": "transformer_blocks.29.attn.to_out.0.weight",
1816
+ "shape": [
1817
+ 4096,
1818
+ 4096
1819
+ ],
1820
+ "source_dtype": "torch.bfloat16",
1821
+ "storage": "nvfp4",
1822
+ "relative_rmse": 0.09516238421201706
1823
+ },
1824
+ {
1825
+ "name": "transformer_blocks.29.attn.to_q.weight",
1826
+ "shape": [
1827
+ 4096,
1828
+ 4096
1829
+ ],
1830
+ "source_dtype": "torch.bfloat16",
1831
+ "storage": "nvfp4",
1832
+ "relative_rmse": 0.09444045275449753
1833
+ },
1834
+ {
1835
+ "name": "transformer_blocks.29.attn.to_v.weight",
1836
+ "shape": [
1837
+ 4096,
1838
+ 4096
1839
+ ],
1840
+ "source_dtype": "torch.bfloat16",
1841
+ "storage": "nvfp4",
1842
+ "relative_rmse": 0.09318964183330536
1843
+ },
1844
+ {
1845
+ "name": "transformer_blocks.29.img_mlp.gate_up.weight",
1846
+ "shape": [
1847
+ 24576,
1848
+ 4096
1849
+ ],
1850
+ "source_dtype": "torch.bfloat16",
1851
+ "storage": "nvfp4",
1852
+ "relative_rmse": 0.09439058601856232
1853
+ },
1854
+ {
1855
+ "name": "transformer_blocks.29.img_mlp.out.weight",
1856
+ "shape": [
1857
+ 4096,
1858
+ 12288
1859
+ ],
1860
+ "source_dtype": "torch.bfloat16",
1861
+ "storage": "nvfp4",
1862
+ "relative_rmse": 0.09467429667711258
1863
+ },
1864
+ {
1865
+ "name": "transformer_blocks.3.attn.norm_k.weight",
1866
+ "shape": [
1867
+ 128
1868
+ ],
1869
+ "source_dtype": "torch.bfloat16",
1870
+ "storage": "torch.bfloat16",
1871
+ "sha256": "9adafcf36fbcf1a1fc90864119107f5aaf1034c0af2e842a2e7e76abf67249dc"
1872
+ },
1873
+ {
1874
+ "name": "transformer_blocks.3.attn.norm_q.weight",
1875
+ "shape": [
1876
+ 128
1877
+ ],
1878
+ "source_dtype": "torch.bfloat16",
1879
+ "storage": "torch.bfloat16",
1880
+ "sha256": "11fe2b7ce8993bc09ff3d12afaef320f363fc5b9bdd84e7bef02d223ab09a990"
1881
+ },
1882
+ {
1883
+ "name": "transformer_blocks.3.attn.to_k.weight",
1884
+ "shape": [
1885
+ 4096,
1886
+ 4096
1887
+ ],
1888
+ "source_dtype": "torch.bfloat16",
1889
+ "storage": "nvfp4",
1890
+ "relative_rmse": 0.09428946673870087
1891
+ },
1892
+ {
1893
+ "name": "transformer_blocks.3.attn.to_out.0.weight",
1894
+ "shape": [
1895
+ 4096,
1896
+ 4096
1897
+ ],
1898
+ "source_dtype": "torch.bfloat16",
1899
+ "storage": "nvfp4",
1900
+ "relative_rmse": 0.09520148485898972
1901
+ },
1902
+ {
1903
+ "name": "transformer_blocks.3.attn.to_q.weight",
1904
+ "shape": [
1905
+ 4096,
1906
+ 4096
1907
+ ],
1908
+ "source_dtype": "torch.bfloat16",
1909
+ "storage": "nvfp4",
1910
+ "relative_rmse": 0.09453629702329636
1911
+ },
1912
+ {
1913
+ "name": "transformer_blocks.3.attn.to_v.weight",
1914
+ "shape": [
1915
+ 4096,
1916
+ 4096
1917
+ ],
1918
+ "source_dtype": "torch.bfloat16",
1919
+ "storage": "nvfp4",
1920
+ "relative_rmse": 0.09431635588407516
1921
+ },
1922
+ {
1923
+ "name": "transformer_blocks.3.img_mlp.gate_up.weight",
1924
+ "shape": [
1925
+ 24576,
1926
+ 4096
1927
+ ],
1928
+ "source_dtype": "torch.bfloat16",
1929
+ "storage": "nvfp4",
1930
+ "relative_rmse": 0.09454379230737686
1931
+ },
1932
+ {
1933
+ "name": "transformer_blocks.3.img_mlp.out.weight",
1934
+ "shape": [
1935
+ 4096,
1936
+ 12288
1937
+ ],
1938
+ "source_dtype": "torch.bfloat16",
1939
+ "storage": "nvfp4",
1940
+ "relative_rmse": 0.09459960460662842
1941
+ },
1942
+ {
1943
+ "name": "transformer_blocks.30.attn.norm_k.weight",
1944
+ "shape": [
1945
+ 128
1946
+ ],
1947
+ "source_dtype": "torch.bfloat16",
1948
+ "storage": "torch.bfloat16",
1949
+ "sha256": "69689ec6f8424448347567aaf0a7f577c21cd02dd9d329c977f485671c8c39a6"
1950
+ },
1951
+ {
1952
+ "name": "transformer_blocks.30.attn.norm_q.weight",
1953
+ "shape": [
1954
+ 128
1955
+ ],
1956
+ "source_dtype": "torch.bfloat16",
1957
+ "storage": "torch.bfloat16",
1958
+ "sha256": "49f667f017d3164db4b840b087903801a85b350a103d1173c8f5fc5c5a771165"
1959
+ },
1960
+ {
1961
+ "name": "transformer_blocks.30.attn.to_k.weight",
1962
+ "shape": [
1963
+ 4096,
1964
+ 4096
1965
+ ],
1966
+ "source_dtype": "torch.bfloat16",
1967
+ "storage": "nvfp4",
1968
+ "relative_rmse": 0.09390967339277267
1969
+ },
1970
+ {
1971
+ "name": "transformer_blocks.30.attn.to_out.0.weight",
1972
+ "shape": [
1973
+ 4096,
1974
+ 4096
1975
+ ],
1976
+ "source_dtype": "torch.bfloat16",
1977
+ "storage": "nvfp4",
1978
+ "relative_rmse": 0.095180943608284
1979
+ },
1980
+ {
1981
+ "name": "transformer_blocks.30.attn.to_q.weight",
1982
+ "shape": [
1983
+ 4096,
1984
+ 4096
1985
+ ],
1986
+ "source_dtype": "torch.bfloat16",
1987
+ "storage": "nvfp4",
1988
+ "relative_rmse": 0.09430109709501266
1989
+ },
1990
+ {
1991
+ "name": "transformer_blocks.30.attn.to_v.weight",
1992
+ "shape": [
1993
+ 4096,
1994
+ 4096
1995
+ ],
1996
+ "source_dtype": "torch.bfloat16",
1997
+ "storage": "nvfp4",
1998
+ "relative_rmse": 0.09337132424116135
1999
+ },
2000
+ {
2001
+ "name": "transformer_blocks.30.img_mlp.gate_up.weight",
2002
+ "shape": [
2003
+ 24576,
2004
+ 4096
2005
+ ],
2006
+ "source_dtype": "torch.bfloat16",
2007
+ "storage": "nvfp4",
2008
+ "relative_rmse": 0.09421910345554352
2009
+ },
2010
+ {
2011
+ "name": "transformer_blocks.30.img_mlp.out.weight",
2012
+ "shape": [
2013
+ 4096,
2014
+ 12288
2015
+ ],
2016
+ "source_dtype": "torch.bfloat16",
2017
+ "storage": "nvfp4",
2018
+ "relative_rmse": 0.09415393322706223
2019
+ },
2020
+ {
2021
+ "name": "transformer_blocks.31.attn.norm_k.weight",
2022
+ "shape": [
2023
+ 128
2024
+ ],
2025
+ "source_dtype": "torch.bfloat16",
2026
+ "storage": "torch.bfloat16",
2027
+ "sha256": "c35261d78c7d5177ab9ec1e8412a59853981c038e6ba41066dc216d9a394f1e9"
2028
+ },
2029
+ {
2030
+ "name": "transformer_blocks.31.attn.norm_q.weight",
2031
+ "shape": [
2032
+ 128
2033
+ ],
2034
+ "source_dtype": "torch.bfloat16",
2035
+ "storage": "torch.bfloat16",
2036
+ "sha256": "e0f1c31a771f5948f3f2d2bb96d4e0ed2a897b5d275251486e07c7d7ebb1651a"
2037
+ },
2038
+ {
2039
+ "name": "transformer_blocks.31.attn.to_k.weight",
2040
+ "shape": [
2041
+ 4096,
2042
+ 4096
2043
+ ],
2044
+ "source_dtype": "torch.bfloat16",
2045
+ "storage": "nvfp4",
2046
+ "relative_rmse": 0.09357605874538422
2047
+ },
2048
+ {
2049
+ "name": "transformer_blocks.31.attn.to_out.0.weight",
2050
+ "shape": [
2051
+ 4096,
2052
+ 4096
2053
+ ],
2054
+ "source_dtype": "torch.bfloat16",
2055
+ "storage": "nvfp4",
2056
+ "relative_rmse": 0.09499607235193253
2057
+ },
2058
+ {
2059
+ "name": "transformer_blocks.31.attn.to_q.weight",
2060
+ "shape": [
2061
+ 4096,
2062
+ 4096
2063
+ ],
2064
+ "source_dtype": "torch.bfloat16",
2065
+ "storage": "nvfp4",
2066
+ "relative_rmse": 0.0939827635884285
2067
+ },
2068
+ {
2069
+ "name": "transformer_blocks.31.attn.to_v.weight",
2070
+ "shape": [
2071
+ 4096,
2072
+ 4096
2073
+ ],
2074
+ "source_dtype": "torch.bfloat16",
2075
+ "storage": "nvfp4",
2076
+ "relative_rmse": 0.09221894294023514
2077
+ },
2078
+ {
2079
+ "name": "transformer_blocks.31.img_mlp.gate_up.weight",
2080
+ "shape": [
2081
+ 24576,
2082
+ 4096
2083
+ ],
2084
+ "source_dtype": "torch.bfloat16",
2085
+ "storage": "nvfp4",
2086
+ "relative_rmse": 0.09380938112735748
2087
+ },
2088
+ {
2089
+ "name": "transformer_blocks.31.img_mlp.out.weight",
2090
+ "shape": [
2091
+ 4096,
2092
+ 12288
2093
+ ],
2094
+ "source_dtype": "torch.bfloat16",
2095
+ "storage": "nvfp4",
2096
+ "relative_rmse": 0.09404856711626053
2097
+ },
2098
+ {
2099
+ "name": "transformer_blocks.4.attn.norm_k.weight",
2100
+ "shape": [
2101
+ 128
2102
+ ],
2103
+ "source_dtype": "torch.bfloat16",
2104
+ "storage": "torch.bfloat16",
2105
+ "sha256": "bbee8dc5c62f81c8286c2485ace11ab9eda0f9107596ce5c587c54dae1174406"
2106
+ },
2107
+ {
2108
+ "name": "transformer_blocks.4.attn.norm_q.weight",
2109
+ "shape": [
2110
+ 128
2111
+ ],
2112
+ "source_dtype": "torch.bfloat16",
2113
+ "storage": "torch.bfloat16",
2114
+ "sha256": "dad41e5972a227e07a6e2885f463546b7b171b1a120b9de5199527148ca942aa"
2115
+ },
2116
+ {
2117
+ "name": "transformer_blocks.4.attn.to_k.weight",
2118
+ "shape": [
2119
+ 4096,
2120
+ 4096
2121
+ ],
2122
+ "source_dtype": "torch.bfloat16",
2123
+ "storage": "nvfp4",
2124
+ "relative_rmse": 0.09441725164651871
2125
+ },
2126
+ {
2127
+ "name": "transformer_blocks.4.attn.to_out.0.weight",
2128
+ "shape": [
2129
+ 4096,
2130
+ 4096
2131
+ ],
2132
+ "source_dtype": "torch.bfloat16",
2133
+ "storage": "nvfp4",
2134
+ "relative_rmse": 0.09523670375347137
2135
+ },
2136
+ {
2137
+ "name": "transformer_blocks.4.attn.to_q.weight",
2138
+ "shape": [
2139
+ 4096,
2140
+ 4096
2141
+ ],
2142
+ "source_dtype": "torch.bfloat16",
2143
+ "storage": "nvfp4",
2144
+ "relative_rmse": 0.09450657665729523
2145
+ },
2146
+ {
2147
+ "name": "transformer_blocks.4.attn.to_v.weight",
2148
+ "shape": [
2149
+ 4096,
2150
+ 4096
2151
+ ],
2152
+ "source_dtype": "torch.bfloat16",
2153
+ "storage": "nvfp4",
2154
+ "relative_rmse": 0.09446003288030624
2155
+ },
2156
+ {
2157
+ "name": "transformer_blocks.4.img_mlp.gate_up.weight",
2158
+ "shape": [
2159
+ 24576,
2160
+ 4096
2161
+ ],
2162
+ "source_dtype": "torch.bfloat16",
2163
+ "storage": "nvfp4",
2164
+ "relative_rmse": 0.09445067495107651
2165
+ },
2166
+ {
2167
+ "name": "transformer_blocks.4.img_mlp.out.weight",
2168
+ "shape": [
2169
+ 4096,
2170
+ 12288
2171
+ ],
2172
+ "source_dtype": "torch.bfloat16",
2173
+ "storage": "nvfp4",
2174
+ "relative_rmse": 0.09469588100910187
2175
+ },
2176
+ {
2177
+ "name": "transformer_blocks.5.attn.norm_k.weight",
2178
+ "shape": [
2179
+ 128
2180
+ ],
2181
+ "source_dtype": "torch.bfloat16",
2182
+ "storage": "torch.bfloat16",
2183
+ "sha256": "1d8bde5394b8c899d54bdb9bdbe83db069204b16286c4aeaf05c7c9f166090ad"
2184
+ },
2185
+ {
2186
+ "name": "transformer_blocks.5.attn.norm_q.weight",
2187
+ "shape": [
2188
+ 128
2189
+ ],
2190
+ "source_dtype": "torch.bfloat16",
2191
+ "storage": "torch.bfloat16",
2192
+ "sha256": "d48c5fe07fcd71a357af1295c6e00109d4e2f23fb5b213ace6dc88fc7fd33de2"
2193
+ },
2194
+ {
2195
+ "name": "transformer_blocks.5.attn.to_k.weight",
2196
+ "shape": [
2197
+ 4096,
2198
+ 4096
2199
+ ],
2200
+ "source_dtype": "torch.bfloat16",
2201
+ "storage": "nvfp4",
2202
+ "relative_rmse": 0.09460146725177765
2203
+ },
2204
+ {
2205
+ "name": "transformer_blocks.5.attn.to_out.0.weight",
2206
+ "shape": [
2207
+ 4096,
2208
+ 4096
2209
+ ],
2210
+ "source_dtype": "torch.bfloat16",
2211
+ "storage": "nvfp4",
2212
+ "relative_rmse": 0.09520139545202255
2213
+ },
2214
+ {
2215
+ "name": "transformer_blocks.5.attn.to_q.weight",
2216
+ "shape": [
2217
+ 4096,
2218
+ 4096
2219
+ ],
2220
+ "source_dtype": "torch.bfloat16",
2221
+ "storage": "nvfp4",
2222
+ "relative_rmse": 0.09447811543941498
2223
+ },
2224
+ {
2225
+ "name": "transformer_blocks.5.attn.to_v.weight",
2226
+ "shape": [
2227
+ 4096,
2228
+ 4096
2229
+ ],
2230
+ "source_dtype": "torch.bfloat16",
2231
+ "storage": "nvfp4",
2232
+ "relative_rmse": 0.09432633221149445
2233
+ },
2234
+ {
2235
+ "name": "transformer_blocks.5.img_mlp.gate_up.weight",
2236
+ "shape": [
2237
+ 24576,
2238
+ 4096
2239
+ ],
2240
+ "source_dtype": "torch.bfloat16",
2241
+ "storage": "nvfp4",
2242
+ "relative_rmse": 0.0945073738694191
2243
+ },
2244
+ {
2245
+ "name": "transformer_blocks.5.img_mlp.out.weight",
2246
+ "shape": [
2247
+ 4096,
2248
+ 12288
2249
+ ],
2250
+ "source_dtype": "torch.bfloat16",
2251
+ "storage": "nvfp4",
2252
+ "relative_rmse": 0.09461148828268051
2253
+ },
2254
+ {
2255
+ "name": "transformer_blocks.6.attn.norm_k.weight",
2256
+ "shape": [
2257
+ 128
2258
+ ],
2259
+ "source_dtype": "torch.bfloat16",
2260
+ "storage": "torch.bfloat16",
2261
+ "sha256": "fbe5113744aff19a2be1ad19a9e3c2c97bdd83cd8d468168d1c5ada895f6b0e1"
2262
+ },
2263
+ {
2264
+ "name": "transformer_blocks.6.attn.norm_q.weight",
2265
+ "shape": [
2266
+ 128
2267
+ ],
2268
+ "source_dtype": "torch.bfloat16",
2269
+ "storage": "torch.bfloat16",
2270
+ "sha256": "2d100b9bb3855e307372e7f60875268e9f760ad441936bc0bc15072a997143cc"
2271
+ },
2272
+ {
2273
+ "name": "transformer_blocks.6.attn.to_k.weight",
2274
+ "shape": [
2275
+ 4096,
2276
+ 4096
2277
+ ],
2278
+ "source_dtype": "torch.bfloat16",
2279
+ "storage": "nvfp4",
2280
+ "relative_rmse": 0.09451349079608917
2281
+ },
2282
+ {
2283
+ "name": "transformer_blocks.6.attn.to_out.0.weight",
2284
+ "shape": [
2285
+ 4096,
2286
+ 4096
2287
+ ],
2288
+ "source_dtype": "torch.bfloat16",
2289
+ "storage": "nvfp4",
2290
+ "relative_rmse": 0.09513034671545029
2291
+ },
2292
+ {
2293
+ "name": "transformer_blocks.6.attn.to_q.weight",
2294
+ "shape": [
2295
+ 4096,
2296
+ 4096
2297
+ ],
2298
+ "source_dtype": "torch.bfloat16",
2299
+ "storage": "nvfp4",
2300
+ "relative_rmse": 0.09451977163553238
2301
+ },
2302
+ {
2303
+ "name": "transformer_blocks.6.attn.to_v.weight",
2304
+ "shape": [
2305
+ 4096,
2306
+ 4096
2307
+ ],
2308
+ "source_dtype": "torch.bfloat16",
2309
+ "storage": "nvfp4",
2310
+ "relative_rmse": 0.09427080303430557
2311
+ },
2312
+ {
2313
+ "name": "transformer_blocks.6.img_mlp.gate_up.weight",
2314
+ "shape": [
2315
+ 24576,
2316
+ 4096
2317
+ ],
2318
+ "source_dtype": "torch.bfloat16",
2319
+ "storage": "nvfp4",
2320
+ "relative_rmse": 0.09461503475904465
2321
+ },
2322
+ {
2323
+ "name": "transformer_blocks.6.img_mlp.out.weight",
2324
+ "shape": [
2325
+ 4096,
2326
+ 12288
2327
+ ],
2328
+ "source_dtype": "torch.bfloat16",
2329
+ "storage": "nvfp4",
2330
+ "relative_rmse": 0.0945393294095993
2331
+ },
2332
+ {
2333
+ "name": "transformer_blocks.7.attn.norm_k.weight",
2334
+ "shape": [
2335
+ 128
2336
+ ],
2337
+ "source_dtype": "torch.bfloat16",
2338
+ "storage": "torch.bfloat16",
2339
+ "sha256": "1702076f2303eb64dc660d2934811de2ac7ef90e816f60fa319d422fc34867d2"
2340
+ },
2341
+ {
2342
+ "name": "transformer_blocks.7.attn.norm_q.weight",
2343
+ "shape": [
2344
+ 128
2345
+ ],
2346
+ "source_dtype": "torch.bfloat16",
2347
+ "storage": "torch.bfloat16",
2348
+ "sha256": "b52ac50f9154d388aa3178a1cc21b1400616120ee3095ad984658f75b5ca0b1c"
2349
+ },
2350
+ {
2351
+ "name": "transformer_blocks.7.attn.to_k.weight",
2352
+ "shape": [
2353
+ 4096,
2354
+ 4096
2355
+ ],
2356
+ "source_dtype": "torch.bfloat16",
2357
+ "storage": "nvfp4",
2358
+ "relative_rmse": 0.09451562166213989
2359
+ },
2360
+ {
2361
+ "name": "transformer_blocks.7.attn.to_out.0.weight",
2362
+ "shape": [
2363
+ 4096,
2364
+ 4096
2365
+ ],
2366
+ "source_dtype": "torch.bfloat16",
2367
+ "storage": "nvfp4",
2368
+ "relative_rmse": 0.0953247919678688
2369
+ },
2370
+ {
2371
+ "name": "transformer_blocks.7.attn.to_q.weight",
2372
+ "shape": [
2373
+ 4096,
2374
+ 4096
2375
+ ],
2376
+ "source_dtype": "torch.bfloat16",
2377
+ "storage": "nvfp4",
2378
+ "relative_rmse": 0.09449370205402374
2379
+ },
2380
+ {
2381
+ "name": "transformer_blocks.7.attn.to_v.weight",
2382
+ "shape": [
2383
+ 4096,
2384
+ 4096
2385
+ ],
2386
+ "source_dtype": "torch.bfloat16",
2387
+ "storage": "nvfp4",
2388
+ "relative_rmse": 0.09425489604473114
2389
+ },
2390
+ {
2391
+ "name": "transformer_blocks.7.img_mlp.gate_up.weight",
2392
+ "shape": [
2393
+ 24576,
2394
+ 4096
2395
+ ],
2396
+ "source_dtype": "torch.bfloat16",
2397
+ "storage": "nvfp4",
2398
+ "relative_rmse": 0.09459647536277771
2399
+ },
2400
+ {
2401
+ "name": "transformer_blocks.7.img_mlp.out.weight",
2402
+ "shape": [
2403
+ 4096,
2404
+ 12288
2405
+ ],
2406
+ "source_dtype": "torch.bfloat16",
2407
+ "storage": "nvfp4",
2408
+ "relative_rmse": 0.09462863206863403
2409
+ },
2410
+ {
2411
+ "name": "transformer_blocks.8.attn.norm_k.weight",
2412
+ "shape": [
2413
+ 128
2414
+ ],
2415
+ "source_dtype": "torch.bfloat16",
2416
+ "storage": "torch.bfloat16",
2417
+ "sha256": "9a56df6095d2a425d0f66275b41bd6c356056735cd3bfa023724e0cd90e8dfff"
2418
+ },
2419
+ {
2420
+ "name": "transformer_blocks.8.attn.norm_q.weight",
2421
+ "shape": [
2422
+ 128
2423
+ ],
2424
+ "source_dtype": "torch.bfloat16",
2425
+ "storage": "torch.bfloat16",
2426
+ "sha256": "ff2c3f870cad641f784f36f95efddfbc098752999384ee69463b39bb1e7f5533"
2427
+ },
2428
+ {
2429
+ "name": "transformer_blocks.8.attn.to_k.weight",
2430
+ "shape": [
2431
+ 4096,
2432
+ 4096
2433
+ ],
2434
+ "source_dtype": "torch.bfloat16",
2435
+ "storage": "nvfp4",
2436
+ "relative_rmse": 0.09443946182727814
2437
+ },
2438
+ {
2439
+ "name": "transformer_blocks.8.attn.to_out.0.weight",
2440
+ "shape": [
2441
+ 4096,
2442
+ 4096
2443
+ ],
2444
+ "source_dtype": "torch.bfloat16",
2445
+ "storage": "nvfp4",
2446
+ "relative_rmse": 0.09550652652978897
2447
+ },
2448
+ {
2449
+ "name": "transformer_blocks.8.attn.to_q.weight",
2450
+ "shape": [
2451
+ 4096,
2452
+ 4096
2453
+ ],
2454
+ "source_dtype": "torch.bfloat16",
2455
+ "storage": "nvfp4",
2456
+ "relative_rmse": 0.0944790169596672
2457
+ },
2458
+ {
2459
+ "name": "transformer_blocks.8.attn.to_v.weight",
2460
+ "shape": [
2461
+ 4096,
2462
+ 4096
2463
+ ],
2464
+ "source_dtype": "torch.bfloat16",
2465
+ "storage": "nvfp4",
2466
+ "relative_rmse": 0.09414148330688477
2467
+ },
2468
+ {
2469
+ "name": "transformer_blocks.8.img_mlp.gate_up.weight",
2470
+ "shape": [
2471
+ 24576,
2472
+ 4096
2473
+ ],
2474
+ "source_dtype": "torch.bfloat16",
2475
+ "storage": "nvfp4",
2476
+ "relative_rmse": 0.09464308619499207
2477
+ },
2478
+ {
2479
+ "name": "transformer_blocks.8.img_mlp.out.weight",
2480
+ "shape": [
2481
+ 4096,
2482
+ 12288
2483
+ ],
2484
+ "source_dtype": "torch.bfloat16",
2485
+ "storage": "nvfp4",
2486
+ "relative_rmse": 0.09467563033103943
2487
+ },
2488
+ {
2489
+ "name": "transformer_blocks.9.attn.norm_k.weight",
2490
+ "shape": [
2491
+ 128
2492
+ ],
2493
+ "source_dtype": "torch.bfloat16",
2494
+ "storage": "torch.bfloat16",
2495
+ "sha256": "7e20746b285a1d254a56aed717f9e22293ea36bb699d5f599b7f43384bd1441a"
2496
+ },
2497
+ {
2498
+ "name": "transformer_blocks.9.attn.norm_q.weight",
2499
+ "shape": [
2500
+ 128
2501
+ ],
2502
+ "source_dtype": "torch.bfloat16",
2503
+ "storage": "torch.bfloat16",
2504
+ "sha256": "c0bb2e40385389a5f7312b3a6c37883d70306a20f0affdd2b8303109431b8c3d"
2505
+ },
2506
+ {
2507
+ "name": "transformer_blocks.9.attn.to_k.weight",
2508
+ "shape": [
2509
+ 4096,
2510
+ 4096
2511
+ ],
2512
+ "source_dtype": "torch.bfloat16",
2513
+ "storage": "nvfp4",
2514
+ "relative_rmse": 0.09447592496871948
2515
+ },
2516
+ {
2517
+ "name": "transformer_blocks.9.attn.to_out.0.weight",
2518
+ "shape": [
2519
+ 4096,
2520
+ 4096
2521
+ ],
2522
+ "source_dtype": "torch.bfloat16",
2523
+ "storage": "nvfp4",
2524
+ "relative_rmse": 0.09517411887645721
2525
+ },
2526
+ {
2527
+ "name": "transformer_blocks.9.attn.to_q.weight",
2528
+ "shape": [
2529
+ 4096,
2530
+ 4096
2531
+ ],
2532
+ "source_dtype": "torch.bfloat16",
2533
+ "storage": "nvfp4",
2534
+ "relative_rmse": 0.09470388293266296
2535
+ },
2536
+ {
2537
+ "name": "transformer_blocks.9.attn.to_v.weight",
2538
+ "shape": [
2539
+ 4096,
2540
+ 4096
2541
+ ],
2542
+ "source_dtype": "torch.bfloat16",
2543
+ "storage": "nvfp4",
2544
+ "relative_rmse": 0.09404205530881882
2545
+ },
2546
+ {
2547
+ "name": "transformer_blocks.9.img_mlp.gate_up.weight",
2548
+ "shape": [
2549
+ 24576,
2550
+ 4096
2551
+ ],
2552
+ "source_dtype": "torch.bfloat16",
2553
+ "storage": "nvfp4",
2554
+ "relative_rmse": 0.09456857293844223
2555
+ },
2556
+ {
2557
+ "name": "transformer_blocks.9.img_mlp.out.weight",
2558
+ "shape": [
2559
+ 4096,
2560
+ 12288
2561
+ ],
2562
+ "source_dtype": "torch.bfloat16",
2563
+ "storage": "nvfp4",
2564
+ "relative_rmse": 0.09464238584041595
2565
+ },
2566
+ {
2567
+ "name": "txt_in.in_layer.weight",
2568
+ "shape": [
2569
+ 4096,
2570
+ 4096
2571
+ ],
2572
+ "source_dtype": "torch.bfloat16",
2573
+ "storage": "torch.bfloat16",
2574
+ "sha256": "2afeaaac182536117eb984cd878e94b3d5447fd1e0989f1c925b55f5b2aba828"
2575
+ },
2576
+ {
2577
+ "name": "txt_in.out_layer.weight",
2578
+ "shape": [
2579
+ 4096,
2580
+ 4096
2581
+ ],
2582
+ "source_dtype": "torch.bfloat16",
2583
+ "storage": "torch.bfloat16",
2584
+ "sha256": "e4c37943834c699fc4e101b3141bee53839b78c096e00cfbd836b8b061162672"
2585
+ },
2586
+ {
2587
+ "name": "txt_in.text_norm.weight",
2588
+ "shape": [
2589
+ 4096
2590
+ ],
2591
+ "source_dtype": "torch.bfloat16",
2592
+ "storage": "torch.bfloat16",
2593
+ "sha256": "b496795d142460d2f72d13b560d7cf54fba3081cc895c2d41b8e00b2470f9efe"
2594
+ }
2595
+ ]
2596
+ }
diffusion_models/prism_image_2.1_nvfp4.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4fdbaec94c19f7b8888f1e1ddbae05354c014492f9b2547b1cd8dca0ce923526
3
+ size 4197574664
text_encoders/prism_qwen3vl_8b_nvfp4.manifest.json ADDED
The diff for this file is too large to render. See raw diff
 
text_encoders/prism_qwen3vl_8b_nvfp4.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cdd9b85bcb60d5cb358ddecfd45a48fa15cb728b70d88bd2028840eaef095d16
3
+ size 7549882768
vae/qwen_image_2.1_vae_bf16.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bb21f7473051e1ac368515dd3f2e15cd44d7a11748ee8823e1ddca3e4876b7c9
3
+ size 675509688