Release Tancho Generator router v5 with two verified checkpoints and reproducible evidence

.gitattributes

@@ -33,3 +33,7 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+checkpoints/balanced288/text_tokenizer/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+checkpoints/balanced288/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+checkpoints/mixed240/text_tokenizer/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+checkpoints/mixed240/tokenizer.json filter=lfs diff=lfs merge=lfs -text

LICENSE-CODE

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) 2026 Tancho contributors
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

NOTICE.md

@@ -0,0 +1,9 @@
+# Licensing and origin
+
+Published by Vox (Tokyo, Japan) under the v13s namespace. Tancho Generator is a derivative of NVIDIA Cosmos3-Edge, pinned revision a9d944e2c6a1bf9f48b92ad16348e70c5f1836ba. Copyright and origin notices in the original retained artifacts are preserved. The pinned upstream model card and available license/notice files are copied under licenses/upstream/ for attribution; its full-model capabilities are not claims about this Tancho release. Model weights and upstream model artifacts are distributed under the accompanying licenses/LICENSE.OpenMDW-1.1. Original Vox code, documentation, and synthetic evaluation records use LICENSE-CODE (MIT); that license does not replace third-party terms.
+
+The pinned NVIDIA Cosmos Framework is a separate dependency, not bundled source software. Install it under its own terms. The exported processor/tokenizer/configuration assets retain their original bytes. The checkpoint provenance files refer to the pinned upstream base snapshot; trained-export file identity is established by release-manifest.json and the checkpoint SHA-256 records.
+
+No GSI footage, extracted frames, client materials, credentials, or complete internal run archives are distributed. Public GSI source imagery informed training; see SOURCES.md. The packaged evidence contains synthetic numerical geometry, image hashes and saved generated text, with no images. These are developer-created records, not official GSI assessments. No NVIDIA, Nebius, or GSI endorsement is asserted.
+
+The dependency file deploy/nebius/edge-parent40-expected-weights.json supplies a historical fingerprint for checking the frozen vision encoder in the audited overlay helper. It is not a parent checkpoint and is not loaded as trained weights. The two released models were independently fine-tuned from the pretrained base.

README.md

@@ -0,0 +1,102 @@
+---
+language:
+- ja
+- en
+license: other
+license_name: openmdw-1.1
+license_link: https://openmdw.ai/license/1-1/
+library_name: cosmos
+base_model: nvidia/Cosmos3-Edge
+base_model_relation: finetune
+tags:
+- physical-ai
+- viewpoint-planning
+- uav
+- research
+- cosmos3
+---
+
+# Tancho Generator — router v5 research release
+
+**A reproducible research baseline for generating numeric observation viewpoints.** Developed in Japan by Vox, Tokyo; compute provided by Nebius AI Cloud. Released September 14, 2026.
+
+This release contains **two fine-tuned checkpoints and a deterministic input-based router**. “v5” is the routing-policy version, not a fifth checkpoint or the upstream model version. It is the current adopted Tancho research baseline. The older [Tancho release](https://huggingface.co/v13s/tancho) contains different weights and a different output protocol; its 21/40 result is not this release's metric.
+
+## What it does
+
+Given a reference image and trusted numeric context (current/target coordinates, target size, required pixels, viewing direction, approved volume, speed and mission-time limits), the Generator emits a JSON list:
+
+```json
+[{"offset_m": [0.0, 20.0, 15.0], "dwell_ms": 2000, "speed_mps": 3.0}]
+```
+
+This is a **format illustration**, not a certified plan. `offset_m` is the displacement from the target in local ENU metres; add the target position to obtain the viewpoint. The other fields are dwell milliseconds and outbound speed in m/s. A separate validator checks the unchanged answer.
+
+This application Generator uses Cosmos's **autoregressive tower**. It does not train the application's Reasoner role (deciding what to observe), use the diffusion tower to produce a continuous camera trajectory, or execute flight control. The intended architecture remains observation objective → viewpoint sequence → detailed camera/aircraft trajectory → flight control.
+
+## Exactly what is released
+
+| Component | Path | Role |
+|---|---|---|
+| mixed240 | `checkpoints/mixed240/` | Default viewpoint generation |
+| balanced288 | `checkpoints/balanced288/` | Eligible stationary observations only |
+| router v5 | `tancho/viewpoint_router.py` | Select once before inference |
+| validators and pinned-backend helpers | `tancho/`, `training/`, `run_request.py` | Preserve raw output and check geometry |
+| saved-output evidence | `evidence/` | Re-score the reported v5 answers without new inference |
+
+Each checkpoint is the original 31-file retained export (4,905,905,551 bytes), including the fine-tuned AR tower and frozen vision encoder. The two exports total 9,811,811,102 bytes before code and documentation. Framework configuration/assets in the exports do not mean diffusion/VAE weights were fine-tuned or that the export alone is a full Cosmos multimodal snapshot. Loading uses the pinned Cosmos Framework and base-overlay procedure in [REPRODUCE.md](REPRODUCE.md), **not a plain `transformers.from_pretrained` call or an HF-hosted inference endpoint**.
+
+Router eligibility requires all of:
+
+- Remaining mission time after return margin is exactly 1, 2, or 3 seconds.
+- Trusted-input preflight is undetermined rather than an established invalid/infeasible request.
+- Conversion of the current position to relative coordinates and back is exact.
+- A current-position, 1000 ms stationary validation probe passes every check.
+
+Eligible inputs use balanced288 with an explicit current-relative-position input. All other inputs use mixed240 and the original relative-coordinate prompt. The probe is only an eligibility check; it is not returned as a model answer. There is one generation per request, without answer repair, retry, or cross-model fallback. The **1/2/3 seconds describe remaining mission budget, not inference latency or flight-control frequency**. The included snapshot also contains older explicit policies and protocol helpers as dependencies; only `viewpoint-router-v5` is the advertised release. Neither move432 nor the experimental timing-input router is released here.
+
+## Measured results and unresolved failures
+
+Success means passing the contract and all evaluated numerical geometry/envelope checks together. These results are from the fixed v4-versus-v5 comparison on September 13, 2026.
+
+| Evaluation group | Cases | v4 accepted | v5 accepted |
+|---|---:|---:|---:|
+| New stationary, 1-second budget | 64 | 56 | 60 |
+| New stationary, 2-second budget | 64 | 53 | 60 |
+| New stationary, 3-second budget | 64 | 53 | 60 |
+| Previously evaluated stationary regression cases | 128 | 111 | 122 |
+| Movement required | 64 | 15 | 15 |
+| Normal numeric conditions | 224 | 221 | 221 |
+| Current viewpoint valid, 4-second boundary | 32 | 0 | 0 |
+| Current position on the wrong side | 32 | 0 | 0 |
+
+New stationary success is **180/192 (93.75%)**, with 22 paired improvements and 4 regressions against v4. This is not overall accuracy. The 352 cases outside the stationary branch had identical raw outputs across policies. All 1,344 original generations and their input/model identities were audited; the original GPU and temporary disk were deleted. The adopted implementation passed 93 related CPU tests.
+
+**The movement and boundary failures remain unresolved.** balanced288 had previously failed a broad deployment comparison due to movement regression; v5 adopts it only within the stationary branch. Later movement/timing experiments do not change these weights or results.
+
+The 544 new numerical geometries were not in earlier packs; 128 cases are explicitly reused regression cases. Reference images reuse the existing evaluation split. Normal cases are 28 base scenes × 8 symmetry transformations, not 224 independent flights. Numerical geometry is synthetic and is not tied to reconstructed objects in the images. Camera scoring uses a fixed 3840-pixel width and 81-degree field of view. Passing does not establish image understanding, occlusion handling, actual image quality, field generalization, or flight safety. The evaluation informed adoption and is not an untouched external certification set.
+
+## Training provenance
+
+Both runs started independently from pinned pretrained `nvidia/Cosmos3-Edge` revision `a9d944e2c6a1bf9f48b92ad16348e70c5f1836ba`; neither continues the retired parent-40 fine-tune.
+
+| Item | mixed240 | balanced288 |
+|---|---|---|
+| Training examples | 480 mixed numeric cases | 576 cases: 480 normal + 96 time-constrained |
+| Epochs / updates | 4 / 240 | 4 / 288 |
+| Learning rate / gradient accumulation | 1e-6 / 8 | 1e-6 / 8 |
+| Evaluated retained export | Final 240-update export | Final 288-update export |
+
+For each model, **233 AR tensors were trainable and 437 vision tensors were frozen**. Verification of 670 exported tensors is not a claim that all 670 were trained. Numerical teachers come from the project's geometry/planning code, not human-reviewed observation decisions. Training uses reference tiles from public GSI Omachi footage, with evaluation tiles separated within the same flight. The synthetic geometry varies independently of the reference imagery. See [SOURCES.md](SOURCES.md).
+
+## Use and release verification
+
+See [REPRODUCE.md](REPRODUCE.md) for download, CPU saved-answer rescoring, request preparation, and the pinned CUDA backend procedure. `smoke.py` re-scores 672 previously generated v5 answers; it makes **zero model calls** and does not measure fresh accuracy. Release verification checks exported bytes and downloaded package behavior; it does not add a new performance benchmark or a Jetson measurement.
+
+Intended runtime is Jetson Orin NX 16GB, but latency, memory use with two checkpoints, and device deployment remain unmeasured. No learned-model real-flight execution has been validated. Upstream capabilities cannot be transferred into claims about this fine-tune.
+
+## Licenses and attribution
+
+Weights and upstream model artifacts retain [OpenMDW 1.1](licenses/LICENSE.OpenMDW-1.1). Original Vox code, documentation, and synthetic evaluation records are under [MIT](LICENSE-CODE); third-party terms remain applicable to their artifacts. [NOTICE.md](NOTICE.md) records scope and attribution. No source footage, extracted frames, client materials, credentials, or complete internal run archives are distributed. NVIDIA, Nebius, and GSI do not endorse this release.
+
+Contact: tancho@vox.delivery

REPRODUCE.md

@@ -0,0 +1,64 @@
+# Download and reproduce
+
+## Scope
+
+This is a custom Cosmos Framework research package. Python 3.11+ and Pillow suffice for the CPU steps. Actual generation requires Linux, an NVIDIA CUDA environment compatible with the pinned framework, the full pinned pretrained base snapshot, and an overlay of the selected export. A generic Transformers loader is not supported. The two checkpoint files are not merged weights.
+
+## Download
+
+```sh
+hf download v13s/tancho-generator-v5 --local-dir tancho-generator-v5
+cd tancho-generator-v5
+python -m pip install -r requirements-cpu.txt
+python verify_files.py
+python smoke.py
+```
+
+For repeatable work, add `--revision COMMIT_SHA` using the immutable commit from the HF revision history. `verify_files.py` checks every file listed in `release-manifest.json`, including both weight exports. The manifest itself is anchored by the HF commit, not a self-signature. `smoke.py` reproduces the recorded group counts by routing and re-scoring 672 saved answers. It does not load model weights or generate new answers.
+
+## Prepare a request without a GPU
+
+Use an RGB observation image you are authorized to process. `examples/normal.json` and `examples/stationary.json` contain synthetic numeric contexts from the evaluated cases. They do not locate objects in your image.
+
+```sh
+python run_request.py --request examples/stationary.json --image /absolute/path/observation.png --output prepared-stationary --prepare-only
+python run_request.py --request examples/normal.json --image /absolute/path/observation.png --output prepared-normal --prepare-only
+```
+
+Expected selections are balanced288 and mixed240 respectively. This step writes the exact prompt, canonical image proof, and routing decision, with zero model calls. It converts the user image to RGB PNG without resizing. Output directories must be new. The route's `checkpoint_prefix` is an original retention identifier; local exports live at `checkpoints/<model>/`.
+
+## Pinned CUDA backend
+
+The original audited runtime used NVIDIA Cosmos Framework revision `0fe093eafbac390ffb7906a6f4ed9f558fe42c4c`, with a clean checkout at `/opt/cosmos-framework`. Install the framework and dependencies for that revision. One recorded environment recipe is:
+
+```sh
+git clone https://github.com/NVIDIA/cosmos-framework.git /opt/cosmos-framework
+git -C /opt/cosmos-framework checkout 0fe093eafbac390ffb7906a6f4ed9f558fe42c4c
+cd /opt/cosmos-framework
+uv sync --frozen --all-extras --group=cu130-train
+export PATH=/opt/cosmos-framework/.venv/bin:$PATH
+```
+
+Run the next commands from the downloaded Tancho repository, using absolute destinations. Obtain the base once; it is larger than the two AR/vision exports and requires additional disk space for overlays. `prepare_model.py` checks the immutable upstream snapshot, and will not silently use a new `main` revision.
+
+```sh
+python training/prepare_model.py --output /absolute/path/cosmos3-edge-base
+python training/prepare_train_v2_overlay.py --base /absolute/path/cosmos3-edge-base --export "$PWD/checkpoints/mixed240" --overlay /absolute/path/overlays/mixed240 --output /absolute/path/proofs/mixed240 --name mixed240
+python training/prepare_train_v2_overlay.py --base /absolute/path/cosmos3-edge-base --export "$PWD/checkpoints/balanced288" --overlay /absolute/path/overlays/balanced288 --output /absolute/path/proofs/balanced288 --name balanced288
+```
+
+The helpers preserve the base, replace and verify 670 AR/vision tensors, and confirm that 437 vision tensors are frozen. `expected-weights.json` records the overlay path and expected loaded tensor hashes. Historical parent-40 metadata is used only as a frozen-vision fingerprint; no parent-40 training weights are loaded. Paths in the generated proof are absolute, so regenerate the overlay proof if relocating it.
+
+Then run one request:
+
+```sh
+python run_request.py --request examples/stationary.json --image /absolute/path/observation.png --output generated-stationary --proof-root /absolute/path/proofs
+```
+
+This invokes the included audited `training/detect_native.py` with one selected model and greedy decoding (seed 42, maximum 768 new tokens), saves the original output and independently validates it. No guard retry flag is passed. Each invocation loads one model; this wrapper does not claim an optimized two-model resident service. A rejected answer remains rejected. Backend errors propagate instead of selecting another model. There is no flight-command transport.
+
+The native backend and overlay procedure were used in the original GPU evaluations. The new public request wrapper is verified through request preparation; publication does not claim a fresh GPU execution of that wrapper or device deployment. Evidence generation used the original reference images, which are not distributed. Using another image is a new inference input, not an exact rerun of the reported score.
+
+## Evaluation records
+
+`evidence/evaluation-summary.json` gives the original paired v4/v5 counts and gates. `evidence/v5-saved-outputs.json` contains all 672 v5 raw answers with synthetic contexts, selected model, prompt hash, and reference-image fingerprint. `smoke.py` validates the router selection and rescoring against that summary. It cannot reconstruct the source image from its hash.

SOURCES.md

@@ -0,0 +1,12 @@
+# Sources for this release
+
+Both Generator training packs use reference-image tiles from the Geospatial Information Authority of Japan (GSI), Nagano City Omachi, October 13, 2019, Typhoon Hagibis. Source footage SHA-256 recorded locally: a112641a9335adc310f872963ce49a4e73d7a9451fe07fc06705286e32379ec2. This is a local provenance checksum, not one issued by GSI.
+
+Official source: https://www.gsi.go.jp/BOUSAI/R1.taihuu19gou.html
+GSI content terms: https://www.gsi.go.jp/kikakuchousei/kikakuchousei40182.html
+
+Attribution: 出典：国土地理院ウェブサイト。動画の切り出し・縮小と合成観測条件・数値教師・評価はTancho開発側で作成。国土地理院の公式評価ではありません。
+
+Training and evaluation tiles are separated within this one flight. Images are reference inputs; synthetic target coordinates have no provided image-to-3D correspondence. mixed240 uses 480 numeric examples; balanced288 uses 576. The released saved answers include newly generated numerical geometry and explicitly marked reused regression cases; they reuse reference evaluation images. No footage or image tiles are included in this repository.
+
+Earlier documents described Omachi as evaluation-only for a retired observation task. That statement does not apply to these Generator training packs. No client footage was used in these checkpoints. Aso, Sannoudani, and other events mentioned in older experiments are not these models' training imagery.

checkpoints/balanced288/00000.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c0d5c3a5990169b923749bcdd38b96aba3d5fbf1736db601f25356332cbac887
+size 4258943864

checkpoints/balanced288/00001.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8c74768e82da9c7fbca8d9e21796db89162b59c4e554996eac77ca8ce9374347
+size 612372944

checkpoints/balanced288/assets/diffusers_outputs/edge_action_id_av_inverse_0_diffusers.json

@@ -0,0 +1,672 @@
+{
+  "data": [
+    [
+      -0.013148754835128784,
+      -0.007273353636264801,
+      0.008258908987045288,
+      0.9254555702209473,
+      -0.018639683723449707,
+      0.004321083426475525,
+      -0.00694487988948822,
+      0.9603041410446167,
+      0.007375245913863182
+    ],
+    [
+      0.0006928369402885437,
+      0.00114353746175766,
+      0.04833635687828064,
+      0.9550113677978516,
+      0.007736995816230774,
+      -0.0007977494969964027,
+      -0.001905590295791626,
+      0.9611708521842957,
+      -0.0071649253368377686
+    ],
+    [
+      0.00024224817752838135,
+      -0.00632748007774353,
+      0.01743471622467041,
+      0.9503518342971802,
+      0.006431609392166138,
+      -0.0021766857244074345,
+      0.004798382520675659,
+      0.9540749192237854,
+      -0.002829238772392273
+    ],
+    [
+      -0.003921394236385822,
+      0.008617669343948364,
+      -0.012175090610980988,
+      0.9608586430549622,
+      -0.008618205785751343,
+      -0.008708074688911438,
+      -0.013742625713348389,
+      0.9400895833969116,
+      0.006977975368499756
+    ],
+    [
+      0.005376532673835754,
+      0.003240346908569336,
+      0.018488049507141113,
+      0.9523720145225525,
+      0.01081898808479309,
+      -0.00035040080547332764,
+      0.00804641842842102,
+      0.9556390643119812,
+      0.012530684471130371
+    ],
+    [
+      0.005463764071464539,
+      0.0012700557708740234,
+      -0.012111283838748932,
+      0.9668004512786865,
+      0.009593963623046875,
+      0.0014052540063858032,
+      0.00772630050778389,
+      0.935010552406311,
+      0.011620238423347473
+    ],
+    [
+      -0.003778284415602684,
+      0.012686282396316528,
+      0.012819170951843262,
+      0.9748083353042603,
+      -0.015680819749832153,
+      -0.0014512911438941956,
+      -0.004034742712974548,
+      0.9654931426048279,
+      0.0029178932309150696
+    ],
+    [
+      0.009581685066223145,
+      -0.0018721558153629303,
+      0.015696480870246887,
+      0.9498556852340698,
+      -0.007028155028820038,
+      -0.003986746072769165,
+      -0.0010101348161697388,
+      0.9363378286361694,
+      0.0034978240728378296
+    ],
+    [
+      0.011020243167877197,
+      0.015359997749328613,
+      0.0042057037353515625,
+      0.9537041783332825,
+      -0.008601069450378418,
+      -0.0073888301849365234,
+      0.0013249143958091736,
+      0.94188392162323,
+      0.0001823045313358307
+    ],
+    [
+      0.008615091443061829,
+      0.005651026964187622,
+      -0.009945794939994812,
+      0.9452113509178162,
+      0.019210517406463623,
+      0.004503607749938965,
+      0.015948235988616943,
+      0.9488579630851746,
+      0.008347108960151672
+    ],
+    [
+      0.001062244176864624,
+      -0.01891157031059265,
+      -0.0280563086271286,
+      0.9730226993560791,
+      0.011333107948303223,
+      -0.000612400472164154,
+      -0.004964202642440796,
+      0.9605361819267273,
+      0.00998196005821228
+    ],
+    [
+      0.0016751736402511597,
+      -0.024208784103393555,
+      -0.024219349026679993,
+      0.9559570550918579,
+      -0.009602159261703491,
+      -0.004984036087989807,
+      0.0061578452587127686,
+      0.950946033000946,
+      0.008079171180725098
+    ],
+    [
+      -0.011940449476242065,
+      -0.0034200847148895264,
+      0.0017094612121582031,
+      0.9588748812675476,
+      0.006712079048156738,
+      -0.004783693701028824,
+      -0.00014981627464294434,
+      0.9792852997779846,
+      -0.00029080547392368317
+    ],
+    [
+      0.0016713226214051247,
+      -0.0047683920711278915,
+      0.0011281678453087807,
+      0.9475633502006531,
+      0.007233217358589172,
+      -9.954720735549927e-05,
+      -0.0002157837152481079,
+      0.9581102132797241,
+      -0.001299828290939331
+    ],
+    [
+      0.006934747099876404,
+      0.008136779069900513,
+      -0.039625704288482666,
+      0.9607610106468201,
+      0.010957300662994385,
+      0.0001928955316543579,
+      0.004511512815952301,
+      0.9533595442771912,
+      0.011611387133598328
+    ],
+    [
+      0.007694117724895477,
+      -0.01480981707572937,
+      0.01341133564710617,
+      0.9478503465652466,
+      0.0021869465708732605,
+      -0.0011091921478509903,
+      0.003402979113161564,
+      0.9389904737472534,
+      -0.0016643255949020386
+    ],
+    [
+      -0.006875067949295044,
+      0.0049460530281066895,
+      0.0421476811170578,
+      0.9672802090644836,
+      -0.01006162166595459,
+      0.0008940547704696655,
+      0.007537230849266052,
+      0.9556049704551697,
+      0.0027959682047367096
+    ],
+    [
+      -0.0024900436401367188,
+      -0.005135815590620041,
+      0.05198696255683899,
+      0.9647979140281677,
+      0.01649463176727295,
+      0.003368660807609558,
+      -0.019760966300964355,
+      0.9663780331611633,
+      -0.004725992679595947
+    ],
+    [
+      -0.0026149116456508636,
+      -0.007602095603942871,
+      0.03872739523649216,
+      0.9427680969238281,
+      -0.0020749270915985107,
+      -0.004558362066745758,
+      -0.011337906122207642,
+      0.9802517890930176,
+      0.0020113736391067505
+    ],
+    [
+      -0.0024757981300354004,
+      -0.007645174860954285,
+      0.07559360563755035,
+      0.9630593061447144,
+      -0.0025666803121566772,
+      -0.00292031466960907,
+      -0.012108653783798218,
+      0.9655929803848267,
+      0.0013676062226295471
+    ],
+    [
+      0.0007936935871839523,
+      0.0024557560682296753,
+      0.036987900733947754,
+      0.9483445882797241,
+      0.006975963711738586,
+      0.0030634403228759766,
+      -0.0004689544439315796,
+      0.9642810225486755,
+      -0.001054992899298668
+    ],
+    [
+      -0.003186628222465515,
+      0.00013031065464019775,
+      0.06438089907169342,
+      0.967340350151062,
+      -0.008410289883613586,
+      -0.007106497883796692,
+      0.010625198483467102,
+      0.9285515546798706,
+      -0.0012674331665039062
+    ],
+    [
+      -0.02860349416732788,
+      -8.131563663482666e-05,
+      0.08170737326145172,
+      0.9743189811706543,
+      0.004199020564556122,
+      0.006051763892173767,
+      0.004216104745864868,
+      0.9849252700805664,
+      -0.01118806004524231
+    ],
+    [
+      0.00029268115758895874,
+      -0.0008304938673973083,
+      0.08716102689504623,
+      0.9572217464447021,
+      0.00250987708568573,
+      -0.0032331272959709167,
+      -0.004110082983970642,
+      0.9600695371627808,
+      -0.0021736174821853638
+    ],
+    [
+      0.016955643892288208,
+      0.0030432939529418945,
+      0.04992994666099548,
+      0.9569373726844788,
+      -0.011746704578399658,
+      -0.0003188829869031906,
+      -0.007667466998100281,
+      0.9866983890533447,
+      0.004928670823574066
+    ],
+    [
+      -0.0039969682693481445,
+      0.00038054585456848145,
+      0.12631714344024658,
+      0.9718866348266602,
+      0.018440932035446167,
+      -0.005601778626441956,
+      -0.009917289018630981,
+      0.9650411605834961,
+      0.005232140421867371
+    ],
+    [
+      -0.0012138709425926208,
+      -0.011934876441955566,
+      0.11297653615474701,
+      0.9682045578956604,
+      0.0012573739513754845,
+      0.0006018783897161484,
+      0.009243190288543701,
+      0.9470562934875488,
+      0.012865453958511353
+    ],
+    [
+      -0.009654894471168518,
+      0.004492349922657013,
+      0.14582459628582,
+      0.941580057144165,
+      -0.027970850467681885,
+      -0.01605433225631714,
+      -0.003179602324962616,
+      0.9500089883804321,
+      -0.005389504134654999
+    ],
+    [
+      0.014612823724746704,
+      -0.004633047617971897,
+      0.14664553105831146,
+      0.9637702703475952,
+      -0.0011444943957030773,
+      -0.0005822107195854187,
+      0.005188122391700745,
+      0.9636419415473938,
+      -0.007603704929351807
+    ],
+    [
+      -0.014512777328491211,
+      -0.00830838829278946,
+      0.14723633229732513,
+      0.9575201272964478,
+      0.009052962064743042,
+      0.002744898200035095,
+      0.00654207170009613,
+      0.9790866374969482,
+      -0.006706550717353821
+    ],
+    [
+      -0.01381877064704895,
+      0.013246327638626099,
+      0.1438756138086319,
+      0.9541648626327515,
+      0.0031017810106277466,
+      -0.010317087173461914,
+      0.004141256213188171,
+      0.9406745433807373,
+      -0.0032720565795898438
+    ],
+    [
+      0.0049401819705963135,
+      0.016335099935531616,
+      0.1370936781167984,
+      0.9569792747497559,
+      0.009543389081954956,
+      -0.0038724213372915983,
+      -0.011453330516815186,
+      0.9742096066474915,
+      -0.013819366693496704
+    ],
+    [
+      0.016965091228485107,
+      -0.014787629246711731,
+      0.18282562494277954,
+      0.952957034111023,
+      0.00769689679145813,
+      -0.006391674280166626,
+      0.00217418372631073,
+      0.9660205841064453,
+      0.006829023361206055
+    ],
+    [
+      0.00011231936514377594,
+      0.022837340831756592,
+      0.21823179721832275,
+      0.9779958128929138,
+      0.0016702637076377869,
+      -0.01641136407852173,
+      0.008365646004676819,
+      0.9648821949958801,
+      -0.015010237693786621
+    ],
+    [
+      -0.003881126642227173,
+      0.008091509342193604,
+      0.16629643738269806,
+      0.9440470933914185,
+      0.017186373472213745,
+      -0.0032056421041488647,
+      0.015325725078582764,
+      0.9715288877487183,
+      0.005628049373626709
+    ],
+    [
+      0.015618979930877686,
+      -0.016067102551460266,
+      0.1358950436115265,
+      0.9455870985984802,
+      0.015390992164611816,
+      0.0032478421926498413,
+      0.007700107991695404,
+      0.949781060218811,
+      0.00139538012444973
+    ],
+    [
+      0.003707513213157654,
+      0.0012879809364676476,
+      0.18519513309001923,
+      0.9606454968452454,
+      -0.016481131315231323,
+      -0.0009821802377700806,
+      -0.0053266435861587524,
+      0.9794431924819946,
+      0.002626672387123108
+    ],
+    [
+      0.016481012105941772,
+      -0.017973721027374268,
+      0.14953568577766418,
+      0.9501946568489075,
+      0.013054758310317993,
+      -0.0001233518123626709,
+      0.002798639237880707,
+      0.963482141494751,
+      0.0029630735516548157
+    ],
+    [
+      0.027081698179244995,
+      -0.008018411695957184,
+      0.19762511551380157,
+      0.9853548407554626,
+      0.007277920842170715,
+      0.0018384754657745361,
+      -0.0006946176290512085,
+      0.9530956149101257,
+      -0.00409291684627533
+    ],
+    [
+      0.009928137063980103,
+      -0.01654413342475891,
+      0.18209686875343323,
+      0.9711376428604126,
+      0.01371067762374878,
+      -0.01334737241268158,
+      -0.011193245649337769,
+      0.9716130495071411,
+      0.005922876298427582
+    ],
+    [
+      0.012314438819885254,
+      -0.0027115456759929657,
+      0.18243494629859924,
+      0.9741570949554443,
+      0.008049450814723969,
+      -0.004693128168582916,
+      -0.003039032220840454,
+      0.9581626057624817,
+      0.012616187334060669
+    ],
+    [
+      0.0076538920402526855,
+      -0.003307037055492401,
+      0.20810538530349731,
+      0.948331892490387,
+      -0.015447914600372314,
+      -0.01176406443119049,
+      -0.0022220220416784286,
+      0.9713965058326721,
+      -0.0014124363660812378
+    ],
+    [
+      0.022586889564990997,
+      -0.008036494255065918,
+      0.21718934178352356,
+      0.9554579257965088,
+      0.028451621532440186,
+      -0.008404174819588661,
+      -0.0012748166918754578,
+      0.9658167362213135,
+      -0.0026244521141052246
+    ],
+    [
+      0.015891581773757935,
+      0.0012519285082817078,
+      0.2355501353740692,
+      0.9612299799919128,
+      -0.005295991897583008,
+      0.00039255619049072266,
+      -0.00497812032699585,
+      0.9328453540802002,
+      -0.002513475716114044
+    ],
+    [
+      0.024546697735786438,
+      0.004739120602607727,
+      0.24198676645755768,
+      0.9556739926338196,
+      0.001108948141336441,
+      -0.010602131485939026,
+      -0.0015903003513813019,
+      0.9675569534301758,
+      0.004108220338821411
+    ],
+    [
+      0.02232934534549713,
+      0.018866419792175293,
+      0.24329781532287598,
+      0.9607975482940674,
+      -0.008478760719299316,
+      -0.00401577353477478,
+      0.005954533815383911,
+      0.961711585521698,
+      -0.008179426193237305
+    ],
+    [
+      0.014459583908319473,
+      0.013193011283874512,
+      0.2807546854019165,
+      0.9628647565841675,
+      0.02138429880142212,
+      -0.009663410484790802,
+      0.012736231088638306,
+      0.9604622721672058,
+      0.004635050892829895
+    ],
+    [
+      0.03173169493675232,
+      -0.008499197661876678,
+      0.2548338770866394,
+      0.9557382464408875,
+      0.0049033742398023605,
+      0.006540834903717041,
+      0.013527542352676392,
+      0.9523492455482483,
+      0.0032977014780044556
+    ],
+    [
+      0.03362193703651428,
+      0.005373731255531311,
+      0.28878676891326904,
+      0.9541832804679871,
+      0.00421798974275589,
+      -0.022053956985473633,
+      -0.007141679525375366,
+      0.9740029573440552,
+      0.002051055431365967
+    ],
+    [
+      0.0156448632478714,
+      0.007966414093971252,
+      0.26515382528305054,
+      0.9523801803588867,
+      0.0037920400500297546,
+      -0.011845819652080536,
+      -0.005416005849838257,
+      0.9764019846916199,
+      0.0025727003812789917
+    ],
+    [
+      0.025211334228515625,
+      -0.0038858801126480103,
+      0.3200596272945404,
+      0.9874192476272583,
+      0.01006472110748291,
+      -0.005867555737495422,
+      0.0030220672488212585,
+      0.950593113899231,
+      -0.002622779458761215
+    ],
+    [
+      0.016667742282152176,
+      0.016612201929092407,
+      0.3063710629940033,
+      0.9813263416290283,
+      0.010637477040290833,
+      -0.0004864633083343506,
+      0.009502381086349487,
+      0.9399935007095337,
+      -0.0036408603191375732
+    ],
+    [
+      0.03205466270446777,
+      -0.005740225315093994,
+      0.3219253718852997,
+      0.9442741870880127,
+      -0.0003297049552202225,
+      -0.007991593331098557,
+      -0.012274682521820068,
+      0.9457107782363892,
+      0.001197025179862976
+    ],
+    [
+      0.019879944622516632,
+      -0.00796326994895935,
+      0.34765785932540894,
+      0.9492185711860657,
+      0.008849918842315674,
+      -0.003306932747364044,
+      0.005508631467819214,
+      0.9591333866119385,
+      0.008243441581726074
+    ],
+    [
+      0.015053778886795044,
+      -0.00721488893032074,
+      0.3408358097076416,
+      0.9282618761062622,
+      0.002898307517170906,
+      -0.00362338125705719,
+      0.027731001377105713,
+      0.9604060053825378,
+      -0.00824989378452301
+    ],
+    [
+      0.015081822872161865,
+      -0.006049111485481262,
+      0.35627633333206177,
+      0.9522294998168945,
+      0.014767050743103027,
+      -0.013559997081756592,
+      -0.0005444735288619995,
+      0.9336357116699219,
+      -0.008866548538208008
+    ],
+    [
+      0.012881480157375336,
+      -0.008715510368347168,
+      0.35815778374671936,
+      0.9767504334449768,
+      0.011995196342468262,
+      -0.0015369206666946411,
+      -0.00036385655403137207,
+      0.9670126438140869,
+      0.006960272789001465
+    ],
+    [
+      0.022443406283855438,
+      -0.002777688205242157,
+      0.3705684542655945,
+      0.9601130485534668,
+      -0.010128200054168701,
+      -0.00759703665971756,
+      0.0009619146585464478,
+      0.968835711479187,
+      -0.006335556507110596
+    ],
+    [
+      0.0191623717546463,
+      -0.003963552415370941,
+      0.3500891327857971,
+      0.9584890007972717,
+      -0.0029276683926582336,
+      -0.015166878700256348,
+      -0.002148374915122986,
+      0.9575344920158386,
+      0.010722845792770386
+    ],
+    [
+      0.006769150495529175,
+      -0.0050390660762786865,
+      0.4090595245361328,
+      0.9641549587249756,
+      -0.002060607075691223,
+      -0.015374422073364258,
+      0.005776405334472656,
+      0.9640921354293823,
+      0.0018393322825431824
+    ]
+  ],
+  "shape": [
+    60,
+    9
+  ],
+  "dtype": "torch.float32",
+  "raw_action_dim": 9,
+  "action_mode": "inverse_dynamics",
+  "domain_id": 1
+}

checkpoints/balanced288/assets/diffusers_outputs/edge_action_id_av_inverse_1_diffusers.json

@@ -0,0 +1,672 @@
+{
+  "data": [
+    [
+      0.059141844511032104,
+      -0.003840334713459015,
+      1.0373594760894775,
+      0.9279366731643677,
+      -0.01645451784133911,
+      -0.020578712224960327,
+      -0.010958120226860046,
+      0.9640744924545288,
+      0.0024261921644210815
+    ],
+    [
+      0.07163303345441818,
+      0.002209894359111786,
+      1.0704994201660156,
+      0.9624326229095459,
+      0.011429950594902039,
+      -0.02556397207081318,
+      -0.005203992128372192,
+      0.968371570110321,
+      -0.005390077829360962
+    ],
+    [
+      0.06948350369930267,
+      -0.014859065413475037,
+      1.0249040126800537,
+      0.9573811292648315,
+      0.007525742053985596,
+      -0.027830475941300392,
+      0.006637901067733765,
+      0.9581300616264343,
+      0.00023680925369262695
+    ],
+    [
+      0.07753375917673111,
+      0.004523158073425293,
+      0.9877839684486389,
+      0.9649670124053955,
+      -0.006604701280593872,
+      -0.037096068263053894,
+      -0.021954774856567383,
+      0.9435235261917114,
+      0.013597071170806885
+    ],
+    [
+      0.09455021470785141,
+      -0.0016047954559326172,
+      1.0100252628326416,
+      0.9584341645240784,
+      0.014761030673980713,
+      -0.029446259140968323,
+      0.00870533287525177,
+      0.968270480632782,
+      0.0247458815574646
+    ],
+    [
+      0.10178711265325546,
+      -0.0029810070991516113,
+      0.9616026878356934,
+      0.9771547913551331,
+      0.01504051685333252,
+      -0.031167365610599518,
+      0.0053897276520729065,
+      0.9344217777252197,
+      0.012324824929237366
+    ],
+    [
+      0.10360411554574966,
+      0.01793801784515381,
+      0.9839838743209839,
+      0.986229658126831,
+      -0.011833727359771729,
+      -0.038624923676252365,
+      -0.007526323199272156,
+      0.9758810997009277,
+      0.005369395017623901
+    ],
+    [
+      0.12239452451467514,
+      0.010958259925246239,
+      0.9665457010269165,
+      0.9559676647186279,
+      -0.0019251927733421326,
+      -0.039464741945266724,
+      -0.005040377378463745,
+      0.9393422603607178,
+      0.00036060065031051636
+    ],
+    [
+      0.13781818747520447,
+      0.04306331276893616,
+      0.9548782110214233,
+      0.9634062051773071,
+      -0.0013715922832489014,
+      -0.045522540807724,
+      -0.0034839287400245667,
+      0.9445981979370117,
+      -0.0009270161390304565
+    ],
+    [
+      0.13575460016727448,
+      0.026487261056900024,
+      0.9226974844932556,
+      0.9517682790756226,
+      0.024003714323043823,
+      -0.03737533092498779,
+      0.013349950313568115,
+      0.9547375440597534,
+      0.00824420154094696
+    ],
+    [
+      0.12451967597007751,
+      -0.0071739256381988525,
+      0.9000017642974854,
+      0.9793621301651001,
+      0.011195510625839233,
+      -0.04407672584056854,
+      -0.00877419114112854,
+      0.9616803526878357,
+      0.011973768472671509
+    ],
+    [
+      0.12706036865711212,
+      -0.014932453632354736,
+      0.9002858400344849,
+      0.9622393250465393,
+      -0.00951644778251648,
+      -0.04734916239976883,
+      0.003892853856086731,
+      0.9567041397094727,
+      0.013047799468040466
+    ],
+    [
+      0.11344760656356812,
+      0.01170305535197258,
+      0.9190186858177185,
+      0.9637442231178284,
+      0.011624082922935486,
+      -0.04697572439908981,
+      -0.0024839788675308228,
+      0.9862824082374573,
+      0.0046536242589354515
+    ],
+    [
+      0.1317308247089386,
+      0.01151534914970398,
+      0.9060279726982117,
+      0.950132429599762,
+      0.013150960206985474,
+      -0.042732544243335724,
+      -0.006613433361053467,
+      0.9610092043876648,
+      0.0009927898645401
+    ],
+    [
+      0.13878925144672394,
+      0.027730464935302734,
+      0.8691807985305786,
+      0.9631220698356628,
+      0.016683101654052734,
+      -0.038141220808029175,
+      -0.002742782235145569,
+      0.9560869932174683,
+      0.009326145052909851
+    ],
+    [
+      0.13446137309074402,
+      0.0007270127534866333,
+      0.9065344333648682,
+      0.9507459402084351,
+      0.007336311042308807,
+      -0.04232313856482506,
+      -0.001765731256455183,
+      0.9377214908599854,
+      -0.004297852516174316
+    ],
+    [
+      0.11476296186447144,
+      0.02131199836730957,
+      0.9385601878166199,
+      0.9792501926422119,
+      -0.0066051185131073,
+      -0.04161176085472107,
+      0.0019875168800354004,
+      0.9670274257659912,
+      0.005515553057193756
+    ],
+    [
+      0.12210288643836975,
+      0.014036169275641441,
+      0.9407962560653687,
+      0.9701698422431946,
+      0.020105689764022827,
+      -0.040228381752967834,
+      -0.020383119583129883,
+      0.9672138094902039,
+      0.0005619972944259644
+    ],
+    [
+      0.12542369961738586,
+      0.012022823095321655,
+      0.9342747926712036,
+      0.9483041763305664,
+      0.0013997424393892288,
+      -0.046562936156988144,
+      -0.02045336365699768,
+      0.9865255355834961,
+      0.00695318728685379
+    ],
+    [
+      0.11753255128860474,
+      0.016480877995491028,
+      0.977397084236145,
+      0.9714816212654114,
+      0.0014084279537200928,
+      -0.04178629815578461,
+      -0.01719522476196289,
+      0.9729042649269104,
+      0.004064872860908508
+    ],
+    [
+      0.12327518314123154,
+      0.026617400348186493,
+      0.9441711902618408,
+      0.9547913670539856,
+      0.009748861193656921,
+      -0.03178030252456665,
+      -0.005975648760795593,
+      0.9724594950675964,
+      0.0015931297093629837
+    ],
+    [
+      0.11693878471851349,
+      0.021891258656978607,
+      0.9779582023620605,
+      0.9773543477058411,
+      -0.0021515488624572754,
+      -0.043881744146347046,
+      0.005668759346008301,
+      0.9312025308609009,
+      -0.0018804669380187988
+    ],
+    [
+      0.09713619947433472,
+      0.022913970053195953,
+      0.9865879416465759,
+      0.984277606010437,
+      0.008582152426242828,
+      -0.035678133368492126,
+      -0.003005385398864746,
+      0.9906625747680664,
+      -0.010433465242385864
+    ],
+    [
+      0.11487491428852081,
+      0.02062314748764038,
+      1.004561185836792,
+      0.9658318161964417,
+      0.00811738520860672,
+      -0.0393141433596611,
+      -0.008064255118370056,
+      0.9643077850341797,
+      -0.00047591328620910645
+    ],
+    [
+      0.12689977884292603,
+      0.02446255087852478,
+      0.9813741445541382,
+      0.9599205255508423,
+      -0.007350906729698181,
+      -0.03434314206242561,
+      -0.0102815181016922,
+      0.99027019739151,
+      0.002850934863090515
+    ],
+    [
+      0.10348488390445709,
+      0.01788690686225891,
+      1.0414836406707764,
+      0.9772853851318359,
+      0.019330114126205444,
+      -0.041947878897190094,
+      -0.013509660959243774,
+      0.9699065089225769,
+      0.005952954292297363
+    ],
+    [
+      0.10493399202823639,
+      0.010198116302490234,
+      1.0407824516296387,
+      0.9719204902648926,
+      0.0058035897091031075,
+      -0.03458989039063454,
+      0.003740936517715454,
+      0.9522305130958557,
+      0.012766420841217041
+    ],
+    [
+      0.09770180284976959,
+      0.024997010827064514,
+      1.0794150829315186,
+      0.9405001401901245,
+      -0.02436143159866333,
+      -0.04618346691131592,
+      -0.008885281160473824,
+      0.9424073696136475,
+      -0.0033924728631973267
+    ],
+    [
+      0.11438962817192078,
+      0.01623646914958954,
+      1.0927131175994873,
+      0.9766831398010254,
+      0.0005866186693310738,
+      -0.030141858384013176,
+      0.0021623969078063965,
+      0.9683176875114441,
+      -0.0047433823347091675
+    ],
+    [
+      0.07521477341651917,
+      0.008214041590690613,
+      1.098933219909668,
+      0.9660043120384216,
+      0.007547542452812195,
+      -0.025479033589363098,
+      0.004106804728507996,
+      0.9826686978340149,
+      -0.001127287745475769
+    ],
+    [
+      0.07278415560722351,
+      0.0321023166179657,
+      1.1175589561462402,
+      0.9674540758132935,
+      0.005659177899360657,
+      -0.038438498973846436,
+      -0.0007940381765365601,
+      0.9435781240463257,
+      -0.0032588541507720947
+    ],
+    [
+      0.08530683070421219,
+      0.02760574221611023,
+      1.123960018157959,
+      0.9651504158973694,
+      0.010333657264709473,
+      -0.02847376838326454,
+      -0.014152109622955322,
+      0.9765793681144714,
+      -0.007708162069320679
+    ],
+    [
+      0.08623477816581726,
+      -2.8833746910095215e-05,
+      1.1860765218734741,
+      0.9632298350334167,
+      0.009518980979919434,
+      -0.028353288769721985,
+      0.0003351382911205292,
+      0.9702121019363403,
+      0.011311382055282593
+    ],
+    [
+      0.06764379888772964,
+      0.028459995985031128,
+      1.228102207183838,
+      0.9854918718338013,
+      0.004853567108511925,
+      -0.030850589275360107,
+      0.005490615963935852,
+      0.9692810773849487,
+      -0.004521816968917847
+    ],
+    [
+      0.05355161428451538,
+      0.020747363567352295,
+      1.2010810375213623,
+      0.951269805431366,
+      0.016863375902175903,
+      -0.017977416515350342,
+      0.01373264193534851,
+      0.9801374077796936,
+      0.014254122972488403
+    ],
+    [
+      0.07317647337913513,
+      0.0030185580253601074,
+      1.18898344039917,
+      0.9577667713165283,
+      0.01679345965385437,
+      -0.010508865118026733,
+      0.006877075880765915,
+      0.9590687155723572,
+      0.005443556234240532
+    ],
+    [
+      0.04951860010623932,
+      0.01835135743021965,
+      1.2524373531341553,
+      0.9677692651748657,
+      -0.012610375881195068,
+      -0.01456555724143982,
+      -0.005562201142311096,
+      0.9804211854934692,
+      0.005360782146453857
+    ],
+    [
+      0.057762667536735535,
+      -0.0012004673480987549,
+      1.2260611057281494,
+      0.9578285217285156,
+      0.0164794921875,
+      -0.00892224907875061,
+      -0.002040460705757141,
+      0.9750438332557678,
+      0.010551542043685913
+    ],
+    [
+      0.0635719895362854,
+      0.009304247796535492,
+      1.2985970973968506,
+      0.997957170009613,
+      0.005984649062156677,
+      -0.006568968296051025,
+      -0.005957365036010742,
+      0.9624383449554443,
+      0.0034569650888442993
+    ],
+    [
+      0.030685484409332275,
+      -0.0031789839267730713,
+      1.2745897769927979,
+      0.9833477735519409,
+      0.015771299600601196,
+      -0.02075822651386261,
+      -0.018386155366897583,
+      0.9756336212158203,
+      0.011255372315645218
+    ],
+    [
+      0.023339152336120605,
+      0.010662931948900223,
+      1.300084114074707,
+      0.989835262298584,
+      0.006620235741138458,
+      -0.0073957666754722595,
+      -0.006816834211349487,
+      0.9638521075248718,
+      0.01855221390724182
+    ],
+    [
+      0.012639999389648438,
+      0.007987678050994873,
+      1.3306738138198853,
+      0.9491333961486816,
+      -0.020535647869110107,
+      -0.01028469204902649,
+      -0.002563953399658203,
+      0.9858134388923645,
+      0.0020048022270202637
+    ],
+    [
+      0.02348978817462921,
+      -0.0019411742687225342,
+      1.3654818534851074,
+      0.969693124294281,
+      0.027309060096740723,
+      -0.004834961146116257,
+      -0.0036605969071388245,
+      0.9743373990058899,
+      0.003153502941131592
+    ],
+    [
+      0.013904020190238953,
+      0.013629376888275146,
+      1.394413948059082,
+      0.972601592540741,
+      -0.00408954918384552,
+      0.004027083516120911,
+      -0.008378058671951294,
+      0.9446616172790527,
+      0.0034879446029663086
+    ],
+    [
+      0.02238820493221283,
+      0.01910078525543213,
+      1.4235327243804932,
+      0.968029797077179,
+      0.004553822800517082,
+      -0.0062204450368881226,
+      -0.003272419795393944,
+      0.977702260017395,
+      0.00832560658454895
+    ],
+    [
+      0.02112443745136261,
+      0.04720121622085571,
+      1.4362165927886963,
+      0.9765746593475342,
+      -0.013532817363739014,
+      0.001711629331111908,
+      0.007163316011428833,
+      0.9686256647109985,
+      -0.010016411542892456
+    ],
+    [
+      0.007742851972579956,
+      0.03149166703224182,
+      1.4930720329284668,
+      0.9732664823532104,
+      0.01966017484664917,
+      -0.0022897571325302124,
+      0.011702001094818115,
+      0.96928870677948,
+      0.006121553480625153
+    ],
+    [
+      0.022700637578964233,
+      0.010335221886634827,
+      1.4739594459533691,
+      0.9702088832855225,
+      0.0024269153364002705,
+      0.01349705457687378,
+      0.013742953538894653,
+      0.9670001864433289,
+      0.006703421473503113
+    ],
+    [
+      0.02724406123161316,
+      0.02931670844554901,
+      1.5207319259643555,
+      0.9660757184028625,
+      0.004963122308254242,
+      -0.017152994871139526,
+      -0.009395450353622437,
+      0.9865334630012512,
+      0.009139366447925568
+    ],
+    [
+      0.008380383253097534,
+      0.024726346135139465,
+      1.4987715482711792,
+      0.9654471278190613,
+      0.0028583072125911713,
+      -0.005337700247764587,
+      -0.0050354450941085815,
+      0.9871041774749756,
+      0.006967529654502869
+    ],
+    [
+      0.01739254593849182,
+      0.012995205819606781,
+      1.5692707300186157,
+      1.0089263916015625,
+      0.013926923274993896,
+      0.0009343177080154419,
+      0.004500538110733032,
+      0.9502257108688354,
+      0.006055116653442383
+    ],
+    [
+      0.009858133271336555,
+      0.03461769223213196,
+      1.5677274465560913,
+      0.9968569278717041,
+      0.011664733290672302,
+      0.004488259553909302,
+      0.00662684440612793,
+      0.9470456838607788,
+      0.0005231946706771851
+    ],
+    [
+      0.02299785614013672,
+      0.009481832385063171,
+      1.5700998306274414,
+      0.9577478766441345,
+      0.00069449283182621,
+      -0.0011343881487846375,
+      -0.016278564929962158,
+      0.958492636680603,
+      0.006463430821895599
+    ],
+    [
+      0.005318776238709688,
+      0.008516699075698853,
+      1.615574836730957,
+      0.9617098569869995,
+      0.007522448897361755,
+      0.0025394558906555176,
+      0.005760625004768372,
+      0.9720036387443542,
+      0.015061944723129272
+    ],
+    [
+      0.007067561149597168,
+      0.0065644532442092896,
+      1.6096922159194946,
+      0.9413715600967407,
+      -0.0019346103072166443,
+      0.002095624804496765,
+      0.02600991725921631,
+      0.974121630191803,
+      -0.006266683340072632
+    ],
+    [
+      0.007169589400291443,
+      0.009554922580718994,
+      1.6439979076385498,
+      0.964790403842926,
+      0.014039307832717896,
+      -0.006732136011123657,
+      0.00041218847036361694,
+      0.9473226070404053,
+      -0.01044127345085144
+    ],
+    [
+      0.007147058844566345,
+      0.00785742700099945,
+      1.644051194190979,
+      0.985714852809906,
+      0.0075702965259552,
+      0.0006187558174133301,
+      -0.000648103654384613,
+      0.9734295010566711,
+      0.009049922227859497
+    ],
+    [
+      0.015374734997749329,
+      0.014419212937355042,
+      1.6574026346206665,
+      0.9712061285972595,
+      -0.01914668083190918,
+      -0.0018936395645141602,
+      -0.0007403641939163208,
+      0.9860180616378784,
+      -0.006495922803878784
+    ],
+    [
+      0.013697490096092224,
+      0.013768978416919708,
+      1.642235517501831,
+      0.9747515916824341,
+      -0.002270542085170746,
+      -0.011506795883178711,
+      -0.006279811263084412,
+      0.9668055772781372,
+      0.013116374611854553
+    ],
+    [
+      -0.0011235475540161133,
+      0.013980269432067871,
+      1.7224175930023193,
+      0.9761761426925659,
+      -0.0001882612705230713,
+      -0.008678078651428223,
+      0.002798914909362793,
+      0.9733132719993591,
+      0.00561833381652832
+    ]
+  ],
+  "shape": [
+    60,
+    9
+  ],
+  "dtype": "torch.float32",
+  "raw_action_dim": 9,
+  "action_mode": "inverse_dynamics",
+  "domain_id": 1
+}

checkpoints/balanced288/assets/edge_action_id_av_0_output.json

@@ -0,0 +1,672 @@
+{
+  "data": [
+    [
+      0.0107421875,
+      -0.00048828125,
+      0.0859375,
+      0.95703125,
+      0.0025634765625,
+      0.00390625,
+      0.0087890625,
+      0.9609375,
+      0.00390625
+    ],
+    [
+      -0.004638671875,
+      0.005859375,
+      -0.0146484375,
+      0.96875,
+      0.01171875,
+      -0.0009765625,
+      -0.0029296875,
+      0.9609375,
+      0.0068359375
+    ],
+    [
+      0.0078125,
+      0.0009765625,
+      0.0048828125,
+      0.921875,
+      0.015625,
+      -0.013671875,
+      0.0234375,
+      0.9765625,
+      -0.00341796875
+    ],
+    [
+      -0.003173828125,
+      0.005859375,
+      0.0078125,
+      0.9609375,
+      -0.0029296875,
+      -0.000244140625,
+      0.009765625,
+      0.9609375,
+      0.0029296875
+    ],
+    [
+      -0.005615234375,
+      -0.01953125,
+      -0.00927734375,
+      0.9609375,
+      0.005859375,
+      -0.009765625,
+      -0.0087890625,
+      0.9609375,
+      -0.001953125
+    ],
+    [
+      -0.013671875,
+      -0.01953125,
+      -0.012939453125,
+      0.9453125,
+      -0.001953125,
+      0.001953125,
+      -0.0029296875,
+      0.92578125,
+      -0.001953125
+    ],
+    [
+      0.00341796875,
+      -0.0086669921875,
+      0.0078125,
+      0.9609375,
+      0.00244140625,
+      0.0048828125,
+      0.009765625,
+      0.9453125,
+      0.00146484375
+    ],
+    [
+      -0.015625,
+      0.00390625,
+      -0.02734375,
+      0.94140625,
+      -0.0048828125,
+      -0.0029296875,
+      -0.0078125,
+      0.96484375,
+      0.0028076171875
+    ],
+    [
+      0.013671875,
+      0.0009765625,
+      -0.0390625,
+      0.9453125,
+      0.0078125,
+      0.005859375,
+      -0.01953125,
+      0.921875,
+      -0.009765625
+    ],
+    [
+      0.005859375,
+      0.005859375,
+      -0.006591796875,
+      0.9765625,
+      -0.0029296875,
+      -0.00244140625,
+      -0.0009765625,
+      0.96875,
+      0.015625
+    ],
+    [
+      -0.013671875,
+      -0.013671875,
+      -0.0078125,
+      0.96875,
+      -0.0009765625,
+      0.002197265625,
+      -0.015625,
+      0.95703125,
+      -0.01171875
+    ],
+    [
+      0.001708984375,
+      0.01953125,
+      -0.0078125,
+      0.9453125,
+      -0.0087890625,
+      0.005859375,
+      0.0126953125,
+      0.9375,
+      0.013671875
+    ],
+    [
+      0.005859375,
+      -0.0009765625,
+      -0.0111083984375,
+      0.94921875,
+      -0.013671875,
+      -0.001708984375,
+      0.009765625,
+      0.953125,
+      0.002197265625
+    ],
+    [
+      -0.0009765625,
+      -0.021484375,
+      0.021484375,
+      0.96484375,
+      -0.0087890625,
+      -0.0078125,
+      0.00341796875,
+      0.953125,
+      -0.005859375
+    ],
+    [
+      0.02734375,
+      -0.01953125,
+      0.0068359375,
+      0.95703125,
+      0.009765625,
+      0.00244140625,
+      -0.0078125,
+      0.953125,
+      0.013671875
+    ],
+    [
+      0.017578125,
+      -0.00927734375,
+      0.046875,
+      0.95703125,
+      0.0087890625,
+      0.001953125,
+      -0.009765625,
+      0.9453125,
+      0.01171875
+    ],
+    [
+      0.01171875,
+      0.0087890625,
+      0.01611328125,
+      0.9453125,
+      -0.004638671875,
+      -0.0087890625,
+      0.00537109375,
+      0.953125,
+      -0.01171875
+    ],
+    [
+      0.001220703125,
+      0.00390625,
+      0.0458984375,
+      0.9609375,
+      0.0078125,
+      0.0029296875,
+      0.0087890625,
+      0.94921875,
+      0.0048828125
+    ],
+    [
+      -0.005859375,
+      0.001953125,
+      0.02392578125,
+      0.98046875,
+      0.01953125,
+      0.005859375,
+      0.00634765625,
+      0.95703125,
+      0.005859375
+    ],
+    [
+      -0.0068359375,
+      -0.003662109375,
+      0.0634765625,
+      0.9296875,
+      -0.0068359375,
+      0.0001220703125,
+      0.015625,
+      0.94921875,
+      0.000244140625
+    ],
+    [
+      0.0068359375,
+      0.005859375,
+      0.06591796875,
+      0.9296875,
+      -0.01171875,
+      0.0029296875,
+      0.013671875,
+      0.953125,
+      -0.00390625
+    ],
+    [
+      0.01171875,
+      -0.02734375,
+      0.07421875,
+      0.9609375,
+      0.0078125,
+      0.0078125,
+      0.013671875,
+      0.9765625,
+      0.00390625
+    ],
+    [
+      -0.0018310546875,
+      0.013671875,
+      0.0888671875,
+      0.95703125,
+      -0.015625,
+      0.001953125,
+      0.009765625,
+      0.96875,
+      0.0078125
+    ],
+    [
+      0.015625,
+      -0.025390625,
+      0.08251953125,
+      0.94921875,
+      0.0068359375,
+      -0.013671875,
+      -0.002197265625,
+      0.96875,
+      0.001953125
+    ],
+    [
+      0.017578125,
+      0.00146484375,
+      0.09619140625,
+      0.94140625,
+      0.0029296875,
+      0.01171875,
+      0.0067138671875,
+      0.9296875,
+      0.0029296875
+    ],
+    [
+      -0.0001220703125,
+      -0.025390625,
+      0.111328125,
+      0.96875,
+      0.00390625,
+      -0.001220703125,
+      0.0006103515625,
+      0.94140625,
+      0.00048828125
+    ],
+    [
+      0.00146484375,
+      0.0078125,
+      0.08935546875,
+      0.94921875,
+      -0.00238037109375,
+      -0.0087890625,
+      -0.005859375,
+      0.95703125,
+      0.0029296875
+    ],
+    [
+      -0.00390625,
+      0.0078125,
+      0.10302734375,
+      0.9609375,
+      0.005859375,
+      0.0078125,
+      0.0068359375,
+      0.9453125,
+      -0.0009765625
+    ],
+    [
+      -0.0087890625,
+      0.0029296875,
+      0.10986328125,
+      0.9765625,
+      0.00048828125,
+      -0.0078125,
+      0.017578125,
+      0.95703125,
+      -0.0087890625
+    ],
+    [
+      -0.00665283203125,
+      0.0078125,
+      0.1064453125,
+      0.953125,
+      0.00244140625,
+      -0.015625,
+      0.000244140625,
+      0.96875,
+      0.00146484375
+    ],
+    [
+      -0.00146484375,
+      -0.00384521484375,
+      0.15625,
+      0.9609375,
+      -0.01171875,
+      0.01171875,
+      0.013671875,
+      0.95703125,
+      -0.0029296875
+    ],
+    [
+      0.0048828125,
+      0.013671875,
+      0.1318359375,
+      0.94921875,
+      0.00439453125,
+      -0.005859375,
+      0.003662109375,
+      0.96875,
+      -0.00244140625
+    ],
+    [
+      -0.01171875,
+      0.01171875,
+      0.138671875,
+      0.953125,
+      -0.0078125,
+      0.0009765625,
+      0.009765625,
+      0.953125,
+      0.0078125
+    ],
+    [
+      -0.00390625,
+      -0.006103515625,
+      0.138671875,
+      0.97265625,
+      0.002197265625,
+      0.0009765625,
+      0.0048828125,
+      0.9453125,
+      0.00341796875
+    ],
+    [
+      0.0009765625,
+      -0.0028076171875,
+      0.17578125,
+      0.953125,
+      0.00048828125,
+      0.0,
+      0.005859375,
+      0.96875,
+      0.0009765625
+    ],
+    [
+      0.0078125,
+      -0.00439453125,
+      0.150390625,
+      0.953125,
+      -0.0068359375,
+      0.0,
+      -0.0078125,
+      0.95703125,
+      0.0029296875
+    ],
+    [
+      -0.0009765625,
+      0.0048828125,
+      0.15234375,
+      0.9453125,
+      -0.0068359375,
+      -0.005859375,
+      0.00390625,
+      0.92578125,
+      0.0078125
+    ],
+    [
+      0.00341796875,
+      0.001953125,
+      0.14453125,
+      0.96484375,
+      0.0009765625,
+      -0.017578125,
+      -0.001953125,
+      0.96875,
+      0.00146484375
+    ],
+    [
+      0.009765625,
+      0.0,
+      0.197265625,
+      0.9609375,
+      0.00341796875,
+      -0.00390625,
+      0.005859375,
+      0.96484375,
+      0.00390625
+    ],
+    [
+      0.0087890625,
+      -0.0015869140625,
+      0.1826171875,
+      0.97265625,
+      0.0054931640625,
+      -0.00390625,
+      0.00048828125,
+      0.9765625,
+      0.009765625
+    ],
+    [
+      0.00390625,
+      0.0001220703125,
+      0.19921875,
+      0.9609375,
+      0.015625,
+      -0.0126953125,
+      -0.0078125,
+      0.984375,
+      0.015625
+    ],
+    [
+      0.0205078125,
+      0.005859375,
+      0.21875,
+      0.9609375,
+      0.01953125,
+      -0.01025390625,
+      -0.0029296875,
+      0.96875,
+      0.00390625
+    ],
+    [
+      0.029296875,
+      -0.00927734375,
+      0.22265625,
+      0.9609375,
+      0.00341796875,
+      -0.001953125,
+      0.00390625,
+      0.96484375,
+      -0.00390625
+    ],
+    [
+      0.021484375,
+      -0.004638671875,
+      0.1875,
+      0.9765625,
+      0.004638671875,
+      -0.0126953125,
+      -0.003173828125,
+      0.97265625,
+      0.001708984375
+    ],
+    [
+      0.01239013671875,
+      0.0068359375,
+      0.236328125,
+      0.96875,
+      -0.009765625,
+      -0.013671875,
+      0.01953125,
+      0.953125,
+      0.0068359375
+    ],
+    [
+      0.025390625,
+      -0.017578125,
+      0.244140625,
+      0.95703125,
+      -0.01953125,
+      -0.0087890625,
+      0.01171875,
+      0.95703125,
+      0.01953125
+    ],
+    [
+      0.0194091796875,
+      0.0078125,
+      0.251953125,
+      0.953125,
+      -0.00048828125,
+      0.001953125,
+      0.00152587890625,
+      0.95703125,
+      -0.0078125
+    ],
+    [
+      0.0166015625,
+      -0.0068359375,
+      0.2265625,
+      0.9453125,
+      0.000732421875,
+      -0.01953125,
+      0.00390625,
+      0.9453125,
+      -0.00341796875
+    ],
+    [
+      0.016845703125,
+      0.00341796875,
+      0.26171875,
+      0.9453125,
+      -0.001953125,
+      -0.005859375,
+      0.00390625,
+      0.9375,
+      0.00390625
+    ],
+    [
+      0.014892578125,
+      0.0087890625,
+      0.298828125,
+      0.953125,
+      0.005859375,
+      -0.009033203125,
+      0.0009765625,
+      0.953125,
+      -0.0029296875
+    ],
+    [
+      0.0224609375,
+      -0.0234375,
+      0.30078125,
+      0.9609375,
+      0.005859375,
+      -0.0048828125,
+      -0.0003662109375,
+      0.9609375,
+      0.009765625
+    ],
+    [
+      0.017822265625,
+      0.005859375,
+      0.322265625,
+      0.9609375,
+      -0.0029296875,
+      -0.00634765625,
+      -0.001220703125,
+      0.96875,
+      0.0029296875
+    ],
+    [
+      0.02392578125,
+      -0.00390625,
+      0.30078125,
+      0.9375,
+      0.0006103515625,
+      0.00390625,
+      -0.005859375,
+      0.93359375,
+      0.003662109375
+    ],
+    [
+      0.0185546875,
+      -0.0020751953125,
+      0.333984375,
+      0.94921875,
+      0.001220703125,
+      -0.015625,
+      -0.00048828125,
+      0.96875,
+      0.0048828125
+    ],
+    [
+      0.0185546875,
+      0.01171875,
+      0.326171875,
+      0.9453125,
+      0.0023193359375,
+      -0.008056640625,
+      0.00146484375,
+      0.95703125,
+      -0.0068359375
+    ],
+    [
+      0.0162353515625,
+      0.015625,
+      0.35546875,
+      0.953125,
+      0.009765625,
+      -0.0068359375,
+      0.01171875,
+      0.96875,
+      0.0
+    ],
+    [
+      0.02099609375,
+      0.000244140625,
+      0.375,
+      0.95703125,
+      -0.0009765625,
+      -0.0029296875,
+      -0.0009765625,
+      0.96484375,
+      0.00390625
+    ],
+    [
+      0.0145263671875,
+      -0.015625,
+      0.369140625,
+      0.96484375,
+      0.00164794921875,
+      -0.01171875,
+      -0.00537109375,
+      0.953125,
+      -0.0009765625
+    ],
+    [
+      0.021484375,
+      0.00390625,
+      0.37109375,
+      0.953125,
+      0.00048828125,
+      -0.013671875,
+      0.0048828125,
+      0.95703125,
+      0.001953125
+    ],
+    [
+      0.018798828125,
+      -0.0078125,
+      0.41015625,
+      0.95703125,
+      -0.01171875,
+      -0.00390625,
+      -0.0068359375,
+      0.9609375,
+      0.005859375
+    ]
+  ],
+  "shape": [
+    60,
+    9
+  ],
+  "dtype": "torch.bfloat16",
+  "raw_action_dim": 9,
+  "action_mode": "inverse_dynamics",
+  "domain_id": 1
+}

checkpoints/balanced288/assets/edge_action_id_av_1_output.json

@@ -0,0 +1,672 @@
+{
+  "data": [
+    [
+      0.076171875,
+      0.0,
+      1.0859375,
+      0.96875,
+      0.004150390625,
+      -0.017578125,
+      0.005859375,
+      0.9765625,
+      0.0078125
+    ],
+    [
+      0.0654296875,
+      0.00390625,
+      0.9921875,
+      0.9765625,
+      0.0107421875,
+      -0.02490234375,
+      -0.0048828125,
+      0.96875,
+      0.0107421875
+    ],
+    [
+      0.087890625,
+      -0.0068359375,
+      1.0,
+      0.9375,
+      0.013671875,
+      -0.037109375,
+      0.01953125,
+      0.984375,
+      0.00146484375
+    ],
+    [
+      0.08203125,
+      -0.001953125,
+      0.984375,
+      0.97265625,
+      -0.0029296875,
+      -0.027099609375,
+      0.009765625,
+      0.97265625,
+      0.0126953125
+    ],
+    [
+      0.0849609375,
+      -0.0322265625,
+      0.95703125,
+      0.97265625,
+      0.009765625,
+      -0.04296875,
+      -0.0126953125,
+      0.96875,
+      0.00537109375
+    ],
+    [
+      0.080078125,
+      -0.021484375,
+      0.9375,
+      0.953125,
+      0.000732421875,
+      -0.03271484375,
+      -0.0068359375,
+      0.93359375,
+      -0.0009765625
+    ],
+    [
+      0.1015625,
+      -0.0042724609375,
+      0.9453125,
+      0.97265625,
+      0.00244140625,
+      -0.03173828125,
+      0.0078125,
+      0.953125,
+      0.00244140625
+    ],
+    [
+      0.09375,
+      0.0224609375,
+      0.91015625,
+      0.9453125,
+      -0.001953125,
+      -0.0361328125,
+      -0.015625,
+      0.96875,
+      0.0018310546875
+    ],
+    [
+      0.1318359375,
+      0.017578125,
+      0.90625,
+      0.95703125,
+      0.0107421875,
+      -0.0322265625,
+      -0.0234375,
+      0.93359375,
+      -0.017578125
+    ],
+    [
+      0.130859375,
+      0.025390625,
+      0.91796875,
+      0.984375,
+      0.0009765625,
+      -0.04345703125,
+      -0.0078125,
+      0.9765625,
+      0.017578125
+    ],
+    [
+      0.107421875,
+      -0.001953125,
+      0.90234375,
+      0.9765625,
+      0.002685546875,
+      -0.04443359375,
+      -0.017578125,
+      0.95703125,
+      -0.009765625
+    ],
+    [
+      0.1220703125,
+      0.03125,
+      0.90234375,
+      0.94921875,
+      -0.0078125,
+      -0.037109375,
+      0.0087890625,
+      0.9453125,
+      0.017578125
+    ],
+    [
+      0.130859375,
+      0.009765625,
+      0.88671875,
+      0.953125,
+      -0.009765625,
+      -0.040283203125,
+      0.0029296875,
+      0.953125,
+      0.005126953125
+    ],
+    [
+      0.12353515625,
+      -0.0078125,
+      0.91015625,
+      0.96875,
+      0.0029296875,
+      -0.0478515625,
+      -0.00537109375,
+      0.95703125,
+      -0.0029296875
+    ],
+    [
+      0.15625,
+      -0.001953125,
+      0.8828125,
+      0.96484375,
+      0.0126953125,
+      -0.038330078125,
+      -0.01171875,
+      0.953125,
+      0.01171875
+    ],
+    [
+      0.1328125,
+      0.005859375,
+      0.9140625,
+      0.96875,
+      0.0087890625,
+      -0.03955078125,
+      -0.013671875,
+      0.953125,
+      0.013671875
+    ],
+    [
+      0.1318359375,
+      0.0205078125,
+      0.8984375,
+      0.953125,
+      0.0,
+      -0.0458984375,
+      0.0009765625,
+      0.95703125,
+      -0.0078125
+    ],
+    [
+      0.119140625,
+      0.013671875,
+      0.921875,
+      0.96875,
+      0.0087890625,
+      -0.037109375,
+      0.001953125,
+      0.95703125,
+      0.0068359375
+    ],
+    [
+      0.115234375,
+      0.015625,
+      0.91015625,
+      0.984375,
+      0.01953125,
+      -0.0361328125,
+      -0.000732421875,
+      0.9609375,
+      0.0078125
+    ],
+    [
+      0.1103515625,
+      0.01312255859375,
+      0.9453125,
+      0.9375,
+      -0.00244140625,
+      -0.038330078125,
+      0.005859375,
+      0.953125,
+      -0.001068115234375
+    ],
+    [
+      0.1220703125,
+      0.0244140625,
+      0.953125,
+      0.9375,
+      -0.005859375,
+      -0.033203125,
+      0.005859375,
+      0.95703125,
+      -0.00390625
+    ],
+    [
+      0.1279296875,
+      -0.00390625,
+      0.96875,
+      0.96875,
+      0.0087890625,
+      -0.029296875,
+      0.00390625,
+      0.98046875,
+      0.0048828125
+    ],
+    [
+      0.11572265625,
+      0.033203125,
+      0.984375,
+      0.9609375,
+      -0.0078125,
+      -0.0341796875,
+      0.0029296875,
+      0.97265625,
+      0.009765625
+    ],
+    [
+      0.126953125,
+      -0.00390625,
+      0.9765625,
+      0.9609375,
+      0.0087890625,
+      -0.044921875,
+      -0.00390625,
+      0.9765625,
+      0.00244140625
+    ],
+    [
+      0.12109375,
+      0.01953125,
+      0.9921875,
+      0.953125,
+      0.0048828125,
+      -0.0234375,
+      0.0010986328125,
+      0.9375,
+      0.0029296875
+    ],
+    [
+      0.10546875,
+      -0.0078125,
+      1.015625,
+      0.9765625,
+      0.0078125,
+      -0.03466796875,
+      -0.0035400390625,
+      0.94921875,
+      0.0029296875
+    ],
+    [
+      0.1064453125,
+      0.0263671875,
+      1.0078125,
+      0.94921875,
+      0.00042724609375,
+      -0.0400390625,
+      -0.013671875,
+      0.9609375,
+      0.005859375
+    ],
+    [
+      0.095703125,
+      0.0244140625,
+      1.03125,
+      0.96875,
+      0.0068359375,
+      -0.0234375,
+      0.00048828125,
+      0.953125,
+      0.002197265625
+    ],
+    [
+      0.08837890625,
+      0.02099609375,
+      1.0390625,
+      0.984375,
+      0.0052490234375,
+      -0.03515625,
+      0.009765625,
+      0.96484375,
+      -0.0048828125
+    ],
+    [
+      0.08154296875,
+      0.029296875,
+      1.0625,
+      0.953125,
+      0.0048828125,
+      -0.04296875,
+      -0.005615234375,
+      0.96875,
+      0.00634765625
+    ],
+    [
+      0.0849609375,
+      0.00823974609375,
+      1.109375,
+      0.96875,
+      -0.0078125,
+      -0.01953125,
+      0.00390625,
+      0.96484375,
+      0.00146484375
+    ],
+    [
+      0.08203125,
+      0.029296875,
+      1.1171875,
+      0.95703125,
+      0.0048828125,
+      -0.02734375,
+      0.0,
+      0.97265625,
+      0.004852294921875
+    ],
+    [
+      0.056640625,
+      0.021484375,
+      1.1328125,
+      0.9609375,
+      -0.005859375,
+      -0.02001953125,
+      0.0078125,
+      0.9609375,
+      0.015625
+    ],
+    [
+      0.060546875,
+      0.001220703125,
+      1.140625,
+      0.984375,
+      0.0029296875,
+      -0.017578125,
+      0.001953125,
+      0.94921875,
+      0.009765625
+    ],
+    [
+      0.060546875,
+      0.007568359375,
+      1.1875,
+      0.96484375,
+      -0.000732421875,
+      -0.0166015625,
+      0.0029296875,
+      0.96875,
+      0.005615234375
+    ],
+    [
+      0.060302734375,
+      0.01123046875,
+      1.1875,
+      0.9609375,
+      -0.0087890625,
+      -0.0166015625,
+      -0.01171875,
+      0.9609375,
+      0.0078125
+    ],
+    [
+      0.046875,
+      0.01953125,
+      1.2109375,
+      0.953125,
+      -0.0048828125,
+      -0.0184326171875,
+      0.0029296875,
+      0.9296875,
+      0.009765625
+    ],
+    [
+      0.04248046875,
+      0.01953125,
+      1.2109375,
+      0.97265625,
+      0.005859375,
+      -0.029296875,
+      -0.0068359375,
+      0.9765625,
+      0.0078125
+    ],
+    [
+      0.041015625,
+      0.01611328125,
+      1.2734375,
+      0.96875,
+      0.0048828125,
+      -0.00927734375,
+      0.0009765625,
+      0.97265625,
+      0.0087890625
+    ],
+    [
+      0.0302734375,
+      0.009521484375,
+      1.265625,
+      0.984375,
+      0.004638671875,
+      -0.005859375,
+      -0.00537109375,
+      0.98046875,
+      0.013671875
+    ],
+    [
+      0.015625,
+      0.0086669921875,
+      1.296875,
+      0.96875,
+      0.013671875,
+      -0.013671875,
+      -0.015625,
+      0.984375,
+      0.0234375
+    ],
+    [
+      0.0283203125,
+      0.0146484375,
+      1.3359375,
+      0.96875,
+      0.01953125,
+      -0.0068359375,
+      -0.0078125,
+      0.9765625,
+      0.01318359375
+    ],
+    [
+      0.033203125,
+      0.0,
+      1.34375,
+      0.97265625,
+      0.00146484375,
+      0.00390625,
+      0.001953125,
+      0.97265625,
+      0.005615234375
+    ],
+    [
+      0.0234375,
+      0.0048828125,
+      1.328125,
+      0.9921875,
+      0.00439453125,
+      -0.0078125,
+      -0.003662109375,
+      0.98046875,
+      0.010009765625
+    ],
+    [
+      0.009033203125,
+      0.0166015625,
+      1.3984375,
+      0.984375,
+      -0.01171875,
+      -0.009765625,
+      0.0234375,
+      0.96484375,
+      0.01171875
+    ],
+    [
+      0.021484375,
+      -0.01171875,
+      1.40625,
+      0.96875,
+      -0.01953125,
+      -0.0048828125,
+      0.01171875,
+      0.96484375,
+      0.0234375
+    ],
+    [
+      0.0155029296875,
+      0.021484375,
+      1.4375,
+      0.9609375,
+      -0.00341796875,
+      0.009765625,
+      0.0006103515625,
+      0.96484375,
+      -0.00390625
+    ],
+    [
+      0.0108642578125,
+      0.005859375,
+      1.421875,
+      0.953125,
+      -0.002685546875,
+      -0.013671875,
+      0.0068359375,
+      0.953125,
+      -0.00048828125
+    ],
+    [
+      0.01068115234375,
+      0.01171875,
+      1.46875,
+      0.953125,
+      -0.00341796875,
+      -0.00048828125,
+      0.005859375,
+      0.9453125,
+      0.009765625
+    ],
+    [
+      0.00830078125,
+      0.0224609375,
+      1.515625,
+      0.96875,
+      0.005859375,
+      0.00048828125,
+      0.0009765625,
+      0.96484375,
+      0.001953125
+    ],
+    [
+      0.01171875,
+      -0.015625,
+      1.515625,
+      0.9765625,
+      0.0029296875,
+      0.001953125,
+      -0.001220703125,
+      0.96875,
+      0.01171875
+    ],
+    [
+      0.010986328125,
+      0.0185546875,
+      1.546875,
+      0.97265625,
+      -0.00390625,
+      0.00244140625,
+      -0.00390625,
+      0.984375,
+      0.0078125
+    ],
+    [
+      0.01318359375,
+      0.0087890625,
+      1.5390625,
+      0.94921875,
+      0.0,
+      0.015625,
+      -0.0078125,
+      0.953125,
+      0.005859375
+    ],
+    [
+      0.00830078125,
+      0.01165771484375,
+      1.578125,
+      0.953125,
+      0.0003662109375,
+      -0.009765625,
+      0.0,
+      0.9765625,
+      0.0087890625
+    ],
+    [
+      0.011962890625,
+      0.025390625,
+      1.5703125,
+      0.953125,
+      -0.00164794921875,
+      -0.000244140625,
+      0.001953125,
+      0.96875,
+      -0.0068359375
+    ],
+    [
+      0.00970458984375,
+      0.025390625,
+      1.6171875,
+      0.9609375,
+      0.0068359375,
+      0.0009765625,
+      0.0078125,
+      0.984375,
+      0.0048828125
+    ],
+    [
+      0.01220703125,
+      0.014892578125,
+      1.640625,
+      0.96875,
+      -0.00390625,
+      0.0,
+      -0.0048828125,
+      0.97265625,
+      0.0078125
+    ],
+    [
+      0.006103515625,
+      -0.001953125,
+      1.640625,
+      0.9765625,
+      0.002471923828125,
+      -0.001953125,
+      -0.00537109375,
+      0.96875,
+      0.00341796875
+    ],
+    [
+      0.0166015625,
+      0.017578125,
+      1.640625,
+      0.96875,
+      0.00146484375,
+      -0.009765625,
+      0.0048828125,
+      0.96484375,
+      0.0087890625
+    ],
+    [
+      0.005126953125,
+      0.0087890625,
+      1.6796875,
+      0.9609375,
+      -0.005859375,
+      -0.00146484375,
+      -0.005859375,
+      0.96875,
+      0.0068359375
+    ]
+  ],
+  "shape": [
+    60,
+    9
+  ],
+  "dtype": "torch.bfloat16",
+  "raw_action_dim": 9,
+  "action_mode": "inverse_dynamics",
+  "domain_id": 1
+}

checkpoints/balanced288/assets/example_action_fd_umi_action_chunks.json

@@ -0,0 +1,404 @@
+{
+  "prompt": "mouse arrangement",
+  "domain_name": "umi",
+  "view_point": "ego_view",
+  "fps": 20,
+  "image_size": 256,
+  "action_chunk_size": 16,
+  "num_chunks": 2,
+  "action_shape_per_chunk": [
+    16,
+    10
+  ],
+  "description": "Two normalized 10-D UMI action chunks for a single-view ego_view rollout. Use the first frame as the initial conditioning image. For chunk 1, condition on the final generated frame from chunk 0.",
+  "action_chunks": [
+    [
+      [
+        0.053812503814697266,
+        -0.004779123235493898,
+        0.002008301904425025,
+        0.9671046733856201,
+        0.03711317479610443,
+        -0.17747420072555542,
+        -0.036594998091459274,
+        0.9977647662162781,
+        0.02953636832535267,
+        -0.13823197782039642
+      ],
+      [
+        0.07370813935995102,
+        -0.00015990791143849492,
+        -0.00526643730700016,
+        0.966162919998169,
+        0.05513376370072365,
+        -0.17547594010829926,
+        -0.05433010682463646,
+        0.994891881942749,
+        0.04623955488204956,
+        -0.13932132720947266
+      ],
+      [
+        0.1894039809703827,
+        -0.0023578035179525614,
+        0.012279288843274117,
+        0.9756994843482971,
+        0.09475686401128769,
+        -0.12368101626634598,
+        -0.09487718343734741,
+        0.9908984303474426,
+        -0.009143882431089878,
+        -0.14122092723846436
+      ],
+      [
+        0.1646755337715149,
+        0.014868665486574173,
+        -0.02827119641005993,
+        0.9662106037139893,
+        0.11741045117378235,
+        -0.14138658344745636,
+        -0.11718737334012985,
+        0.9859751462936401,
+        0.01658531278371811,
+        -0.14161521196365356
+      ],
+      [
+        0.20245812833309174,
+        0.039910294115543365,
+        -0.025805803015828133,
+        0.8995737433433533,
+        0.16153031587600708,
+        -0.27254194021224976,
+        -0.1620442271232605,
+        0.9734464883804321,
+        -0.016664521768689156,
+        -0.14406844973564148
+      ],
+      [
+        0.18459202349185944,
+        0.03604526445269585,
+        -0.02222990058362484,
+        0.941689670085907,
+        0.08134357631206512,
+        -0.22731782495975494,
+        -0.08176705986261368,
+        0.9929845333099365,
+        -0.01771094650030136,
+        -0.14325366914272308
+      ],
+      [
+        0.19590386748313904,
+        0.02676231600344181,
+        -0.02729889750480652,
+        0.8968558311462402,
+        0.16832612454891205,
+        -0.2734377384185791,
+        -0.16814984381198883,
+        0.97162264585495,
+        0.008744634687900543,
+        -0.1433658003807068
+      ],
+      [
+        0.2117065191268921,
+        0.019320685416460037,
+        -0.013418853282928467,
+        0.8548710346221924,
+        0.22257667779922485,
+        -0.30904778838157654,
+        -0.22233201563358307,
+        0.9504156708717346,
+        0.011350061744451523,
+        -0.1437632143497467
+      ],
+      [
+        0.22299973666667938,
+        0.0327562540769577,
+        -0.009134029038250446,
+        0.8706302046775818,
+        0.21322639286518097,
+        -0.28956693410873413,
+        -0.21412642300128937,
+        0.953336238861084,
+        -0.02801540493965149,
+        -0.14188432693481445
+      ],
+      [
+        0.2140849381685257,
+        0.02660888060927391,
+        -0.01170671172440052,
+        0.8908835649490356,
+        0.20415504276752472,
+        -0.2596054971218109,
+        -0.20452779531478882,
+        0.9580091238021851,
+        -0.01170840673148632,
+        -0.14164277911186218
+      ],
+      [
+        0.22304928302764893,
+        0.028626402840018272,
+        -0.006994225084781647,
+        0.8915749192237854,
+        0.12412955611944199,
+        -0.30490365624427795,
+        -0.12411271035671234,
+        0.9845566153526306,
+        0.0024451441131532192,
+        -0.14154405891895294
+      ],
+      [
+        0.2222731113433838,
+        0.025864848867058754,
+        -0.03064606711268425,
+        0.8916106820106506,
+        0.11292119324207306,
+        -0.3092045783996582,
+        -0.11282884329557419,
+        0.9872149229049683,
+        0.004730388056486845,
+        -0.14219173789024353
+      ],
+      [
+        0.2097492665052414,
+        0.05057718604803085,
+        -0.007311991881579161,
+        0.9075368046760559,
+        0.1548784226179123,
+        -0.26160797476768494,
+        -0.15552769601345062,
+        0.9752822518348694,
+        -0.022801857441663742,
+        -0.1428474634885788
+      ],
+      [
+        0.2123514711856842,
+        0.042986635118722916,
+        0.006450705695897341,
+        0.9269675612449646,
+        0.16701975464820862,
+        -0.2123788744211197,
+        -0.16792836785316467,
+        0.9700967669487,
+        -0.041070736944675446,
+        -0.14396123588085175
+      ],
+      [
+        0.2005469650030136,
+        0.04303627461194992,
+        0.0021174526773393154,
+        0.9145819544792175,
+        0.15997713804244995,
+        -0.24451406300067902,
+        -0.16089586913585663,
+        0.9728385210037231,
+        -0.0356520377099514,
+        -0.143580824136734
+      ],
+      [
+        0.1828203797340393,
+        0.06162899360060692,
+        0.015765784308314323,
+        0.9442406892776489,
+        0.12680575251579285,
+        -0.199128195643425,
+        -0.12898683547973633,
+        0.9715272784233093,
+        -0.10863088071346283,
+        -0.14364691078662872
+      ]
+    ],
+    [
+      [
+        0.1800091415643692,
+        0.05415700003504753,
+        0.0220723208039999,
+        0.9427744746208191,
+        0.15702207386493683,
+        -0.18039608001708984,
+        -0.1585177183151245,
+        0.9681656360626221,
+        -0.08177943527698517,
+        -0.14226296544075012
+      ],
+      [
+        0.1782533973455429,
+        0.046168215572834015,
+        0.03214065358042717,
+        0.9491162896156311,
+        0.15013249218463898,
+        -0.16828377544879913,
+        -0.15176372230052948,
+        0.9677245616912842,
+        -0.09608176350593567,
+        -0.1437339335680008
+      ],
+      [
+        0.17733417451381683,
+        0.05023511126637459,
+        0.042507752776145935,
+        0.9599641561508179,
+        0.11787547171115875,
+        -0.16160599887371063,
+        -0.11985509097576141,
+        0.9706928133964539,
+        -0.12208050489425659,
+        -0.14515265822410583
+      ],
+      [
+        0.17919816076755524,
+        0.07686550915241241,
+        0.06860226392745972,
+        0.9644821286201477,
+        0.10539975762367249,
+        -0.15618394315242767,
+        -0.10708234459161758,
+        0.9769988656044006,
+        -0.10728096216917038,
+        -0.1453562080860138
+      ],
+      [
+        0.1575465053319931,
+        0.029737284407019615,
+        0.05468235909938812,
+        0.9541349411010742,
+        0.15530435740947723,
+        -0.14736345410346985,
+        -0.1561610847711563,
+        0.9723378419876099,
+        -0.057166263461112976,
+        -0.14554671943187714
+      ],
+      [
+        0.17658387124538422,
+        -0.0008871768950484693,
+        0.09531591832637787,
+        0.983400285243988,
+        0.09690801054239273,
+        -0.08479148149490356,
+        -0.09749053418636322,
+        0.9857844114303589,
+        -0.06855253875255585,
+        -0.1436685174703598
+      ],
+      [
+        0.1308804750442505,
+        0.016017800197005272,
+        0.04266123101115227,
+        0.9813141822814941,
+        0.10064378380775452,
+        -0.09238820523023605,
+        -0.10080896317958832,
+        0.9895036816596985,
+        -0.017434898763895035,
+        -0.14607854187488556
+      ],
+      [
+        0.12789754569530487,
+        0.0020461133681237698,
+        0.06620839238166809,
+        0.99201899766922,
+        0.03137550875544548,
+        -0.08352884650230408,
+        -0.03163702413439751,
+        0.9980270266532898,
+        -0.031180214136838913,
+        -0.14278197288513184
+      ],
+      [
+        0.11177432537078857,
+        -0.02513059414923191,
+        0.08431962132453918,
+        0.9990403056144714,
+        -0.010432509705424309,
+        -0.02879752404987812,
+        0.010669702664017677,
+        0.9930679798126221,
+        0.08243173360824585,
+        -0.14342190325260162
+      ],
+      [
+        0.0631430447101593,
+        -0.010469917207956314,
+        0.08317670226097107,
+        0.999850869178772,
+        -0.011552712880074978,
+        0.0031132197473198175,
+        0.011538979597389698,
+        0.9979555010795593,
+        0.04372014105319977,
+        -0.1447361707687378
+      ],
+      [
+        0.09046280384063721,
+        -0.012558498419821262,
+        0.09904492646455765,
+        0.998515784740448,
+        0.032513268291950226,
+        0.02011110819876194,
+        -0.0324835367500782,
+        0.9986945986747742,
+        -0.01484532468020916,
+        -0.14469973742961884
+      ],
+      [
+        0.07805871963500977,
+        -0.019602082669734955,
+        0.11864962428808212,
+        0.9934136867523193,
+        0.054121777415275574,
+        0.06036890670657158,
+        -0.05413716286420822,
+        0.9970375895500183,
+        0.002376429969444871,
+        -0.1444096863269806
+      ],
+      [
+        0.08657136559486389,
+        -0.0348740816116333,
+        0.12534210085868835,
+        0.9954044818878174,
+        0.005703791975975037,
+        0.067320816218853,
+        -0.00547851761803031,
+        0.9988376498222351,
+        -0.033448826521635056,
+        -0.14501787722110748
+      ],
+      [
+        0.07565143704414368,
+        -0.044480662792921066,
+        0.1283297836780548,
+        0.9972044825553894,
+        0.022084418684244156,
+        0.04793533310294151,
+        -0.02211857959628105,
+        0.999433696269989,
+        0.007050265092402697,
+        -0.14408022165298462
+      ],
+      [
+        0.06433551013469696,
+        -0.04466487839818001,
+        0.13651199638843536,
+        0.9936521053314209,
+        -0.04951975867152214,
+        0.0623551569879055,
+        0.049662359058856964,
+        0.9970018267631531,
+        -0.022745873779058456,
+        -0.14406241476535797
+      ],
+      [
+        0.05908937379717827,
+        -0.05935889855027199,
+        0.1395753026008606,
+        0.9970375895500183,
+        -0.024985427036881447,
+        0.04805263504385948,
+        0.02504965290427208,
+        0.9991833567619324,
+        -0.013274282217025757,
+        -0.14403760433197021
+      ]
+    ]
+  ]
+}

checkpoints/balanced288/assets/example_i2v_prompt.json

@@ -0,0 +1,124 @@
+{
+    "subjects": [
+      {
+        "description": "A car (viewed from the driver's perspective/dashcam) traveling along a coastal mountain road. The vehicle's grey dashboard and windshield frame are visible at the bottom of the frame.",
+        "appearance_details": "Grey/dark interior dashboard, windshield wipers visible, clean windshield providing clear view of the road ahead",
+        "relationship": "Primary subject and point-of-view vehicle navigating the mountain road",
+        "location": "Bottom foreground, providing the POV perspective",
+        "relative_size": "Large within frame (dashboard occupies bottom portion)",
+        "orientation": "Facing forward along the road direction",
+        "pose": "",
+        "action": "Driving fast along the curved coastal road, then making a sudden emergency stop",
+        "state_changes": "Transitions from fast forward motion to abrupt deceleration and complete stop",
+        "clothing": "",
+        "expression": "",
+        "gender": "",
+        "age": "",
+        "skin_tone_and_texture": "",
+        "facial_features": "",
+        "number_of_subjects": 1,
+        "number_of_arms": 0,
+        "number_of_legs": 0
+      },
+      {
+        "description": "Falling rocks and debris from the steep rocky mountain cliff face, creating a landslide that tumbles down toward the road surface",
+        "appearance_details": "Grey and brown angular rocks of various sizes, accompanied by dust and smaller debris, mixed with displaced green vegetation",
+        "relationship": "Obstacle that forces the car to make an emergency stop",
+        "location": "Center and center-right of frame, falling from the mountain cliff face toward the road",
+        "relative_size": "Medium within frame, growing larger as rocks approach the road",
+        "orientation": "Falling downward from the cliff face",
+        "pose": "",
+        "action": "Tumbling and cascading down the steep rocky mountainside toward the road",
+        "state_changes": "Begins as small movement on the cliff face, escalates into a significant rockfall with dust cloud",
+        "clothing": "",
+        "expression": "",
+        "gender": "",
+        "age": "",
+        "skin_tone_and_texture": "",
+        "facial_features": "",
+        "number_of_subjects": 0,
+        "number_of_arms": 0,
+        "number_of_legs": 0
+      }
+    ],
+    "background_setting": "A dramatic coastal mountain highway carved along steep rocky cliffs. The road is a well-maintained two-lane highway with white dashed center lines, solid white edge lines, and raised reflective road markers. A metal guardrail runs along the right side protecting from a drop toward the ocean. The mountain rises steeply on the left with exposed grey and brown rock faces partially covered with lush green native vegetation including ferns and shrubs. The ocean is visible in the distance to the right under a partly cloudy blue sky. The road curves sharply to the left around the mountain headland.",
+    "lighting": {
+      "conditions": "Bright natural daylight with partly cloudy skies, strong ambient illumination",
+      "direction": "Top-lit and slightly front-lit from the sun positioned high in the sky",
+      "shadows": "Moderate shadows cast by the mountain cliff creating areas of shade on the road and vegetation, soft shadows from clouds",
+      "illumination_effect": "Bright, clear visibility with good contrast between the sunlit road surface and shaded mountain areas, natural coastal light"
+    },
+    "aesthetics": {
+      "composition": "Driver's POV/dashcam perspective with the road curving ahead as the central leading line, mountain dominating the upper-left portion, ocean visible to the right, dashboard framing the bottom",
+      "color_scheme": "Dominant greens from vegetation, grey-brown rocky cliff faces, dark grey asphalt road with white markings, blue sky and ocean, yellow warning sign providing accent color",
+      "mood_atmosphere": "Initially scenic and adventurous, transitioning to tense and dangerous as the landslide occurs",
+      "patterns": "Repeating metal guardrail posts along the right side, dashed center line markings, layered rock strata on the cliff face"
+    },
+    "cinematography": {
+      "camera_motion": "Forward-moving dashcam perspective with slight vibration from vehicle speed, sudden forward lurch during emergency braking",
+      "framing": "Wide shot from driver's POV through windshield",
+      "camera_angle": "Eye-level from driver's seated position",
+      "depth_of_field": "Deep",
+      "focus": "Road ahead and mountain cliff face in sharp focus",
+      "lens_focal_length": "Wide-angle (approximately 28-35mm equivalent)"
+    },
+    "style_medium": "Live-action video",
+    "artistic_style": "Realistic dashcam footage, dramatic documentary style",
+    "context": "Dashcam footage capturing a dangerous landslide event on a coastal mountain highway, requiring emergency driving maneuver",
+    "actions": [
+      {
+        "time": "0:00-0:02",
+        "description": "The car drives fast along the winding coastal mountain road, approaching the left curve with the road rushing beneath"
+      },
+      {
+        "time": "0:02-0:04",
+        "description": "Rocks begin to dislodge from the steep cliff face ahead, tumbling down with increasing intensity as a landslide develops, dust rising from impacts"
+      },
+      {
+        "time": "0:04-0:05",
+        "description": "The car makes a sudden emergency stop, the camera lurching forward from the deceleration as rocks and debris continue falling onto the road ahead"
+      }
+    ],
+    "text_and_signage_elements": [
+      {
+        "text": "Left curve arrow",
+        "category": "scene_sign",
+        "appearance": "Black arrow on yellow diamond-shaped warning sign, mounted on a metal pole",
+        "spatial_temporal": "Left side of road, visible from 0:00 and passing by as car moves forward",
+        "context": "Road warning sign indicating a sharp left curve ahead, standard highway signage"
+      }
+    ],
+    "segments": [
+      {
+        "segment_index": 0,
+        "time_range": "0:00-0:02",
+        "description": "The car speeds along the scenic coastal mountain highway, navigating the curve. The road surface rushes beneath, white lines blur slightly from speed, and the mountain looms ahead.",
+        "key_changes": "Road perspective shifts as car navigates the curve, passing the warning sign, guardrail moves in peripheral view",
+        "camera": "Forward-moving dashcam with slight road vibration, steady forward momentum"
+      },
+      {
+        "segment_index": 1,
+        "time_range": "0:02-0:04",
+        "description": "Rocks begin breaking loose from the cliff face ahead. Small stones first, then larger boulders cascade down the mountainside creating a growing dust cloud and debris field on and near the road.",
+        "key_changes": "Mountain transitions from static backdrop to active hazard, dust cloud forms, debris appears on road surface ahead",
+        "camera": "Still moving forward but beginning to slow, slight camera shake increases"
+      },
+      {
+        "segment_index": 2,
+        "time_range": "0:04-0:05",
+        "description": "The car performs an emergency stop. The camera pitches forward from sudden braking force. The vehicle comes to a complete halt with the landslide debris visible on the road ahead, dust still settling.",
+        "key_changes": "Rapid deceleration, camera lurches forward then settles, motion stops completely, dust and small rocks still visible falling",
+        "camera": "Abrupt forward pitch from braking, then stabilizes to static as vehicle stops"
+      }
+    ],
+    "transitions": [],
+    "temporal_caption": "The video begins with a dashcam view of a car driving fast along a scenic coastal mountain road, the asphalt rushing beneath and a sharp left curve sign visible on the left. The car navigates the curve at speed with the steep rocky cliff towering above and the ocean visible to the right. Around the 2-second mark, small rocks begin to dislodge from the cliff face ahead, quickly escalating into a significant rockfall with larger boulders tumbling down the mountainside and a dust cloud forming. By second 4, the driver reacts with emergency braking - the camera lurches forward dramatically from the sudden deceleration. The car comes to a complete stop between seconds 4 and 5, with the road ahead partially blocked by fallen rocks and debris, dust still settling in the air around the landslide zone.",
+    "audio_description": "Initially the sound of a car engine at moderate-high RPM and tire noise on asphalt with wind passing over the vehicle. Around second 2, the rumbling and cracking sounds of rocks breaking loose begin, growing louder with impacts of stones hitting the road surface and each other. Loud thuds and crashes as larger rocks land. At second 4, the sharp screech of tires braking hard on asphalt, followed by the settling sounds of smaller pebbles and dust, with distant rumbling of the remaining rockfall subsiding.",
+    "resolution": {
+      "W": 1280,
+      "H": 720
+    },
+    "aspect_ratio": "16,9",
+    "duration": "5s",
+    "fps": 24
+  }

checkpoints/balanced288/assets/example_reasoning_prompt.json

@@ -0,0 +1,4 @@
+{
+  "prompt": "The task is to put flower into the red bottle. Generate a plan consisting of subtasks for accomplish the task.",
+  "max_tokens": 4096
+}

checkpoints/balanced288/assets/negative_prompt.json

@@ -0,0 +1,131 @@
+{
+  "subjects": [
+    {
+      "description": "A subject suffering from extreme temporal instability — flickering outlines, morphing silhouette, and visible frame-to-frame discontinuities that make it look like a corrupted video file.",
+      "appearance_details": "Distorted features, visible compression artifacts, muddy textures lacking fine detail, color bleeding between elements, and unnatural skin tones or surface textures that appear artificial or computer-generated.",
+      "relationship": "Subjects appear disconnected from the environment, floating or improperly grounded in the scene without proper occlusion or spatial coherence.",
+      "location": "Subjects are poorly placed within the frame, appearing at awkward positions that violate basic compositional rules.",
+      "relative_size": "Inconsistent scale relationships between subjects and the environment, with objects appearing too large or too small relative to their surroundings.",
+      "orientation": "Unnatural orientations that defy physics and spatial logic.",
+      "pose": "Poses snap between positions with no interpolation, creating a strobe-like effect.",
+      "action": "Motion is completely incoherent — limbs teleport between positions, movement appears as discrete jumps rather than continuous flow, and speed varies wildly between frames.",
+      "state_changes": "The subject flickers between completely different visual states every few frames, as if multiple renders were randomly interleaved.",
+      "clothing": "Garments phase in and out of visibility, textures swim across surfaces untethered to the geometry.",
+      "expression": "Frozen, uncanny valley expressions or expressions that change abruptly without natural transition.",
+      "gender": "",
+      "age": "",
+      "skin_tone_and_texture": "Waxy, plastic-looking skin with visible artifacts and inconsistent texture resolution across the frame.",
+      "facial_features": "Asymmetric facial features, extra fingers or limbs, teeth that appear blurry or malformed.",
+      "number_of_subjects": 0,
+      "number_of_arms": 0,
+      "number_of_legs": 0
+    },
+    {
+      "description": "A subject with catastrophically broken surface rendering — visible polygon edges, texture seams, UV mapping errors, and normal map inversions.",
+      "appearance_details": "Distorted features, visible compression artifacts, muddy textures lacking fine detail, color bleeding between elements, and unnatural skin tones or surface textures that appear artificial or computer-generated.",
+      "relationship": "Subjects appear disconnected from the environment, floating or improperly grounded in the scene without proper occlusion or spatial coherence.",
+      "location": "Subjects are poorly placed within the frame, appearing at awkward positions that violate basic compositional rules.",
+      "relative_size": "Inconsistent scale relationships between subjects and the environment, with objects appearing too large or too small relative to their surroundings.",
+      "orientation": "Unnatural orientations that defy physics and spatial logic.",
+      "pose": "Static poses reveal texture swimming, moire patterns, and aliased edges on every contour.",
+      "action": "Movement reveals progressively worse texture breakdown — stretching, tearing, and resolution collapse in deformed regions.",
+      "state_changes": "Surface materials randomly swap between frames — metal becomes cloth, glass becomes stone, with no transition.",
+      "clothing": "Fabric renders as a flat solid color with no folds, wrinkles, or material response to form.",
+      "expression": "Frozen, uncanny valley expressions or expressions that change abruptly without natural transition.",
+      "gender": "",
+      "age": "",
+      "skin_tone_and_texture": "Waxy, plastic-looking skin with visible artifacts and inconsistent texture resolution across the frame.",
+      "facial_features": "Asymmetric facial features, extra fingers or limbs, teeth that appear blurry or malformed.",
+      "number_of_subjects": 0,
+      "number_of_arms": 0,
+      "number_of_legs": 0
+    },
+    {
+      "description": "A subject that appears composited into the scene rather than belonging to it — mismatched lighting direction, wrong color temperature, and edges that bleed into the background.",
+      "appearance_details": "Distorted features, visible compression artifacts, muddy textures lacking fine detail, color bleeding between elements, and unnatural skin tones or surface textures that appear artificial or computer-generated.",
+      "relationship": "Subjects appear disconnected from the environment, floating or improperly grounded in the scene without proper occlusion or spatial coherence.",
+      "location": "Subjects are poorly placed within the frame, appearing at awkward positions that violate basic compositional rules.",
+      "relative_size": "Inconsistent scale relationships between subjects and the environment, with objects appearing too large or too small relative to their surroundings.",
+      "orientation": "Unnatural orientations that defy physics and spatial logic.",
+      "pose": "Proportions shift between frames — limbs lengthen and shorten, heads resize, creating an unsettling instability.",
+      "action": "Movement creates visible matting artifacts — green screen fringe, edge chattering, and translucent boundaries.",
+      "state_changes": "The subject randomly changes size, opacity, and z-depth relative to other scene elements.",
+      "clothing": "Clothing appears to be from a different render pass — different noise level, different motion blur kernel, different color space.",
+      "expression": "Frozen, uncanny valley expressions or expressions that change abruptly without natural transition.",
+      "gender": "",
+      "age": "",
+      "skin_tone_and_texture": "Waxy, plastic-looking skin with visible artifacts and inconsistent texture resolution across the frame.",
+      "facial_features": "Asymmetric facial features, extra fingers or limbs, teeth that appear blurry or malformed.",
+      "number_of_subjects": 0,
+      "number_of_arms": 0,
+      "number_of_legs": 0
+    }
+  ],
+  "background_setting": "A poorly rendered, flat background with visible seams, repeated textures, and inconsistent depth cues. The environment lacks volumetric depth and appears as a painted backdrop rather than a three-dimensional space. Vegetation looks like flat cutouts with no volumetric depth. The background appears to have been composited from multiple source materials at different resolutions, creating visible seams and edge artifacts where elements meet. Textures swim and shift across surfaces in a way that breaks the illusion of solidity — patterns drift laterally rather than staying anchored to the geometry they belong to. Background elements flicker in and out of existence between frames, particularly at the edges of the field of view. The rendering resolution is visibly lower for distant elements, creating a jarring transition between near and far objects. Cloud textures repeat obviously in the sky with visible tiling. Water surfaces lack proper reflection and refraction, appearing as flat animated textures. Fog and atmospheric effects pop in and out rather than smoothly transitioning. Trees and vegetation exhibit obvious LOD (level-of-detail) switching. Building facades have inconsistent window spacing and pattern repetition. The overall scene feels like a poorly assembled collage of individually rendered elements rather than a coherent whole.",
+  "lighting": {
+    "conditions": "Harsh, flat lighting with no natural variation. The scene appears uniformly lit as if by a single overhead fluorescent light, removing all sense of depth and atmosphere.",
+    "direction": "Inconsistent light sources — shadows point in multiple contradictory directions, breaking physical plausibility.",
+    "shadows": "Hard-edged, unrealistic shadows that pop in and out of existence between frames. Some objects cast no shadows while others have impossibly dark ones that don't animate smoothly with the object's motion. Shadow edges exhibit visible staircase aliasing artifacts. Shadow maps appear to have been rendered at extremely low resolution, creating blocky patterns. Self-shadowing on characters shows visible peter-panning artifacts where shadows detach from their source. Contact shadows between objects and the ground appear and disappear as objects move slightly. Shadow color is pure black with no ambient contribution, creating an unnaturally harsh contrast that flattens the image. Multiple shadow cascades have visible boundaries where resolution changes. The shadow rendering appears to be temporally unstable — even static objects have shadows that shimmer and crawl frame to frame, breaking the illusion of a stable light source.",
+    "illumination_effect": "No bounce light, no ambient occlusion, no subtle color interactions between surfaces. The scene looks like a poorly lit 3D render from the early 2000s."
+  },
+  "aesthetics": {
+    "composition": "Cluttered, poorly framed composition with no clear focal point. Important elements are cut off by the frame edges. The rule of thirds is completely ignored, leading to an unbalanced and visually unpleasant arrangement.",
+    "color_scheme": "Oversaturated, garish colors that clash violently. Color banding is visible in gradient areas. The overall palette feels artificial and digitally processed rather than natural.",
+    "mood_atmosphere": "Unsettling, uncanny atmosphere that fails to evoke any intended emotional response. The scene feels lifeless and sterile despite attempting to portray dynamic action.",
+    "patterns": "Visible tiling artifacts in textures, moiré patterns, and aliasing on edges."
+  },
+  "cinematography": {
+    "camera_motion": "Extremely shaky, unstable camera with visible rolling shutter artifacts. The motion is jerky and discontinuous, causing motion sickness and making the scene impossible to follow. The camera also executes an over-aggressive, unrelenting push-in: it dollies and optically zooms toward the subject far too fast — magnifying the scene roughly 2.5x to 6x within a few seconds — combined with a large, uncontrolled lateral drift, so the framing never settles. Instead of holding a stable composition, the viewpoint continuously accelerates forward and slides sideways, blowing past the intended framing into an unwanted extreme close-up by the end of the clip. This push-in is a distinct failure mode from the shake/jitter described above — it has little to no rotational wobble — a smooth but excessive, monotonic magnitude of forward dolly, zoom, and translation that never eases off, never holds, and never returns to a steady frame. On scenes with strong perspective lines (conveyor belts, quarries, aerial industrial sites, long corridors) the runaway zoom-and-translate makes the perspective rush inward, reading as erratic, claustrophobic, nauseating camerawork.",
+    "framing": "Poorly framed shots that cut off important elements and include unnecessary empty space. The shot also relentlessly tightens into an unintended extreme close-up as the camera barrels forward, cropping out the intended subject and context because the push-in never stops.",
+    "camera_angle": "Awkward, disorienting camera angles that provide no useful spatial information about the scene. The camera path exhibits visible mathematical artifacts suggesting simple interpolation between keyframes rather than natural camera operation. Camera motion is completely disconnected from the scene content — panning away from action, dollying during dialogue, and shaking during still moments. The camera appears to pass through solid objects occasionally. Zoom is applied digitally rather than optically, revealing progressively worse resolution. Camera motion exhibits non-physical acceleration profiles — instant starts and stops rather than smooth ease-in/ease-out. Rolling shutter simulation is applied inconsistently, present in some frames but not others. The camera occasionally exhibits impossible motion like teleporting between positions. Virtual camera stabilization creates an uncanny floating sensation disconnected from any physical camera rig.",
+    "depth_of_field": "Uniform focus throughout, creating a flat, documentary-like appearance with no cinematic depth separation.",
+    "focus": "Soft, out-of-focus imagery with visible chromatic aberration and lens distortion that was not corrected in post-processing.",
+    "lens_focal_length": "Inappropriate focal length causing barrel distortion and unnatural perspective compression."
+  },
+  "style_medium": "Low quality compressed digital video with visible encoding artifacts",
+  "artistic_style": "Amateur, unpolished with inconsistent visual style",
+  "context": "A poorly produced video with numerous technical and artistic flaws that detract from any intended narrative or visual impact.",
+  "actions": [
+    {
+      "time": "0:00-0:02",
+      "description": "As the camera starts moving, rigid foreground objects (cars, signs) warp and change shape; straight painted road lines bend and smear."
+    },
+    {
+      "time": "0:02-0:04",
+      "description": "A clearly-present background object vanishes without occlusion while a new object pops into the frame edge; feet/wheels slide over the ground without contact."
+    },
+    {
+      "time": "0:04-0:06",
+      "description": "A hand manipulating an object fuses with it into a morphing blob; poured/chopped material changes mass, portions disappearing and multiplying."
+    },
+    {
+      "time": "0:06-0:08",
+      "description": "Thin structures (wires, lane lines, foliage) flicker and shimmer; object count and world geometry no longer match the opening frame."
+    },
+    {
+      "time": "0:00-0:06",
+      "description": "Throughout, the camera pushes in far too aggressively — a fast continuous forward dolly and zoom (about 2.5x-6x) with a large lateral drift and no rotational shake — never holding a steady framing and ending in an unwanted extreme close-up."
+    }
+  ],
+  "text_and_signage_elements": [],
+  "segments": [
+    {
+      "segment_index": 0,
+      "time_range": "0:00-0:04",
+      "description": "Camera-motion segment where rigid-body stability collapses: vehicles, signage, and road markings morph, warp, and slide as the viewpoint translates.",
+      "key_changes": "World geometry un-locks — ground plane and lane lines drift; a background object vanishes and another appears without cause.",
+      "camera": "Forward-moving camera that drives rigid-object deformation; simultaneously an over-fast forward dolly-and-zoom with lateral drift that magnifies the scene far too quickly and never holds a stable frame."
+    },
+    {
+      "segment_index": 1,
+      "time_range": "0:04-0:08",
+      "description": "Manipulation and material-transfer segment where hand-object contact fails.",
+      "key_changes": "Hand and handled object merge into a morphing blob; transferred food/liquid violates mass conservation, portions vanishing and multiplying; thin high-frequency structures flicker.",
+      "camera": "Unstable framing with incorrect motion blur; the excessive push-in continues, sliding sideways and blowing past the composition into an extreme close-up."
+    }
+  ],
+  "transitions": [],
+  "temporal_caption": "The clip opens with objects appearing sharp and stable, but as the camera moves forward every rigid object begins to betray its geometry: parked cars warp and bulge, painted lane markings smear and slide across the asphalt, stop signs and poles bend and reshape frame to frame. Midway, a vehicle that was clearly present silently vanishes while a new object pops into existence at the frame edge without cause. Hands manipulating objects fuse with them into a morphing blob; poured or chopped food changes mass and volume, portions disappearing and multiplying. Thin structures — wires, foliage, railings, lane lines — flicker and shimmer throughout. Feet, wheels, and paws glide over the ground without firm contact. By the end, world geometry, object count, and material mass are all inconsistent with how the clip began. Over the whole clip the camera also barrels forward far too fast: a smooth, unrelenting push-in — fast forward dolly plus optical zoom, roughly 2.5x to 6x magnification in a few seconds — paired with a large lateral drift, with essentially no rotational shake. The framing never stabilizes; the viewpoint continuously accelerates past the intended composition and collapses into an uncomfortable extreme close-up by the end, which on industrial and aerial scenes with strong perspective lines reads as erratic, disorienting camerawork.",
+  "audio_description": "",
+  "physical_realism": "No adherence to physical laws. Objects defy gravity, pass through solid surfaces, and change mass and momentum without cause. Fluid dynamics, cloth simulation, and rigid body physics are all fundamentally broken. Furthermore, conservation of energy is violated as objects gain or lose kinetic energy spontaneously. Elastic collisions produce inelastic results and vice versa. Surface friction is inconsistent — objects slide on rough surfaces while sticking to smooth ones. Air resistance appears to affect only some objects while others move through the atmosphere unimpeded. Rigid bodies morph under camera motion; objects slide without ground contact; mass is not conserved in transfer; objects enter/vanish breaking permanence; thin structures flicker."
+}

checkpoints/balanced288/chat_template.jinja

@@ -0,0 +1,324 @@
+
+{% macro render_extra_keys(json_dict, handled_keys) %}
+    {%- if json_dict is mapping %}
+        {%- for json_key in json_dict if json_key not in handled_keys %}
+            {%- if json_dict[json_key] is mapping or (json_dict[json_key] is sequence and json_dict[json_key] is not string) %}
+                {{- '
+<' ~ json_key ~ '>' ~ (json_dict[json_key] | tojson | safe) ~ '</' ~ json_key ~ '>' }}
+            {%- else %}
+                {{-'
+<' ~ json_key ~ '>' ~ (json_dict[json_key] | string) ~ '</' ~ json_key ~ '>' }}
+            {%- endif %}
+        {%- endfor %}
+    {%- endif %}
+{% endmacro %}
+{%- set enable_thinking = enable_thinking if enable_thinking is defined else True %}
+{%- set truncate_history_thinking = truncate_history_thinking if truncate_history_thinking is defined else True %}
+
+{%- set ns = namespace(last_user_idx = -1) %}
+{%- set loop_messages = messages %}
+{%- for m in loop_messages %}
+  {%- if m["role"] == "user" %}
+    {%- set ns.last_user_idx = loop.index0 %}
+  {%- endif %}
+{%- endfor %}
+
+{%- if messages[0]["role"] == "system" %}
+    {%- if messages[0]["content"] is string %}
+        {%- set system_message = messages[0]["content"] %}
+    {%- else %}
+        {%- set ns = namespace(system_text="") %}
+        {%- for part in messages[0]["content"] %}
+            {%- if 'text' in part %}
+                {%- set ns.system_text = ns.system_text + part.text %}
+            {%- endif %}
+        {%- endfor %}
+        {%- set system_message = ns.system_text %}
+    {%- endif %}
+
+    {%- set loop_messages = messages[1:] %}
+{%- else %}
+    {%- set system_message = "" %}
+    {%- set loop_messages = messages %}
+{%- endif %}
+{%- if not tools is defined %}
+    {%- set tools = [] %}
+{%- endif %}
+{# Recompute last_user_idx relative to loop_messages after handling system #}
+{%- set ns = namespace(last_user_idx = -1) %}
+{%- for m in loop_messages %}
+  {%- if m["role"] == "user" %}
+    {%- set ns.last_user_idx = loop.index0 %}
+  {%- endif %}
+{%- endfor %}
+{%- if system_message is defined %}
+    {{- "<|im_start|>system
+" + system_message }}
+{%- else %}
+    {%- if tools is iterable and tools | length > 0 %}
+        {{- "<|im_start|>system
+" }}
+    {%- endif %}
+{%- endif %}
+{%- if tools is iterable and tools | length > 0 %}
+    {%- if system_message is defined and system_message | length > 0 %}
+        {{- "
+
+" }}
+    {%- endif %}
+    {{- "# Tools
+
+You have access to the following functions:
+
+" }}
+    {{- "<tools>" }}
+    {%- for tool in tools %}
+        {%- if tool.function is defined %}
+            {%- set tool = tool.function %}
+        {%- endif %}
+        {{- "
+<function>
+<name>" ~ tool.name ~ "</name>" }}
+        {%- if tool.description is defined %}
+            {{- '
+<description>' ~ (tool.description | trim) ~ '</description>' }}
+        {%- endif %}
+        {{- '
+<parameters>' }}
+        {%- if tool.parameters is defined and tool.parameters is mapping and tool.parameters.properties is defined and tool.parameters.properties is mapping %}
+            {%- for param_name, param_fields in tool.parameters.properties|items %}
+                {{- '
+<parameter>' }}
+                {{- '
+<name>' ~ param_name ~ '</name>' }}
+                {%- if param_fields.type is defined %}
+                    {{- '
+<type>' ~ (param_fields.type | string) ~ '</type>' }}
+                {%- endif %}
+                {%- if param_fields.description is defined %}
+                    {{- '
+<description>' ~ (param_fields.description | trim) ~ '</description>' }}
+                {%- endif %}
+                {%- if param_fields.enum is defined %}
+                    {{- '
+<enum>' ~ (param_fields.enum | tojson | safe) ~ '</enum>' }}
+                {%- endif %}
+                {%- set handled_keys = ['name', 'type', 'description', 'enum'] %}
+                {{- render_extra_keys(param_fields, handled_keys) }}
+                {{- '
+</parameter>' }}
+            {%- endfor %}
+        {%- endif %}
+        {% set handled_keys = ['type', 'properties', 'required'] %}
+        {{- render_extra_keys(tool.parameters, handled_keys) }}
+        {%- if tool.parameters is defined and tool.parameters.required is defined %}
+            {{- '
+<required>' ~ (tool.parameters.required | tojson | safe) ~ '</required>' }}
+        {%- endif %}
+        {{- '
+</parameters>' }}
+        {%- set handled_keys = ['type', 'name', 'description', 'parameters'] %}
+        {{- render_extra_keys(tool, handled_keys) }}
+        {{- '
+</function>' }}
+    {%- endfor %}
+    {{- "
+</tools>" }}
+
+    {{- '
+
+If you choose to call a function ONLY reply in the following format with NO suffix:
+
+<tool_call>
+<function=example_function_name>
+<parameter=example_parameter_1>
+value_1
+</parameter>
+<parameter=example_parameter_2>
+This is the value for the second parameter
+that can span
+multiple lines
+</parameter>
+</function>
+</tool_call>
+
+<IMPORTANT>
+Reminder:
+- Function calls MUST follow the specified format: an inner <function=...></function> block must be nested within <tool_call></tool_call> XML tags
+- Required parameters MUST be specified
+- You may provide optional reasoning for your function call in natural language BEFORE the function call, but NOT after
+- If there is no function call available, answer the question like normal with your current knowledge and do not tell the user about function calls
+</IMPORTANT>' }}
+{%- endif %}
+
+
+{%- if system_message is defined %}
+    {{- '<|im_end|>
+' }}
+{%- else %}
+    {%- if tools is iterable and tools | length > 0 %}
+        {{- '<|im_end|>
+' }}
+    {%- endif %}
+{%- endif %}
+
+{%- set image_count = namespace(value=0) %}
+{%- set video_count = namespace(value=0) %}
+{%- for message in loop_messages %}
+    {%- if message.role == "assistant" %}
+        {# Add reasoning content in to content field for unified processing below. #}
+        {%- set text_content = namespace(text_content="") -%}
+        {%- if message.content is string %}
+            {%- set text_content.text_content = message.content %}
+        {%- else %}
+            {%- for content in message.content %}
+                {%- if 'text' in content %}
+                    {%- set text_content.text_content = content.text %}
+                    {%- break %}
+                {%- endif %}
+            {%- endfor %}
+        {%- endif %}
+        {%- if message.reasoning_content is defined and message.reasoning_content is string and message.reasoning_content | trim | length > 0 %}
+            {%- set content = "<think>
+" ~ message.reasoning_content ~ "
+</think>
+" ~ (text_content.text_content | default('', true)) %}
+        {%- else %}
+            {%- set content = text_content.text_content | default('', true) %}
+            {# Allow downstream logic to to take care of broken thought, only handle coherent reasoning here. #}
+            {%- if '<think>' not in content and '</think>' not in content %}
+                {%- set content = "<think></think>" ~ content %}
+            {%- else %}
+                {%- set content = content %}
+            {%- endif -%}
+        {%- endif %}
+        {%- if message.tool_calls is defined and message.tool_calls is iterable and message.tool_calls | length > 0 %}
+            {# Assistant message has tool calls. #}
+            {{- '<|im_start|>assistant
+' }}
+                {%- set include_content = not (truncate_history_thinking and loop.index0 < ns.last_user_idx) %}
+                {%- if content is string and content | trim | length > 0 %}
+                    {%- if include_content %}
+                        {{- (content | trim) ~ '
+' -}}
+                    {%- else %}
+                        {%- set c = (content | string) %}
+                        {%- if '</think>' in c %}
+                            {# Keep only content after the last closing think. Also generation prompt causes this. #}
+                            {%- set c = c.split('</think>')[-1] %}
+                        {%- elif '<think>' in c %}
+                            {# If <think> was opened but never closed, drop the trailing think segment #}
+                            {%- set c = c.split('<think>')[0] %}
+                        {%- endif %}
+                        {%- set c = "<think></think>" ~ c | trim %}
+                        {%- if c | length > 0 %}
+                            {{- c ~ '
+' -}}
+                        {%- endif %}
+                    {%- endif %}
+                {%- else %}
+                    {{- "<think></think>" -}}
+                {%- endif %}
+                {%- for tool_call in message.tool_calls %}
+                    {%- if tool_call.function is defined %}
+                        {%- set tool_call = tool_call.function %}
+                    {%- endif %}
+                    {{- '<tool_call>
+<function=' ~ tool_call.name ~ '>
+' -}}
+                        {%- if tool_call.arguments is defined %}
+                            {%- for args_name, args_value in tool_call.arguments|items %}
+                                {{- '<parameter=' ~ args_name ~ '>
+' -}}
+                                    {%- set args_value = args_value | tojson | safe if args_value is mapping or (args_value is sequence and args_value is not string) else args_value | string %}
+                                {{- args_value ~ '
+</parameter>
+' -}}
+                            {%- endfor %}
+                        {%- endif %}
+                    {{- '</function>
+</tool_call>
+' -}}
+                {%- endfor %}
+                {{- '<|im_end|>
+' }}
+        {%- else %}
+            {# Assistant message doesn't have tool calls. #}
+            {%- if not (truncate_history_thinking and loop.index0 < ns.last_user_idx) %}
+                {{- '<|im_start|>assistant
+' ~ (content | default('', true) | string | trim) ~ '<|im_end|>
+' }}
+            {%- else %}
+                {%- set c = (content | default('', true) | string) %}
+                {%- if '<think>' in c and '</think>' in c %}
+                    {%- set c = "<think></think>" ~ c.split('</think>')[-1] %}
+                {%- endif %}
+                {%- set c = c | trim %}
+                {%- if c | length > 0 %}
+                    {{- '<|im_start|>assistant
+' ~ c ~ '<|im_end|>
+' }}
+                {%- else %}
+                    {{- '<|im_start|>assistant
+<|im_end|>
+' }}
+                {%- endif %}
+            {%- endif %}
+        {%- endif %}
+    {%- elif message.role == "user" or message.role == "system" %}
+        {{- '<|im_start|>' + message.role + '
+' }}
+        {%- if message.content is string %}
+            {{- message.content }}
+        {%- else %}
+            {%- for content in message.content %}
+                {%- if content.type == 'image' or 'image' in content or 'image_url' in content %}
+                    {%- set image_count.value = image_count.value + 1 %}
+                    {%- if add_vision_id %}Picture {{ image_count.value }}: {% endif -%}
+                    <|vision_start|><|image_pad|><|vision_end|>
+                {%- elif content.type == 'video' or 'video' in content %}
+                    {%- set video_count.value = video_count.value + 1 %}
+                    {%- if add_vision_id %}Video {{ video_count.value }}: {% endif -%}
+                    <|vision_start|><|video_pad|><|vision_end|>
+                {%- elif 'text' in content %}
+                    {{- content.text }}
+                {%- endif %}
+            {%- endfor %}
+        {%- endif %}
+        {{- '<|im_end|>
+' }}
+    {%- elif message.role == "tool" %}
+        {%- if loop.previtem and loop.previtem.role != "tool" %}
+            {{- '<|im_start|>user
+' }}
+        {%- endif %}
+        {{- '<tool_response>
+' }}
+        {{- message.content }}
+        {{- '
+</tool_response>
+' }}
+        {%- if not loop.last and loop.nextitem.role != "tool" %}
+            {{- '<|im_end|>
+' }}
+        {%- elif loop.last %}
+            {{- '<|im_end|>
+' }}
+        {%- endif %}
+    {%- else %}
+        {{- '<|im_start|>' + message.role + '
+' + message.content + '<|im_end|>
+' }}
+    {%- endif %}
+{%- endfor %}
+
+{%- if add_generation_prompt %}
+    {%- if enable_thinking %}
+        {{- '<|im_start|>assistant
+<think>
+' }}
+    {%- else %}
+        {{- '<|im_start|>assistant
+<think></think>' }}
+    {%- endif %}
+{%- endif %}

checkpoints/balanced288/config.json

@@ -0,0 +1,69 @@
+{
+  "allow_patterns_overrides": [
+    "*/*.safetensors"
+  ],
+  "architectures": [
+    "Cosmos3EdgeForConditionalGeneration"
+  ],
+  "image_token_id": 19,
+  "model_type": "cosmos3_edge",
+  "projector_config": {
+    "input_hidden_size": 1152,
+    "merger_intermediate_size": 11520,
+    "model_type": "cosmos3_edge_projector",
+    "out_hidden_size": 2048,
+    "spatial_merge_size": 2,
+    "use_postshuffle_norm": false
+  },
+  "projector_hidden_size": 11520,
+  "text_config": {
+    "attention_bias": false,
+    "attention_dropout": 0.0,
+    "dtype": "bfloat16",
+    "head_dim": 128,
+    "hidden_act": "relu2",
+    "hidden_dropout": 0.0,
+    "hidden_size": 2048,
+    "initializer_range": 0.02,
+    "intermediate_size": 9216,
+    "max_position_embeddings": 131072,
+    "mlp_bias": false,
+    "model_type": "cosmos3_edge_text",
+    "num_attention_heads": 16,
+    "num_hidden_layers": 28,
+    "num_key_value_heads": 8,
+    "residual_in_fp32": false,
+    "rms_norm_eps": 1e-05,
+    "rope_parameters": {
+      "mrope_section": [
+        24,
+        20,
+        20
+      ],
+      "rope_theta": 100000000,
+      "rope_type": "default"
+    },
+    "sliding_window": null,
+    "use_cache": true,
+    "vocab_size": 131072
+  },
+  "tie_word_embeddings": false,
+  "transformers_version": "4.57.6",
+  "video_token_id": 18,
+  "vision_config": {
+    "attention_dropout": 0.0,
+    "hidden_act": "gelu_pytorch_tanh",
+    "hidden_size": 1152,
+    "intermediate_size": 4304,
+    "layer_norm_eps": 1e-06,
+    "model_type": "cosmos3_edge_vision",
+    "num_attention_heads": 16,
+    "num_channels": 3,
+    "num_hidden_layers": 27,
+    "num_patches": 256,
+    "patch_size": 16,
+    "spatial_merge_size": 2
+  },
+  "vision_end_token_id": 21,
+  "vision_start_token_id": 20
+}

checkpoints/balanced288/generation_config.json

@@ -0,0 +1,8 @@
+{
+  "_from_model_config": true,
+  "bos_token_id": 1,
+  "do_sample": true,
+  "eos_token_id": 11,
+  "pad_token_id": 0,
+  "transformers_version": "4.57.6"
+}

checkpoints/balanced288/model.safetensors.index.json

@@ -0,0 +1,677 @@
+{
+    "metadata": {
+        "total_size": 4871232992
+    },
+    "weight_map": {
+        "model.visual.embeddings.patch_embedding.weight": "00000.safetensors",
+        "model.visual.embeddings.patch_embedding.bias": "00000.safetensors",
+        "model.visual.embeddings.position_embedding.weight": "00000.safetensors",
+        "model.visual.encoder.layers.0.layer_norm1.weight": "00000.safetensors",
+        "model.visual.encoder.layers.0.layer_norm1.bias": "00000.safetensors",
+        "model.visual.encoder.layers.0.self_attn.k_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.0.self_attn.k_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.0.self_attn.v_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.0.self_attn.v_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.0.self_attn.q_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.0.self_attn.q_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.0.self_attn.out_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.0.self_attn.out_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.0.layer_norm2.weight": "00000.safetensors",
+        "model.visual.encoder.layers.0.layer_norm2.bias": "00000.safetensors",
+        "model.visual.encoder.layers.0.mlp.fc1.weight": "00000.safetensors",
+        "model.visual.encoder.layers.0.mlp.fc1.bias": "00000.safetensors",
+        "model.visual.encoder.layers.0.mlp.fc2.weight": "00000.safetensors",
+        "model.visual.encoder.layers.0.mlp.fc2.bias": "00000.safetensors",
+        "model.visual.encoder.layers.1.layer_norm1.weight": "00000.safetensors",
+        "model.visual.encoder.layers.1.layer_norm1.bias": "00000.safetensors",
+        "model.visual.encoder.layers.1.self_attn.k_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.1.self_attn.k_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.1.self_attn.v_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.1.self_attn.v_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.1.self_attn.q_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.1.self_attn.q_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.1.self_attn.out_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.1.self_attn.out_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.1.layer_norm2.weight": "00000.safetensors",
+        "model.visual.encoder.layers.1.layer_norm2.bias": "00000.safetensors",
+        "model.visual.encoder.layers.1.mlp.fc1.weight": "00000.safetensors",
+        "model.visual.encoder.layers.1.mlp.fc1.bias": "00000.safetensors",
+        "model.visual.encoder.layers.1.mlp.fc2.weight": "00000.safetensors",
+        "model.visual.encoder.layers.1.mlp.fc2.bias": "00000.safetensors",
+        "model.visual.encoder.layers.2.layer_norm1.weight": "00000.safetensors",
+        "model.visual.encoder.layers.2.layer_norm1.bias": "00000.safetensors",
+        "model.visual.encoder.layers.2.self_attn.k_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.2.self_attn.k_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.2.self_attn.v_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.2.self_attn.v_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.2.self_attn.q_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.2.self_attn.q_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.2.self_attn.out_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.2.self_attn.out_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.2.layer_norm2.weight": "00000.safetensors",
+        "model.visual.encoder.layers.2.layer_norm2.bias": "00000.safetensors",
+        "model.visual.encoder.layers.2.mlp.fc1.weight": "00000.safetensors",
+        "model.visual.encoder.layers.2.mlp.fc1.bias": "00000.safetensors",
+        "model.visual.encoder.layers.2.mlp.fc2.weight": "00000.safetensors",
+        "model.visual.encoder.layers.2.mlp.fc2.bias": "00000.safetensors",
+        "model.visual.encoder.layers.3.layer_norm1.weight": "00000.safetensors",
+        "model.visual.encoder.layers.3.layer_norm1.bias": "00000.safetensors",
+        "model.visual.encoder.layers.3.self_attn.k_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.3.self_attn.k_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.3.self_attn.v_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.3.self_attn.v_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.3.self_attn.q_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.3.self_attn.q_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.3.self_attn.out_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.3.self_attn.out_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.3.layer_norm2.weight": "00000.safetensors",
+        "model.visual.encoder.layers.3.layer_norm2.bias": "00000.safetensors",
+        "model.visual.encoder.layers.3.mlp.fc1.weight": "00000.safetensors",
+        "model.visual.encoder.layers.3.mlp.fc1.bias": "00000.safetensors",
+        "model.visual.encoder.layers.3.mlp.fc2.weight": "00000.safetensors",
+        "model.visual.encoder.layers.3.mlp.fc2.bias": "00000.safetensors",
+        "model.visual.encoder.layers.4.layer_norm1.weight": "00000.safetensors",
+        "model.visual.encoder.layers.4.layer_norm1.bias": "00000.safetensors",
+        "model.visual.encoder.layers.4.self_attn.k_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.4.self_attn.k_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.4.self_attn.v_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.4.self_attn.v_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.4.self_attn.q_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.4.self_attn.q_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.4.self_attn.out_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.4.self_attn.out_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.4.layer_norm2.weight": "00000.safetensors",
+        "model.visual.encoder.layers.4.layer_norm2.bias": "00000.safetensors",
+        "model.visual.encoder.layers.4.mlp.fc1.weight": "00000.safetensors",
+        "model.visual.encoder.layers.4.mlp.fc1.bias": "00000.safetensors",
+        "model.visual.encoder.layers.4.mlp.fc2.weight": "00000.safetensors",
+        "model.visual.encoder.layers.4.mlp.fc2.bias": "00000.safetensors",
+        "model.visual.encoder.layers.5.layer_norm1.weight": "00000.safetensors",
+        "model.visual.encoder.layers.5.layer_norm1.bias": "00000.safetensors",
+        "model.visual.encoder.layers.5.self_attn.k_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.5.self_attn.k_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.5.self_attn.v_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.5.self_attn.v_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.5.self_attn.q_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.5.self_attn.q_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.5.self_attn.out_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.5.self_attn.out_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.5.layer_norm2.weight": "00000.safetensors",
+        "model.visual.encoder.layers.5.layer_norm2.bias": "00000.safetensors",
+        "model.visual.encoder.layers.5.mlp.fc1.weight": "00000.safetensors",
+        "model.visual.encoder.layers.5.mlp.fc1.bias": "00000.safetensors",
+        "model.visual.encoder.layers.5.mlp.fc2.weight": "00000.safetensors",
+        "model.visual.encoder.layers.5.mlp.fc2.bias": "00000.safetensors",
+        "model.visual.encoder.layers.6.layer_norm1.weight": "00000.safetensors",
+        "model.visual.encoder.layers.6.layer_norm1.bias": "00000.safetensors",
+        "model.visual.encoder.layers.6.self_attn.k_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.6.self_attn.k_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.6.self_attn.v_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.6.self_attn.v_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.6.self_attn.q_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.6.self_attn.q_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.6.self_attn.out_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.6.self_attn.out_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.6.layer_norm2.weight": "00000.safetensors",
+        "model.visual.encoder.layers.6.layer_norm2.bias": "00000.safetensors",
+        "model.visual.encoder.layers.6.mlp.fc1.weight": "00000.safetensors",
+        "model.visual.encoder.layers.6.mlp.fc1.bias": "00000.safetensors",
+        "model.visual.encoder.layers.6.mlp.fc2.weight": "00000.safetensors",
+        "model.visual.encoder.layers.6.mlp.fc2.bias": "00000.safetensors",
+        "model.visual.encoder.layers.7.layer_norm1.weight": "00000.safetensors",
+        "model.visual.encoder.layers.7.layer_norm1.bias": "00000.safetensors",
+        "model.visual.encoder.layers.7.self_attn.k_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.7.self_attn.k_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.7.self_attn.v_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.7.self_attn.v_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.7.self_attn.q_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.7.self_attn.q_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.7.self_attn.out_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.7.self_attn.out_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.7.layer_norm2.weight": "00000.safetensors",
+        "model.visual.encoder.layers.7.layer_norm2.bias": "00000.safetensors",
+        "model.visual.encoder.layers.7.mlp.fc1.weight": "00000.safetensors",
+        "model.visual.encoder.layers.7.mlp.fc1.bias": "00000.safetensors",
+        "model.visual.encoder.layers.7.mlp.fc2.weight": "00000.safetensors",
+        "model.visual.encoder.layers.7.mlp.fc2.bias": "00000.safetensors",
+        "model.visual.encoder.layers.8.layer_norm1.weight": "00000.safetensors",
+        "model.visual.encoder.layers.8.layer_norm1.bias": "00000.safetensors",
+        "model.visual.encoder.layers.8.self_attn.k_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.8.self_attn.k_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.8.self_attn.v_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.8.self_attn.v_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.8.self_attn.q_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.8.self_attn.q_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.8.self_attn.out_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.8.self_attn.out_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.8.layer_norm2.weight": "00000.safetensors",
+        "model.visual.encoder.layers.8.layer_norm2.bias": "00000.safetensors",
+        "model.visual.encoder.layers.8.mlp.fc1.weight": "00000.safetensors",
+        "model.visual.encoder.layers.8.mlp.fc1.bias": "00000.safetensors",
+        "model.visual.encoder.layers.8.mlp.fc2.weight": "00000.safetensors",
+        "model.visual.encoder.layers.8.mlp.fc2.bias": "00000.safetensors",
+        "model.visual.encoder.layers.9.layer_norm1.weight": "00000.safetensors",
+        "model.visual.encoder.layers.9.layer_norm1.bias": "00000.safetensors",
+        "model.visual.encoder.layers.9.self_attn.k_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.9.self_attn.k_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.9.self_attn.v_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.9.self_attn.v_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.9.self_attn.q_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.9.self_attn.q_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.9.self_attn.out_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.9.self_attn.out_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.9.layer_norm2.weight": "00000.safetensors",
+        "model.visual.encoder.layers.9.layer_norm2.bias": "00000.safetensors",
+        "model.visual.encoder.layers.9.mlp.fc1.weight": "00000.safetensors",
+        "model.visual.encoder.layers.9.mlp.fc1.bias": "00000.safetensors",
+        "model.visual.encoder.layers.9.mlp.fc2.weight": "00000.safetensors",
+        "model.visual.encoder.layers.9.mlp.fc2.bias": "00000.safetensors",
+        "model.visual.encoder.layers.10.layer_norm1.weight": "00000.safetensors",
+        "model.visual.encoder.layers.10.layer_norm1.bias": "00000.safetensors",
+        "model.visual.encoder.layers.10.self_attn.k_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.10.self_attn.k_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.10.self_attn.v_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.10.self_attn.v_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.10.self_attn.q_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.10.self_attn.q_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.10.self_attn.out_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.10.self_attn.out_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.10.layer_norm2.weight": "00000.safetensors",
+        "model.visual.encoder.layers.10.layer_norm2.bias": "00000.safetensors",
+        "model.visual.encoder.layers.10.mlp.fc1.weight": "00000.safetensors",
+        "model.visual.encoder.layers.10.mlp.fc1.bias": "00000.safetensors",
+        "model.visual.encoder.layers.10.mlp.fc2.weight": "00000.safetensors",
+        "model.visual.encoder.layers.10.mlp.fc2.bias": "00000.safetensors",
+        "model.visual.encoder.layers.11.layer_norm1.weight": "00000.safetensors",
+        "model.visual.encoder.layers.11.layer_norm1.bias": "00000.safetensors",
+        "model.visual.encoder.layers.11.self_attn.k_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.11.self_attn.k_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.11.self_attn.v_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.11.self_attn.v_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.11.self_attn.q_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.11.self_attn.q_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.11.self_attn.out_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.11.self_attn.out_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.11.layer_norm2.weight": "00000.safetensors",
+        "model.visual.encoder.layers.11.layer_norm2.bias": "00000.safetensors",
+        "model.visual.encoder.layers.11.mlp.fc1.weight": "00000.safetensors",
+        "model.visual.encoder.layers.11.mlp.fc1.bias": "00000.safetensors",
+        "model.visual.encoder.layers.11.mlp.fc2.weight": "00000.safetensors",
+        "model.visual.encoder.layers.11.mlp.fc2.bias": "00000.safetensors",
+        "model.visual.encoder.layers.12.layer_norm1.weight": "00000.safetensors",
+        "model.visual.encoder.layers.12.layer_norm1.bias": "00000.safetensors",
+        "model.visual.encoder.layers.12.self_attn.k_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.12.self_attn.k_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.12.self_attn.v_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.12.self_attn.v_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.12.self_attn.q_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.12.self_attn.q_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.12.self_attn.out_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.12.self_attn.out_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.12.layer_norm2.weight": "00000.safetensors",
+        "model.visual.encoder.layers.12.layer_norm2.bias": "00000.safetensors",
+        "model.visual.encoder.layers.12.mlp.fc1.weight": "00000.safetensors",
+        "model.visual.encoder.layers.12.mlp.fc1.bias": "00000.safetensors",
+        "model.visual.encoder.layers.12.mlp.fc2.weight": "00000.safetensors",
+        "model.visual.encoder.layers.12.mlp.fc2.bias": "00000.safetensors",
+        "model.visual.encoder.layers.13.layer_norm1.weight": "00000.safetensors",
+        "model.visual.encoder.layers.13.layer_norm1.bias": "00000.safetensors",
+        "model.visual.encoder.layers.13.self_attn.k_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.13.self_attn.k_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.13.self_attn.v_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.13.self_attn.v_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.13.self_attn.q_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.13.self_attn.q_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.13.self_attn.out_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.13.self_attn.out_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.13.layer_norm2.weight": "00000.safetensors",
+        "model.visual.encoder.layers.13.layer_norm2.bias": "00000.safetensors",
+        "model.visual.encoder.layers.13.mlp.fc1.weight": "00000.safetensors",
+        "model.visual.encoder.layers.13.mlp.fc1.bias": "00000.safetensors",
+        "model.visual.encoder.layers.13.mlp.fc2.weight": "00000.safetensors",
+        "model.visual.encoder.layers.13.mlp.fc2.bias": "00000.safetensors",
+        "model.visual.encoder.layers.14.layer_norm1.weight": "00000.safetensors",
+        "model.visual.encoder.layers.14.layer_norm1.bias": "00000.safetensors",
+        "model.visual.encoder.layers.14.self_attn.k_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.14.self_attn.k_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.14.self_attn.v_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.14.self_attn.v_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.14.self_attn.q_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.14.self_attn.q_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.14.self_attn.out_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.14.self_attn.out_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.14.layer_norm2.weight": "00000.safetensors",
+        "model.visual.encoder.layers.14.layer_norm2.bias": "00000.safetensors",
+        "model.visual.encoder.layers.14.mlp.fc1.weight": "00000.safetensors",
+        "model.visual.encoder.layers.14.mlp.fc1.bias": "00000.safetensors",
+        "model.visual.encoder.layers.14.mlp.fc2.weight": "00000.safetensors",
+        "model.visual.encoder.layers.14.mlp.fc2.bias": "00000.safetensors",
+        "model.visual.encoder.layers.15.layer_norm1.weight": "00000.safetensors",
+        "model.visual.encoder.layers.15.layer_norm1.bias": "00000.safetensors",
+        "model.visual.encoder.layers.15.self_attn.k_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.15.self_attn.k_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.15.self_attn.v_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.15.self_attn.v_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.15.self_attn.q_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.15.self_attn.q_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.15.self_attn.out_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.15.self_attn.out_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.15.layer_norm2.weight": "00000.safetensors",
+        "model.visual.encoder.layers.15.layer_norm2.bias": "00000.safetensors",
+        "model.visual.encoder.layers.15.mlp.fc1.weight": "00000.safetensors",
+        "model.visual.encoder.layers.15.mlp.fc1.bias": "00000.safetensors",
+        "model.visual.encoder.layers.15.mlp.fc2.weight": "00000.safetensors",
+        "model.visual.encoder.layers.15.mlp.fc2.bias": "00000.safetensors",
+        "model.visual.encoder.layers.16.layer_norm1.weight": "00000.safetensors",
+        "model.visual.encoder.layers.16.layer_norm1.bias": "00000.safetensors",
+        "model.visual.encoder.layers.16.self_attn.k_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.16.self_attn.k_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.16.self_attn.v_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.16.self_attn.v_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.16.self_attn.q_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.16.self_attn.q_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.16.self_attn.out_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.16.self_attn.out_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.16.layer_norm2.weight": "00000.safetensors",
+        "model.visual.encoder.layers.16.layer_norm2.bias": "00000.safetensors",
+        "model.visual.encoder.layers.16.mlp.fc1.weight": "00000.safetensors",
+        "model.visual.encoder.layers.16.mlp.fc1.bias": "00000.safetensors",
+        "model.visual.encoder.layers.16.mlp.fc2.weight": "00000.safetensors",
+        "model.visual.encoder.layers.16.mlp.fc2.bias": "00000.safetensors",
+        "model.visual.encoder.layers.17.layer_norm1.weight": "00000.safetensors",
+        "model.visual.encoder.layers.17.layer_norm1.bias": "00000.safetensors",
+        "model.visual.encoder.layers.17.self_attn.k_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.17.self_attn.k_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.17.self_attn.v_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.17.self_attn.v_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.17.self_attn.q_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.17.self_attn.q_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.17.self_attn.out_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.17.self_attn.out_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.17.layer_norm2.weight": "00000.safetensors",
+        "model.visual.encoder.layers.17.layer_norm2.bias": "00000.safetensors",
+        "model.visual.encoder.layers.17.mlp.fc1.weight": "00000.safetensors",
+        "model.visual.encoder.layers.17.mlp.fc1.bias": "00000.safetensors",
+        "model.visual.encoder.layers.17.mlp.fc2.weight": "00000.safetensors",
+        "model.visual.encoder.layers.17.mlp.fc2.bias": "00000.safetensors",
+        "model.visual.encoder.layers.18.layer_norm1.weight": "00000.safetensors",
+        "model.visual.encoder.layers.18.layer_norm1.bias": "00000.safetensors",
+        "model.visual.encoder.layers.18.self_attn.k_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.18.self_attn.k_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.18.self_attn.v_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.18.self_attn.v_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.18.self_attn.q_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.18.self_attn.q_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.18.self_attn.out_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.18.self_attn.out_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.18.layer_norm2.weight": "00000.safetensors",
+        "model.visual.encoder.layers.18.layer_norm2.bias": "00000.safetensors",
+        "model.visual.encoder.layers.18.mlp.fc1.weight": "00000.safetensors",
+        "model.visual.encoder.layers.18.mlp.fc1.bias": "00000.safetensors",
+        "model.visual.encoder.layers.18.mlp.fc2.weight": "00000.safetensors",
+        "model.visual.encoder.layers.18.mlp.fc2.bias": "00000.safetensors",
+        "model.visual.encoder.layers.19.layer_norm1.weight": "00000.safetensors",
+        "model.visual.encoder.layers.19.layer_norm1.bias": "00000.safetensors",
+        "model.visual.encoder.layers.19.self_attn.k_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.19.self_attn.k_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.19.self_attn.v_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.19.self_attn.v_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.19.self_attn.q_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.19.self_attn.q_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.19.self_attn.out_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.19.self_attn.out_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.19.layer_norm2.weight": "00000.safetensors",
+        "model.visual.encoder.layers.19.layer_norm2.bias": "00000.safetensors",
+        "model.visual.encoder.layers.19.mlp.fc1.weight": "00000.safetensors",
+        "model.visual.encoder.layers.19.mlp.fc1.bias": "00000.safetensors",
+        "model.visual.encoder.layers.19.mlp.fc2.weight": "00000.safetensors",
+        "model.visual.encoder.layers.19.mlp.fc2.bias": "00000.safetensors",
+        "model.visual.encoder.layers.20.layer_norm1.weight": "00000.safetensors",
+        "model.visual.encoder.layers.20.layer_norm1.bias": "00000.safetensors",
+        "model.visual.encoder.layers.20.self_attn.k_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.20.self_attn.k_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.20.self_attn.v_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.20.self_attn.v_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.20.self_attn.q_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.20.self_attn.q_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.20.self_attn.out_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.20.self_attn.out_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.20.layer_norm2.weight": "00000.safetensors",
+        "model.visual.encoder.layers.20.layer_norm2.bias": "00000.safetensors",
+        "model.visual.encoder.layers.20.mlp.fc1.weight": "00000.safetensors",
+        "model.visual.encoder.layers.20.mlp.fc1.bias": "00000.safetensors",
+        "model.visual.encoder.layers.20.mlp.fc2.weight": "00000.safetensors",
+        "model.visual.encoder.layers.20.mlp.fc2.bias": "00000.safetensors",
+        "model.visual.encoder.layers.21.layer_norm1.weight": "00000.safetensors",
+        "model.visual.encoder.layers.21.layer_norm1.bias": "00000.safetensors",
+        "model.visual.encoder.layers.21.self_attn.k_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.21.self_attn.k_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.21.self_attn.v_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.21.self_attn.v_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.21.self_attn.q_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.21.self_attn.q_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.21.self_attn.out_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.21.self_attn.out_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.21.layer_norm2.weight": "00000.safetensors",
+        "model.visual.encoder.layers.21.layer_norm2.bias": "00000.safetensors",
+        "model.visual.encoder.layers.21.mlp.fc1.weight": "00000.safetensors",
+        "model.visual.encoder.layers.21.mlp.fc1.bias": "00000.safetensors",
+        "model.visual.encoder.layers.21.mlp.fc2.weight": "00000.safetensors",
+        "model.visual.encoder.layers.21.mlp.fc2.bias": "00000.safetensors",
+        "model.visual.encoder.layers.22.layer_norm1.weight": "00000.safetensors",
+        "model.visual.encoder.layers.22.layer_norm1.bias": "00000.safetensors",
+        "model.visual.encoder.layers.22.self_attn.k_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.22.self_attn.k_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.22.self_attn.v_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.22.self_attn.v_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.22.self_attn.q_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.22.self_attn.q_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.22.self_attn.out_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.22.self_attn.out_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.22.layer_norm2.weight": "00000.safetensors",
+        "model.visual.encoder.layers.22.layer_norm2.bias": "00000.safetensors",
+        "model.visual.encoder.layers.22.mlp.fc1.weight": "00000.safetensors",
+        "model.visual.encoder.layers.22.mlp.fc1.bias": "00000.safetensors",
+        "model.visual.encoder.layers.22.mlp.fc2.weight": "00000.safetensors",
+        "model.visual.encoder.layers.22.mlp.fc2.bias": "00000.safetensors",
+        "model.visual.encoder.layers.23.layer_norm1.weight": "00000.safetensors",
+        "model.visual.encoder.layers.23.layer_norm1.bias": "00000.safetensors",
+        "model.visual.encoder.layers.23.self_attn.k_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.23.self_attn.k_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.23.self_attn.v_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.23.self_attn.v_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.23.self_attn.q_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.23.self_attn.q_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.23.self_attn.out_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.23.self_attn.out_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.23.layer_norm2.weight": "00000.safetensors",
+        "model.visual.encoder.layers.23.layer_norm2.bias": "00000.safetensors",
+        "model.visual.encoder.layers.23.mlp.fc1.weight": "00000.safetensors",
+        "model.visual.encoder.layers.23.mlp.fc1.bias": "00000.safetensors",
+        "model.visual.encoder.layers.23.mlp.fc2.weight": "00000.safetensors",
+        "model.visual.encoder.layers.23.mlp.fc2.bias": "00000.safetensors",
+        "model.visual.encoder.layers.24.layer_norm1.weight": "00000.safetensors",
+        "model.visual.encoder.layers.24.layer_norm1.bias": "00000.safetensors",
+        "model.visual.encoder.layers.24.self_attn.k_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.24.self_attn.k_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.24.self_attn.v_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.24.self_attn.v_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.24.self_attn.q_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.24.self_attn.q_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.24.self_attn.out_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.24.self_attn.out_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.24.layer_norm2.weight": "00000.safetensors",
+        "model.visual.encoder.layers.24.layer_norm2.bias": "00000.safetensors",
+        "model.visual.encoder.layers.24.mlp.fc1.weight": "00000.safetensors",
+        "model.visual.encoder.layers.24.mlp.fc1.bias": "00000.safetensors",
+        "model.visual.encoder.layers.24.mlp.fc2.weight": "00000.safetensors",
+        "model.visual.encoder.layers.24.mlp.fc2.bias": "00000.safetensors",
+        "model.visual.encoder.layers.25.layer_norm1.weight": "00000.safetensors",
+        "model.visual.encoder.layers.25.layer_norm1.bias": "00000.safetensors",
+        "model.visual.encoder.layers.25.self_attn.k_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.25.self_attn.k_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.25.self_attn.v_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.25.self_attn.v_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.25.self_attn.q_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.25.self_attn.q_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.25.self_attn.out_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.25.self_attn.out_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.25.layer_norm2.weight": "00000.safetensors",
+        "model.visual.encoder.layers.25.layer_norm2.bias": "00000.safetensors",
+        "model.visual.encoder.layers.25.mlp.fc1.weight": "00000.safetensors",
+        "model.visual.encoder.layers.25.mlp.fc1.bias": "00000.safetensors",
+        "model.visual.encoder.layers.25.mlp.fc2.weight": "00000.safetensors",
+        "model.visual.encoder.layers.25.mlp.fc2.bias": "00000.safetensors",
+        "model.visual.encoder.layers.26.layer_norm1.weight": "00000.safetensors",
+        "model.visual.encoder.layers.26.layer_norm1.bias": "00000.safetensors",
+        "model.visual.encoder.layers.26.self_attn.k_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.26.self_attn.k_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.26.self_attn.v_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.26.self_attn.v_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.26.self_attn.q_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.26.self_attn.q_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.26.self_attn.out_proj.weight": "00000.safetensors",
+        "model.visual.encoder.layers.26.self_attn.out_proj.bias": "00000.safetensors",
+        "model.visual.encoder.layers.26.layer_norm2.weight": "00000.safetensors",
+        "model.visual.encoder.layers.26.layer_norm2.bias": "00000.safetensors",
+        "model.visual.encoder.layers.26.mlp.fc1.weight": "00000.safetensors",
+        "model.visual.encoder.layers.26.mlp.fc1.bias": "00000.safetensors",
+        "model.visual.encoder.layers.26.mlp.fc2.weight": "00000.safetensors",
+        "model.visual.encoder.layers.26.mlp.fc2.bias": "00000.safetensors",
+        "model.visual.post_layernorm.weight": "00000.safetensors",
+        "model.visual.post_layernorm.bias": "00000.safetensors",
+        "model.projector.norm.weight": "00000.safetensors",
+        "model.projector.norm.bias": "00000.safetensors",
+        "model.projector.linear_fc1.weight": "00000.safetensors",
+        "model.projector.linear_fc1.bias": "00000.safetensors",
+        "model.projector.linear_fc2.weight": "00000.safetensors",
+        "model.projector.linear_fc2.bias": "00000.safetensors",
+        "model.language_model.embeddings.weight": "00000.safetensors",
+        "model.language_model.layers.0.norm.weight": "00000.safetensors",
+        "model.language_model.layers.0.mixer.q_proj.weight": "00000.safetensors",
+        "model.language_model.layers.0.mixer.k_proj.weight": "00000.safetensors",
+        "model.language_model.layers.0.mixer.v_proj.weight": "00000.safetensors",
+        "model.language_model.layers.0.mixer.o_proj.weight": "00000.safetensors",
+        "model.language_model.layers.1.norm.weight": "00000.safetensors",
+        "model.language_model.layers.1.mixer.up_proj.weight": "00000.safetensors",
+        "model.language_model.layers.1.mixer.down_proj.weight": "00000.safetensors",
+        "model.language_model.layers.2.norm.weight": "00000.safetensors",
+        "model.language_model.layers.2.mixer.q_proj.weight": "00000.safetensors",
+        "model.language_model.layers.2.mixer.k_proj.weight": "00000.safetensors",
+        "model.language_model.layers.2.mixer.v_proj.weight": "00000.safetensors",
+        "model.language_model.layers.2.mixer.o_proj.weight": "00000.safetensors",
+        "model.language_model.layers.3.norm.weight": "00000.safetensors",
+        "model.language_model.layers.3.mixer.up_proj.weight": "00000.safetensors",
+        "model.language_model.layers.3.mixer.down_proj.weight": "00000.safetensors",
+        "model.language_model.layers.4.norm.weight": "00000.safetensors",
+        "model.language_model.layers.4.mixer.q_proj.weight": "00000.safetensors",
+        "model.language_model.layers.4.mixer.k_proj.weight": "00000.safetensors",
+        "model.language_model.layers.4.mixer.v_proj.weight": "00000.safetensors",
+        "model.language_model.layers.4.mixer.o_proj.weight": "00000.safetensors",
+        "model.language_model.layers.5.norm.weight": "00000.safetensors",
+        "model.language_model.layers.5.mixer.up_proj.weight": "00000.safetensors",
+        "model.language_model.layers.5.mixer.down_proj.weight": "00000.safetensors",
+        "model.language_model.layers.6.norm.weight": "00000.safetensors",
+        "model.language_model.layers.6.mixer.q_proj.weight": "00000.safetensors",
+        "model.language_model.layers.6.mixer.k_proj.weight": "00000.safetensors",
+        "model.language_model.layers.6.mixer.v_proj.weight": "00000.safetensors",
+        "model.language_model.layers.6.mixer.o_proj.weight": "00000.safetensors",
+        "model.language_model.layers.7.norm.weight": "00000.safetensors",
+        "model.language_model.layers.7.mixer.up_proj.weight": "00000.safetensors",
+        "model.language_model.layers.7.mixer.down_proj.weight": "00000.safetensors",
+        "model.language_model.layers.8.norm.weight": "00000.safetensors",
+        "model.language_model.layers.8.mixer.q_proj.weight": "00000.safetensors",
+        "model.language_model.layers.8.mixer.k_proj.weight": "00000.safetensors",
+        "model.language_model.layers.8.mixer.v_proj.weight": "00000.safetensors",
+        "model.language_model.layers.8.mixer.o_proj.weight": "00000.safetensors",
+        "model.language_model.layers.9.norm.weight": "00000.safetensors",
+        "model.language_model.layers.9.mixer.up_proj.weight": "00000.safetensors",
+        "model.language_model.layers.9.mixer.down_proj.weight": "00000.safetensors",
+        "model.language_model.layers.10.norm.weight": "00000.safetensors",
+        "model.language_model.layers.10.mixer.q_proj.weight": "00000.safetensors",
+        "model.language_model.layers.10.mixer.k_proj.weight": "00000.safetensors",
+        "model.language_model.layers.10.mixer.v_proj.weight": "00000.safetensors",
+        "model.language_model.layers.10.mixer.o_proj.weight": "00000.safetensors",
+        "model.language_model.layers.11.norm.weight": "00000.safetensors",
+        "model.language_model.layers.11.mixer.up_proj.weight": "00000.safetensors",
+        "model.language_model.layers.11.mixer.down_proj.weight": "00000.safetensors",
+        "model.language_model.layers.12.norm.weight": "00000.safetensors",
+        "model.language_model.layers.12.mixer.q_proj.weight": "00000.safetensors",
+        "model.language_model.layers.12.mixer.k_proj.weight": "00000.safetensors",
+        "model.language_model.layers.12.mixer.v_proj.weight": "00000.safetensors",
+        "model.language_model.layers.12.mixer.o_proj.weight": "00000.safetensors",
+        "model.language_model.layers.13.norm.weight": "00000.safetensors",
+        "model.language_model.layers.13.mixer.up_proj.weight": "00000.safetensors",
+        "model.language_model.layers.13.mixer.down_proj.weight": "00000.safetensors",
+        "model.language_model.layers.14.norm.weight": "00000.safetensors",
+        "model.language_model.layers.14.mixer.q_proj.weight": "00000.safetensors",
+        "model.language_model.layers.14.mixer.k_proj.weight": "00000.safetensors",
+        "model.language_model.layers.14.mixer.v_proj.weight": "00000.safetensors",
+        "model.language_model.layers.14.mixer.o_proj.weight": "00000.safetensors",
+        "model.language_model.layers.15.norm.weight": "00000.safetensors",
+        "model.language_model.layers.15.mixer.up_proj.weight": "00000.safetensors",
+        "model.language_model.layers.15.mixer.down_proj.weight": "00000.safetensors",
+        "model.language_model.layers.16.norm.weight": "00000.safetensors",
+        "model.language_model.layers.16.mixer.q_proj.weight": "00000.safetensors",
+        "model.language_model.layers.16.mixer.k_proj.weight": "00000.safetensors",
+        "model.language_model.layers.16.mixer.v_proj.weight": "00000.safetensors",
+        "model.language_model.layers.16.mixer.o_proj.weight": "00000.safetensors",
+        "model.language_model.layers.17.norm.weight": "00000.safetensors",
+        "model.language_model.layers.17.mixer.up_proj.weight": "00000.safetensors",
+        "model.language_model.layers.17.mixer.down_proj.weight": "00000.safetensors",
+        "model.language_model.layers.18.norm.weight": "00000.safetensors",
+        "model.language_model.layers.18.mixer.q_proj.weight": "00000.safetensors",
+        "model.language_model.layers.18.mixer.k_proj.weight": "00000.safetensors",
+        "model.language_model.layers.18.mixer.v_proj.weight": "00000.safetensors",
+        "model.language_model.layers.18.mixer.o_proj.weight": "00000.safetensors",
+        "model.language_model.layers.19.norm.weight": "00000.safetensors",
+        "model.language_model.layers.19.mixer.up_proj.weight": "00000.safetensors",
+        "model.language_model.layers.19.mixer.down_proj.weight": "00000.safetensors",
+        "model.language_model.layers.20.norm.weight": "00000.safetensors",
+        "model.language_model.layers.20.mixer.q_proj.weight": "00000.safetensors",
+        "model.language_model.layers.20.mixer.k_proj.weight": "00000.safetensors",
+        "model.language_model.layers.20.mixer.v_proj.weight": "00000.safetensors",
+        "model.language_model.layers.20.mixer.o_proj.weight": "00000.safetensors",
+        "model.language_model.layers.21.norm.weight": "00000.safetensors",
+        "model.language_model.layers.21.mixer.up_proj.weight": "00000.safetensors",
+        "model.language_model.layers.21.mixer.down_proj.weight": "00000.safetensors",
+        "model.language_model.layers.22.norm.weight": "00000.safetensors",
+        "model.language_model.layers.22.mixer.q_proj.weight": "00000.safetensors",
+        "model.language_model.layers.22.mixer.k_proj.weight": "00000.safetensors",
+        "model.language_model.layers.22.mixer.v_proj.weight": "00000.safetensors",
+        "model.language_model.layers.22.mixer.o_proj.weight": "00000.safetensors",
+        "model.language_model.layers.23.norm.weight": "00000.safetensors",
+        "model.language_model.layers.23.mixer.up_proj.weight": "00000.safetensors",
+        "model.language_model.layers.23.mixer.down_proj.weight": "00000.safetensors",
+        "model.language_model.layers.24.norm.weight": "00000.safetensors",
+        "model.language_model.layers.24.mixer.q_proj.weight": "00000.safetensors",
+        "model.language_model.layers.24.mixer.k_proj.weight": "00000.safetensors",
+        "model.language_model.layers.24.mixer.v_proj.weight": "00000.safetensors",
+        "model.language_model.layers.24.mixer.o_proj.weight": "00000.safetensors",
+        "model.language_model.layers.25.norm.weight": "00000.safetensors",
+        "model.language_model.layers.25.mixer.up_proj.weight": "00000.safetensors",
+        "model.language_model.layers.25.mixer.down_proj.weight": "00000.safetensors",
+        "model.language_model.layers.26.norm.weight": "00000.safetensors",
+        "model.language_model.layers.26.mixer.q_proj.weight": "00000.safetensors",
+        "model.language_model.layers.26.mixer.k_proj.weight": "00000.safetensors",
+        "model.language_model.layers.26.mixer.v_proj.weight": "00000.safetensors",
+        "model.language_model.layers.26.mixer.o_proj.weight": "00000.safetensors",
+        "model.language_model.layers.27.norm.weight": "00000.safetensors",
+        "model.language_model.layers.27.mixer.up_proj.weight": "00000.safetensors",
+        "model.language_model.layers.27.mixer.down_proj.weight": "00000.safetensors",
+        "model.language_model.layers.28.norm.weight": "00000.safetensors",
+        "model.language_model.layers.28.mixer.q_proj.weight": "00000.safetensors",
+        "model.language_model.layers.28.mixer.k_proj.weight": "00000.safetensors",
+        "model.language_model.layers.28.mixer.v_proj.weight": "00000.safetensors",
+        "model.language_model.layers.28.mixer.o_proj.weight": "00000.safetensors",
+        "model.language_model.layers.29.norm.weight": "00000.safetensors",
+        "model.language_model.layers.29.mixer.up_proj.weight": "00000.safetensors",
+        "model.language_model.layers.29.mixer.down_proj.weight": "00000.safetensors",
+        "model.language_model.layers.30.norm.weight": "00000.safetensors",
+        "model.language_model.layers.30.mixer.q_proj.weight": "00000.safetensors",
+        "model.language_model.layers.30.mixer.k_proj.weight": "00000.safetensors",
+        "model.language_model.layers.30.mixer.v_proj.weight": "00000.safetensors",
+        "model.language_model.layers.30.mixer.o_proj.weight": "00000.safetensors",
+        "model.language_model.layers.31.norm.weight": "00000.safetensors",
+        "model.language_model.layers.31.mixer.up_proj.weight": "00000.safetensors",
+        "model.language_model.layers.31.mixer.down_proj.weight": "00000.safetensors",
+        "model.language_model.layers.32.norm.weight": "00000.safetensors",
+        "model.language_model.layers.32.mixer.q_proj.weight": "00000.safetensors",
+        "model.language_model.layers.32.mixer.k_proj.weight": "00000.safetensors",
+        "model.language_model.layers.32.mixer.v_proj.weight": "00000.safetensors",
+        "model.language_model.layers.32.mixer.o_proj.weight": "00000.safetensors",
+        "model.language_model.layers.33.norm.weight": "00000.safetensors",
+        "model.language_model.layers.33.mixer.up_proj.weight": "00000.safetensors",
+        "model.language_model.layers.33.mixer.down_proj.weight": "00000.safetensors",
+        "model.language_model.layers.34.norm.weight": "00000.safetensors",
+        "model.language_model.layers.34.mixer.q_proj.weight": "00000.safetensors",
+        "model.language_model.layers.34.mixer.k_proj.weight": "00000.safetensors",
+        "model.language_model.layers.34.mixer.v_proj.weight": "00000.safetensors",
+        "model.language_model.layers.34.mixer.o_proj.weight": "00000.safetensors",
+        "model.language_model.layers.35.norm.weight": "00000.safetensors",
+        "model.language_model.layers.35.mixer.up_proj.weight": "00000.safetensors",
+        "model.language_model.layers.35.mixer.down_proj.weight": "00000.safetensors",
+        "model.language_model.layers.36.norm.weight": "00000.safetensors",
+        "model.language_model.layers.36.mixer.q_proj.weight": "00000.safetensors",
+        "model.language_model.layers.36.mixer.k_proj.weight": "00000.safetensors",
+        "model.language_model.layers.36.mixer.v_proj.weight": "00000.safetensors",
+        "model.language_model.layers.36.mixer.o_proj.weight": "00000.safetensors",
+        "model.language_model.layers.37.norm.weight": "00000.safetensors",
+        "model.language_model.layers.37.mixer.up_proj.weight": "00000.safetensors",
+        "model.language_model.layers.37.mixer.down_proj.weight": "00000.safetensors",
+        "model.language_model.layers.38.norm.weight": "00000.safetensors",
+        "model.language_model.layers.38.mixer.q_proj.weight": "00000.safetensors",
+        "model.language_model.layers.38.mixer.k_proj.weight": "00000.safetensors",
+        "model.language_model.layers.38.mixer.v_proj.weight": "00000.safetensors",
+        "model.language_model.layers.38.mixer.o_proj.weight": "00000.safetensors",
+        "model.language_model.layers.39.norm.weight": "00000.safetensors",
+        "model.language_model.layers.39.mixer.up_proj.weight": "00000.safetensors",
+        "model.language_model.layers.39.mixer.down_proj.weight": "00000.safetensors",
+        "model.language_model.layers.40.norm.weight": "00000.safetensors",
+        "model.language_model.layers.40.mixer.q_proj.weight": "00000.safetensors",
+        "model.language_model.layers.40.mixer.k_proj.weight": "00000.safetensors",
+        "model.language_model.layers.40.mixer.v_proj.weight": "00000.safetensors",
+        "model.language_model.layers.40.mixer.o_proj.weight": "00000.safetensors",
+        "model.language_model.layers.41.norm.weight": "00000.safetensors",
+        "model.language_model.layers.41.mixer.up_proj.weight": "00000.safetensors",
+        "model.language_model.layers.41.mixer.down_proj.weight": "00000.safetensors",
+        "model.language_model.layers.42.norm.weight": "00000.safetensors",
+        "model.language_model.layers.42.mixer.q_proj.weight": "00000.safetensors",
+        "model.language_model.layers.42.mixer.k_proj.weight": "00000.safetensors",
+        "model.language_model.layers.42.mixer.v_proj.weight": "00000.safetensors",
+        "model.language_model.layers.42.mixer.o_proj.weight": "00000.safetensors",
+        "model.language_model.layers.43.norm.weight": "00000.safetensors",
+        "model.language_model.layers.43.mixer.up_proj.weight": "00000.safetensors",
+        "model.language_model.layers.43.mixer.down_proj.weight": "00000.safetensors",
+        "model.language_model.layers.44.norm.weight": "00000.safetensors",
+        "model.language_model.layers.44.mixer.q_proj.weight": "00000.safetensors",
+        "model.language_model.layers.44.mixer.k_proj.weight": "00000.safetensors",
+        "model.language_model.layers.44.mixer.v_proj.weight": "00000.safetensors",
+        "model.language_model.layers.44.mixer.o_proj.weight": "00000.safetensors",
+        "model.language_model.layers.45.norm.weight": "00000.safetensors",
+        "model.language_model.layers.45.mixer.up_proj.weight": "00000.safetensors",
+        "model.language_model.layers.45.mixer.down_proj.weight": "00000.safetensors",
+        "model.language_model.layers.46.norm.weight": "00000.safetensors",
+        "model.language_model.layers.46.mixer.q_proj.weight": "00000.safetensors",
+        "model.language_model.layers.46.mixer.k_proj.weight": "00000.safetensors",
+        "model.language_model.layers.46.mixer.v_proj.weight": "00000.safetensors",
+        "model.language_model.layers.46.mixer.o_proj.weight": "00000.safetensors",
+        "model.language_model.layers.47.norm.weight": "00000.safetensors",
+        "model.language_model.layers.47.mixer.up_proj.weight": "00000.safetensors",
+        "model.language_model.layers.47.mixer.down_proj.weight": "00000.safetensors",
+        "model.language_model.layers.48.norm.weight": "00000.safetensors",
+        "model.language_model.layers.48.mixer.q_proj.weight": "00000.safetensors",
+        "model.language_model.layers.48.mixer.k_proj.weight": "00000.safetensors",
+        "model.language_model.layers.48.mixer.v_proj.weight": "00000.safetensors",
+        "model.language_model.layers.48.mixer.o_proj.weight": "00000.safetensors",
+        "model.language_model.layers.49.norm.weight": "00000.safetensors",
+        "model.language_model.layers.49.mixer.up_proj.weight": "00000.safetensors",
+        "model.language_model.layers.49.mixer.down_proj.weight": "00000.safetensors",
+        "model.language_model.layers.50.norm.weight": "00000.safetensors",
+        "model.language_model.layers.50.mixer.q_proj.weight": "00000.safetensors",
+        "model.language_model.layers.50.mixer.k_proj.weight": "00000.safetensors",
+        "model.language_model.layers.50.mixer.v_proj.weight": "00000.safetensors",
+        "model.language_model.layers.50.mixer.o_proj.weight": "00000.safetensors",
+        "model.language_model.layers.51.norm.weight": "00000.safetensors",
+        "model.language_model.layers.51.mixer.up_proj.weight": "00000.safetensors",
+        "model.language_model.layers.51.mixer.down_proj.weight": "00000.safetensors",
+        "model.language_model.layers.52.norm.weight": "00000.safetensors",
+        "model.language_model.layers.52.mixer.q_proj.weight": "00000.safetensors",
+        "model.language_model.layers.52.mixer.k_proj.weight": "00000.safetensors",
+        "model.language_model.layers.52.mixer.v_proj.weight": "00000.safetensors",
+        "model.language_model.layers.52.mixer.o_proj.weight": "00000.safetensors",
+        "model.language_model.layers.53.norm.weight": "00000.safetensors",
+        "model.language_model.layers.53.mixer.up_proj.weight": "00000.safetensors",
+        "model.language_model.layers.53.mixer.down_proj.weight": "00000.safetensors",
+        "model.language_model.layers.54.norm.weight": "00000.safetensors",
+        "model.language_model.layers.54.mixer.q_proj.weight": "00000.safetensors",
+        "model.language_model.layers.54.mixer.k_proj.weight": "00000.safetensors",
+        "model.language_model.layers.54.mixer.v_proj.weight": "00000.safetensors",
+        "model.language_model.layers.54.mixer.o_proj.weight": "00000.safetensors",
+        "model.language_model.layers.55.norm.weight": "00000.safetensors",
+        "model.language_model.layers.55.mixer.up_proj.weight": "00001.safetensors",
+        "model.language_model.layers.55.mixer.down_proj.weight": "00001.safetensors",
+        "model.language_model.norm_f.weight": "00001.safetensors",
+        "lm_head.weight": "00001.safetensors"
+    }
+}

checkpoints/balanced288/model_index.json

@@ -0,0 +1,31 @@
+{
+  "_class_name": "Cosmos3OmniPipeline",
+  "_diffusers_version": "0.40.0.dev0",
+  "default_use_system_prompt": false,
+  "enable_safety_checker": false,
+  "safety_checker": [
+    null,
+    null
+  ],
+  "scheduler": [
+    "diffusers",
+    "UniPCMultistepScheduler"
+  ],
+  "sound_tokenizer": [
+    null,
+    null
+  ],
+  "text_tokenizer": [
+    "transformers",
+    "PreTrainedTokenizerFast"
+  ],
+  "transformer": [
+    "diffusers",
+    "Cosmos3OmniTransformer"
+  ],
+  "use_native_flow_schedule": true,
+  "vae": [
+    "diffusers",
+    "AutoencoderKLWan"
+  ]
+}

checkpoints/balanced288/modular_model_index.json

@@ -0,0 +1,60 @@
+{
+  "_blocks_class_name": "Cosmos3OmniBlocks",
+  "_class_name": "Cosmos3OmniModularPipeline",
+  "_diffusers_version": "0.40.0.dev0",
+  "is_distilled": false,
+  "default_use_system_prompt": false,
+  "use_native_flow_schedule": true,
+  "scheduler": [
+    "diffusers",
+    "UniPCMultistepScheduler",
+    {
+      "pretrained_model_name_or_path": "nvidia/Cosmos3-Edge",
+      "subfolder": "scheduler",
+      "type_hint": [
+        "diffusers",
+        "UniPCMultistepScheduler"
+      ],
+      "variant": null
+    }
+  ],
+  "text_tokenizer": [
+    "transformers",
+    "PreTrainedTokenizerFast",
+    {
+      "pretrained_model_name_or_path": "nvidia/Cosmos3-Edge",
+      "subfolder": "text_tokenizer",
+      "type_hint": [
+        "transformers",
+        "PreTrainedTokenizerFast"
+      ],
+      "variant": null
+    }
+  ],
+  "transformer": [
+    "diffusers",
+    "Cosmos3OmniTransformer",
+    {
+      "pretrained_model_name_or_path": "nvidia/Cosmos3-Edge",
+      "subfolder": "transformer",
+      "type_hint": [
+        "diffusers",
+        "Cosmos3OmniTransformer"
+      ],
+      "variant": null
+    }
+  ],
+  "vae": [
+    "diffusers",
+    "AutoencoderKLWan",
+    {
+      "pretrained_model_name_or_path": "nvidia/Cosmos3-Edge",
+      "subfolder": "vae",
+      "type_hint": [
+        "diffusers",
+        "AutoencoderKLWan"
+      ],
+      "variant": null
+    }
+  ]
+}

checkpoints/balanced288/preprocessor_config.json

@@ -0,0 +1,21 @@
+{
+  "do_resize": true,
+  "image_mean": [
+    0.5,
+    0.5,
+    0.5
+  ],
+  "image_processor_type": "Cosmos3EdgeImageProcessor",
+  "image_std": [
+    0.5,
+    0.5,
+    0.5
+  ],
+  "merge_size": 2,
+  "patch_size": 16,
+  "processor_class": "Cosmos3EdgeProcessor",
+  "size": {
+    "longest_edge": 16777216,
+    "shortest_edge": 65536
+  }
+}

checkpoints/balanced288/processor_config.json

@@ -0,0 +1,46 @@
+{
+  "image_processor": {
+    "do_resize": true,
+    "image_mean": [
+      0.5,
+      0.5,
+      0.5
+    ],
+    "image_processor_type": "Cosmos3EdgeImageProcessor",
+    "image_std": [
+      0.5,
+      0.5,
+      0.5
+    ],
+    "merge_size": 2,
+    "patch_size": 16,
+    "processor_class": "Cosmos3EdgeProcessor",
+    "size": {
+      "longest_edge": 16777216,
+      "shortest_edge": 65536
+    }
+  },
+  "processor_class": "Cosmos3EdgeProcessor",
+  "video_processor": {
+    "image_mean": [
+      0.5,
+      0.5,
+      0.5
+    ],
+    "image_std": [
+      0.5,
+      0.5,
+      0.5
+    ],
+    "merge_size": 2,
+    "patch_size": 16,
+    "processor_class": "Cosmos3EdgeProcessor",
+    "return_metadata": true,
+    "size": {
+      "longest_edge": 25165824,
+      "shortest_edge": 4096
+    },
+    "temporal_patch_size": 1,
+    "video_processor_type": "Cosmos3EdgeVideoProcessor"
+  }
+}

checkpoints/balanced288/scheduler/scheduler_config.json

@@ -0,0 +1,33 @@
+{
+  "_class_name": "UniPCMultistepScheduler",
+  "_diffusers_version": "0.40.0.dev0",
+  "beta_end": 0.02,
+  "beta_schedule": "linear",
+  "beta_start": 0.0001,
+  "disable_corrector": [],
+  "dynamic_thresholding_ratio": 0.995,
+  "final_sigmas_type": "zero",
+  "flow_shift": 1.0,
+  "lower_order_final": true,
+  "num_train_timesteps": 1000,
+  "predict_x0": true,
+  "prediction_type": "flow_prediction",
+  "rescale_betas_zero_snr": false,
+  "sample_max_value": 1.0,
+  "shift_terminal": null,
+  "sigma_max": 200.0,
+  "sigma_min": 0.147,
+  "solver_order": 2,
+  "solver_p": null,
+  "solver_type": "bh2",
+  "steps_offset": 0,
+  "thresholding": false,
+  "time_shift_type": "exponential",
+  "timestep_spacing": "linspace",
+  "trained_betas": null,
+  "use_beta_sigmas": false,
+  "use_dynamic_shifting": false,
+  "use_exponential_sigmas": false,
+  "use_flow_sigmas": true,
+  "use_karras_sigmas": true
+}

checkpoints/balanced288/special_tokens_map.json

@@ -0,0 +1,30 @@
+{
+  "bos_token": {
+    "content": "<s>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "eos_token": {
+    "content": "<|im_end|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "<|im_end|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "unk_token": {
+    "content": "<unk>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

checkpoints/balanced288/tancho-model-provenance.json

@@ -0,0 +1,279 @@
+{
+  "repo": "nvidia/Cosmos3-Edge",
+  "revision": "a9d944e2c6a1bf9f48b92ad16348e70c5f1836ba",
+  "files": [
+    {
+      "path": ".gitattributes",
+      "bytes": 2896,
+      "sha256": "0ec08faa6a32b6523f44e31000a59e42743463171a90f640ddde5859f77f645c"
+    },
+    {
+      "path": "BIAS.md",
+      "bytes": 4720,
+      "sha256": "1d65943c20dac47c4250b5a4a71266c001f6c85a17dad556ad00dbfc2a8115a9"
+    },
+    {
+      "path": "EXPLAINABILITY.md",
+      "bytes": 3189,
+      "sha256": "7d9e73df359fc9c0fcffdc18045018f55f124e5a6b6f71268a93d63c56e1a997"
+    },
+    {
+      "path": "PRIVACY.md",
+      "bytes": 1215,
+      "sha256": "0298f236e550d4064cd8d83babad8dfc791295bba602210ca6c8106a993ca699"
+    },
+    {
+      "path": "README.md",
+      "bytes": 55328,
+      "sha256": "b42c91405dad695c8e23c16d82655929504100456c210b8b88fd5f0fe6372f4e"
+    },
+    {
+      "path": "SAFETY.md",
+      "bytes": 3677,
+      "sha256": "b59cf989cb66eb3b1c5e0692d04c42b9a39751801259b225733ab9493e08f03b"
+    },
+    {
+      "path": "assets/benchmark-image2video.png",
+      "bytes": 58518,
+      "sha256": "508a165a894a88d0b118aeb521173ead54fc4c5947e2ba7bc5609a0fa9f7a2ed"
+    },
+    {
+      "path": "assets/benchmark-overall.png",
+      "bytes": 81007,
+      "sha256": "fdc1dbbeda37163b09aab0b69e22c9cae2880eeb53e2287d71eba77e2985a1c1"
+    },
+    {
+      "path": "assets/diffusers_outputs/edge_action_fd_diffusers_chunk_00.mp4",
+      "bytes": 14797,
+      "sha256": "c1288871c6083c913d58dd0398b73a3d8664b6a53b6ae64513f99a91ac3fa208"
+    },
+    {
+      "path": "assets/diffusers_outputs/edge_action_fd_diffusers_chunk_01.mp4",
+      "bytes": 13183,
+      "sha256": "71609ef17dcaa83f46fe2b27766f7405a619475dbf3525cc78b28b678dae1ddc"
+    },
+    {
+      "path": "assets/diffusers_outputs/edge_action_fd_umi_2chunk_diffusers.mp4",
+      "bytes": 23553,
+      "sha256": "488a97f7a45bfc7cdb16011af8fa9d131cb47380e79926b72c7ff485d10ac83b"
+    },
+    {
+      "path": "assets/diffusers_outputs/edge_action_id_av_inverse_0_diffusers.json",
+      "bytes": 15925,
+      "sha256": "ffbc1fe19a06a1e28ced792095dc33630b72b20729bf0dc60d079c197a9e8777"
+    },
+    {
+      "path": "assets/diffusers_outputs/edge_action_id_av_inverse_1_diffusers.json",
+      "bytes": 15676,
+      "sha256": "7202a82fb6fb76d076a045fd2ba097c70320fa979987e4f8e72870e15c917e22"
+    },
+    {
+      "path": "assets/diffusers_outputs/edge_i2v_diffusers.mp4",
+      "bytes": 1278049,
+      "sha256": "2fe93251039d8640625f660f42514d8fddd0812ae6918a4ea3cf5fc2363e4a16"
+    },
+    {
+      "path": "assets/edge_action_fd_umi_2chunk_output.mp4",
+      "bytes": 32755,
+      "sha256": "10037bf0c2a20c46f24e616d7b822932babb45f72113833f320e2bb524c8c57b"
+    },
+    {
+      "path": "assets/edge_action_id_av_0_output.json",
+      "bytes": 11216,
+      "sha256": "087a374e4c4d04e7b5f6a95843fb4c062fac7ae6ce04b82b89e63ed17ccd7162"
+    },
+    {
+      "path": "assets/edge_action_id_av_0_output.png",
+      "bytes": 113804,
+      "sha256": "18b90a143ee04b6be339caa744d5c0debd3d36e90effa20f09c980c0678fec13"
+    },
+    {
+      "path": "assets/edge_action_id_av_1_output.json",
+      "bytes": 10990,
+      "sha256": "82cefef8bf762741a2eecd0a829a6721ec5de411ec8a005bb5fd944535f2db55"
+    },
+    {
+      "path": "assets/edge_action_id_av_1_output.png",
+      "bytes": 102489,
+      "sha256": "660085cebabd54658a108922a9ae842c57cc7762291bb500035b3f8b01c22992"
+    },
+    {
+      "path": "assets/edge_i2v_output.mp4",
+      "bytes": 8053812,
+      "sha256": "d4e87cbc2efe25f40ac31d91a11a872f7b51d262ce764cfd0dde53a7be762998"
+    },
+    {
+      "path": "assets/example_action_fd_umi_action_chunks.json",
+      "bytes": 10350,
+      "sha256": "061dd9fa75614e7d1f88ed8fba7d67cd938cd404161f4f60cb6109390924cd04"
+    },
+    {
+      "path": "assets/example_action_fd_umi_first_frame.png",
+      "bytes": 67026,
+      "sha256": "dc9a45f8b305e2010a4988171f2f19ec61e04346c98ea4c52f0d02b06e298973"
+    },
+    {
+      "path": "assets/example_action_id_av_0_input.mp4",
+      "bytes": 1125838,
+      "sha256": "ff205f86ae169031c0e12c8c6bc8aabe24aeb44b84a16cba977669b29912f5fc"
+    },
+    {
+      "path": "assets/example_action_id_av_1_input.mp4",
+      "bytes": 1639407,
+      "sha256": "169e65cee76ef7c6366987a8e4c8e4ec6f803f5e624ba2ef39ba1f0c672925aa"
+    },
+    {
+      "path": "assets/example_i2v_input.jpg",
+      "bytes": 860765,
+      "sha256": "1de51eb5c6d51ec97aa3351a6685717b0253e36073eb9cdd3ef65affa115a4e2"
+    },
+    {
+      "path": "assets/example_i2v_prompt.json",
+      "bytes": 9186,
+      "sha256": "53413fddf5d0325104bfa6e7a440b902cf58ffd93a3fe8d9b0fb19fe642dd112"
+    },
+    {
+      "path": "assets/example_reasoning_input.png",
+      "bytes": 230656,
+      "sha256": "6686b937bdb28e2c9804c435bd63a7ab56ac1531ffc9b482f2b8a75aed8770f5"
+    },
+    {
+      "path": "assets/example_reasoning_prompt.json",
+      "bytes": 151,
+      "sha256": "fb6fbd57e5af6b09960d9960c709e1b422faf299a4b34139d212c7fccc488348"
+    },
+    {
+      "path": "assets/negative_prompt.json",
+      "bytes": 17578,
+      "sha256": "c7ee5819ef689f9b64074e6aa058fb8c3f4b6671ae0bc8cd20ea3fda5f177fd1"
+    },
+    {
+      "path": "chat_template.jinja",
+      "bytes": 12158,
+      "sha256": "7120ee6666468d4e9b2dc11e133ac5c2fa765fa5907706bf0f906270aa5510c8"
+    },
+    {
+      "path": "config.json",
+      "bytes": 1679,
+      "sha256": "ffb75b654e65d10e337ea07f20ac4eadc3775dd22c9a8194c87c3b68df5c8f5f"
+    },
+    {
+      "path": "generation_config.json",
+      "bytes": 154,
+      "sha256": "b953ca6943f16fec3084c80138c8c61bd32181074b1a721afe95f43d715f5fab"
+    },
+    {
+      "path": "images/benchmark-reasoning.png",
+      "bytes": 265797,
+      "sha256": "75974a959d0eb23edb578dfd2b04656748b8f738f9bc19c2dd97f9d60c886fe1"
+    },
+    {
+      "path": "model.safetensors.index.json",
+      "bytes": 68564,
+      "sha256": "ee48f9da9fbab206b6d2902eb109a842dde7b1347f5716a177f0be00968acf33"
+    },
+    {
+      "path": "model_index.json",
+      "bytes": 555,
+      "sha256": "6e0a5c43411271246ee0446dc644ac38eaf72958ca4dc2fb59c2fb3e3893420e"
+    },
+    {
+      "path": "modular_model_index.json",
+      "bytes": 1357,
+      "sha256": "05f941860981e8f2491deb43dcc20031069467ce9642f6499a3c0d7af55468e9"
+    },
+    {
+      "path": "preprocessor_config.json",
+      "bytes": 334,
+      "sha256": "111a151f82088f4e15cb4d488c5db0e9c481ae46ec8cf146d734ac62d13a57d6"
+    },
+    {
+      "path": "processor_config.json",
+      "bytes": 875,
+      "sha256": "7444d3780a8ed0b11d850292fa54407cfd1f389c101d111090289da354b13333"
+    },
+    {
+      "path": "scheduler/scheduler_config.json",
+      "bytes": 889,
+      "sha256": "a41e41fdf4c81536831a9f20a30ff34326df9871d796f54896d857ad53ff8b53"
+    },
+    {
+      "path": "special_tokens_map.json",
+      "bytes": 563,
+      "sha256": "e9435fefd6d838fd9fcbbc44b97a8e3ff322be7f6dfb7e4fd2468586574bb52b"
+    },
+    {
+      "path": "text_tokenizer/chat_template.jinja",
+      "bytes": 12158,
+      "sha256": "7120ee6666468d4e9b2dc11e133ac5c2fa765fa5907706bf0f906270aa5510c8"
+    },
+    {
+      "path": "text_tokenizer/special_tokens_map.json",
+      "bytes": 563,
+      "sha256": "e9435fefd6d838fd9fcbbc44b97a8e3ff322be7f6dfb7e4fd2468586574bb52b"
+    },
+    {
+      "path": "text_tokenizer/tokenizer.json",
+      "bytes": 17077500,
+      "sha256": "4dc692a99dca6d92a44e9529ffb53541eb79bb260eec7281bc51268c05d7311c"
+    },
+    {
+      "path": "text_tokenizer/tokenizer_config.json",
+      "bytes": 393,
+      "sha256": "f6649084ecfebc186ec33bc8f47be7bba6a4b3fda55c040970259a1cb1c0c67c"
+    },
+    {
+      "path": "tokenizer.json",
+      "bytes": 17077500,
+      "sha256": "4dc692a99dca6d92a44e9529ffb53541eb79bb260eec7281bc51268c05d7311c"
+    },
+    {
+      "path": "tokenizer_config.json",
+      "bytes": 177253,
+      "sha256": "85577f01be64ea03ee9aacc0536088e47b96971e4aff21e0aa604900b1410386"
+    },
+    {
+      "path": "transformer/config.json",
+      "bytes": 1075,
+      "sha256": "8c3c0945e7e66b2f59cbac80aace9db04edb4230fa0931bf64d4c12f51cbc81f"
+    },
+    {
+      "path": "transformer/diffusion_pytorch_model-00001-of-00002.safetensors",
+      "bytes": 5000040072,
+      "sha256": "116134e5492c514df79a2f07214e577c397aa961387dbe1c5dda488e7994ff6b"
+    },
+    {
+      "path": "transformer/diffusion_pytorch_model-00002-of-00002.safetensors",
+      "bytes": 1739335512,
+      "sha256": "3b4c0aafe2705c900ac7bc743085a8e9e09c906624331bc2baa21e172e5d48e4"
+    },
+    {
+      "path": "transformer/diffusion_pytorch_model.safetensors.index.json",
+      "bytes": 53623,
+      "sha256": "13a947ce2f9e546fe5aee7e2303aa3e6f1bbf08ff7a44a61d959ee094d01f2dc"
+    },
+    {
+      "path": "vae/config.json",
+      "bytes": 1755,
+      "sha256": "2af4752d63e8b308b8bfd29798ec6663886583ab228d7c643f559612c54df1ca"
+    },
+    {
+      "path": "vae/diffusion_pytorch_model.safetensors",
+      "bytes": 1409400600,
+      "sha256": "230496cb59ff85bc9c040487737c4062480cb61c71e697b197b4c30142f2a0da"
+    },
+    {
+      "path": "video_preprocessor_config.json",
+      "bytes": 367,
+      "sha256": "9cada8c04cb57ea22ff44984b8307a63c626c608e84a130c1f2e7fe134efc6d4"
+    },
+    {
+      "path": "vision_encoder/model.safetensors",
+      "bytes": 978739880,
+      "sha256": "2180ad739ecc96b5c1e9386892d3c5c08bfa42b9cdab9aabc53b028671db89b3"
+    }
+  ],
+  "total_bytes": 9176128932,
+  "integrity": "upstream LFS SHA256 or Git blob SHA1, plus local SHA256",
+  "model_loaded": false
+}

checkpoints/balanced288/tancho-source-manifest.json

@@ -0,0 +1,422 @@
+{
+  "_id": "6a458c7ce6a31bbaf190d572",
+  "id": "nvidia/Cosmos3-Edge",
+  "private": false,
+  "library_name": "cosmos",
+  "tags": [
+    "cosmos",
+    "diffusers",
+    "safetensors",
+    "cosmos3_edge",
+    "nvidia",
+    "cosmos3",
+    "arxiv:2405.14867",
+    "license:other",
+    "deploy:azure",
+    "deploy:sagemaker",
+    "region:us"
+  ],
+  "downloads": 1615933,
+  "likes": 199,
+  "modelId": "nvidia/Cosmos3-Edge",
+  "author": "nvidia",
+  "sha": "a9d944e2c6a1bf9f48b92ad16348e70c5f1836ba",
+  "lastModified": "2026-08-26T21:26:27.000Z",
+  "gated": false,
+  "disabled": false,
+  "model-index": null,
+  "config": {
+    "architectures": [
+      "Cosmos3EdgeForConditionalGeneration"
+    ],
+    "model_type": "cosmos3_edge",
+    "tokenizer_config": {
+      "bos_token": "<s>",
+      "eos_token": "<|im_end|>",
+      "pad_token": "<|im_end|>",
+      "unk_token": "<unk>"
+    },
+    "chat_template_jinja": "\n{% macro render_extra_keys(json_dict, handled_keys) %}\n    {%- if json_dict is mapping %}\n        {%- for json_key in json_dict if json_key not in handled_keys %}\n            {%- if json_dict[json_key] is mapping or (json_dict[json_key] is sequence and json_dict[json_key] is not string) %}\n                {{- '\n<' ~ json_key ~ '>' ~ (json_dict[json_key] | tojson | safe) ~ '</' ~ json_key ~ '>' }}\n            {%- else %}\n                {{-'\n<' ~ json_key ~ '>' ~ (json_dict[json_key] | string) ~ '</' ~ json_key ~ '>' }}\n            {%- endif %}\n        {%- endfor %}\n    {%- endif %}\n{% endmacro %}\n{%- set enable_thinking = enable_thinking if enable_thinking is defined else True %}\n{%- set truncate_history_thinking = truncate_history_thinking if truncate_history_thinking is defined else True %}\n\n{%- set ns = namespace(last_user_idx = -1) %}\n{%- set loop_messages = messages %}\n{%- for m in loop_messages %}\n  {%- if m[\"role\"] == \"user\" %}\n    {%- set ns.last_user_idx = loop.index0 %}\n  {%- endif %}\n{%- endfor %}\n\n{%- if messages[0][\"role\"] == \"system\" %}\n    {%- if messages[0][\"content\"] is string %}\n        {%- set system_message = messages[0][\"content\"] %}\n    {%- else %}\n        {%- set ns = namespace(system_text=\"\") %}\n        {%- for part in messages[0][\"content\"] %}\n            {%- if 'text' in part %}\n                {%- set ns.system_text = ns.system_text + part.text %}\n            {%- endif %}\n        {%- endfor %}\n        {%- set system_message = ns.system_text %}\n    {%- endif %}\n\n    {%- set loop_messages = messages[1:] %}\n{%- else %}\n    {%- set system_message = \"\" %}\n    {%- set loop_messages = messages %}\n{%- endif %}\n{%- if not tools is defined %}\n    {%- set tools = [] %}\n{%- endif %}\n{# Recompute last_user_idx relative to loop_messages after handling system #}\n{%- set ns = namespace(last_user_idx = -1) %}\n{%- for m in loop_messages %}\n  {%- if m[\"role\"] == \"user\" %}\n    {%- set ns.last_user_idx = loop.index0 %}\n  {%- endif %}\n{%- endfor %}\n{%- if system_message is defined %}\n    {{- \"<|im_start|>system\n\" + system_message }}\n{%- else %}\n    {%- if tools is iterable and tools | length > 0 %}\n        {{- \"<|im_start|>system\n\" }}\n    {%- endif %}\n{%- endif %}\n{%- if tools is iterable and tools | length > 0 %}\n    {%- if system_message is defined and system_message | length > 0 %}\n        {{- \"\n\n\" }}\n    {%- endif %}\n    {{- \"# Tools\n\nYou have access to the following functions:\n\n\" }}\n    {{- \"<tools>\" }}\n    {%- for tool in tools %}\n        {%- if tool.function is defined %}\n            {%- set tool = tool.function %}\n        {%- endif %}\n        {{- \"\n<function>\n<name>\" ~ tool.name ~ \"</name>\" }}\n        {%- if tool.description is defined %}\n            {{- '\n<description>' ~ (tool.description | trim) ~ '</description>' }}\n        {%- endif %}\n        {{- '\n<parameters>' }}\n        {%- if tool.parameters is defined and tool.parameters is mapping and tool.parameters.properties is defined and tool.parameters.properties is mapping %}\n            {%- for param_name, param_fields in tool.parameters.properties|items %}\n                {{- '\n<parameter>' }}\n                {{- '\n<name>' ~ param_name ~ '</name>' }}\n                {%- if param_fields.type is defined %}\n                    {{- '\n<type>' ~ (param_fields.type | string) ~ '</type>' }}\n                {%- endif %}\n                {%- if param_fields.description is defined %}\n                    {{- '\n<description>' ~ (param_fields.description | trim) ~ '</description>' }}\n                {%- endif %}\n                {%- if param_fields.enum is defined %}\n                    {{- '\n<enum>' ~ (param_fields.enum | tojson | safe) ~ '</enum>' }}\n                {%- endif %}\n                {%- set handled_keys = ['name', 'type', 'description', 'enum'] %}\n                {{- render_extra_keys(param_fields, handled_keys) }}\n                {{- '\n</parameter>' }}\n            {%- endfor %}\n        {%- endif %}\n        {% set handled_keys = ['type', 'properties', 'required'] %}\n        {{- render_extra_keys(tool.parameters, handled_keys) }}\n        {%- if tool.parameters is defined and tool.parameters.required is defined %}\n            {{- '\n<required>' ~ (tool.parameters.required | tojson | safe) ~ '</required>' }}\n        {%- endif %}\n        {{- '\n</parameters>' }}\n        {%- set handled_keys = ['type', 'name', 'description', 'parameters'] %}\n        {{- render_extra_keys(tool, handled_keys) }}\n        {{- '\n</function>' }}\n    {%- endfor %}\n    {{- \"\n</tools>\" }}\n\n    {{- '\n\nIf you choose to call a function ONLY reply in the following format with NO suffix:\n\n<tool_call>\n<function=example_function_name>\n<parameter=example_parameter_1>\nvalue_1\n</parameter>\n<parameter=example_parameter_2>\nThis is the value for the second parameter\nthat can span\nmultiple lines\n</parameter>\n</function>\n</tool_call>\n\n<IMPORTANT>\nReminder:\n- Function calls MUST follow the specified format: an inner <function=...></function> block must be nested within <tool_call></tool_call> XML tags\n- Required parameters MUST be specified\n- You may provide optional reasoning for your function call in natural language BEFORE the function call, but NOT after\n- If there is no function call available, answer the question like normal with your current knowledge and do not tell the user about function calls\n</IMPORTANT>' }}\n{%- endif %}\n\n\n{%- if system_message is defined %}\n    {{- '<|im_end|>\n' }}\n{%- else %}\n    {%- if tools is iterable and tools | length > 0 %}\n        {{- '<|im_end|>\n' }}\n    {%- endif %}\n{%- endif %}\n\n{%- set image_count = namespace(value=0) %}\n{%- set video_count = namespace(value=0) %}\n{%- for message in loop_messages %}\n    {%- if message.role == \"assistant\" %}\n        {# Add reasoning content in to content field for unified processing below. #}\n        {%- set text_content = namespace(text_content=\"\") -%}\n        {%- if message.content is string %}\n            {%- set text_content.text_content = message.content %}\n        {%- else %}\n            {%- for content in message.content %}\n                {%- if 'text' in content %}\n                    {%- set text_content.text_content = content.text %}\n                    {%- break %}\n                {%- endif %}\n            {%- endfor %}\n        {%- endif %}\n        {%- if message.reasoning_content is defined and message.reasoning_content is string and message.reasoning_content | trim | length > 0 %}\n            {%- set content = \"<think>\n\" ~ message.reasoning_content ~ \"\n</think>\n\" ~ (text_content.text_content | default('', true)) %}\n        {%- else %}\n            {%- set content = text_content.text_content | default('', true) %}\n            {# Allow downstream logic to to take care of broken thought, only handle coherent reasoning here. #}\n            {%- if '<think>' not in content and '</think>' not in content %}\n                {%- set content = \"<think></think>\" ~ content %}\n            {%- else %}\n                {%- set content = content %}\n            {%- endif -%}\n        {%- endif %}\n        {%- if message.tool_calls is defined and message.tool_calls is iterable and message.tool_calls | length > 0 %}\n            {# Assistant message has tool calls. #}\n            {{- '<|im_start|>assistant\n' }}\n                {%- set include_content = not (truncate_history_thinking and loop.index0 < ns.last_user_idx) %}\n                {%- if content is string and content | trim | length > 0 %}\n                    {%- if include_content %}\n                        {{- (content | trim) ~ '\n' -}}\n                    {%- else %}\n                        {%- set c = (content | string) %}\n                        {%- if '</think>' in c %}\n                            {# Keep only content after the last closing think. Also generation prompt causes this. #}\n                            {%- set c = c.split('</think>')[-1] %}\n                        {%- elif '<think>' in c %}\n                            {# If <think> was opened but never closed, drop the trailing think segment #}\n                            {%- set c = c.split('<think>')[0] %}\n                        {%- endif %}\n                        {%- set c = \"<think></think>\" ~ c | trim %}\n                        {%- if c | length > 0 %}\n                            {{- c ~ '\n' -}}\n                        {%- endif %}\n                    {%- endif %}\n                {%- else %}\n                    {{- \"<think></think>\" -}}\n                {%- endif %}\n                {%- for tool_call in message.tool_calls %}\n                    {%- if tool_call.function is defined %}\n                        {%- set tool_call = tool_call.function %}\n                    {%- endif %}\n                    {{- '<tool_call>\n<function=' ~ tool_call.name ~ '>\n' -}}\n                        {%- if tool_call.arguments is defined %}\n                            {%- for args_name, args_value in tool_call.arguments|items %}\n                                {{- '<parameter=' ~ args_name ~ '>\n' -}}\n                                    {%- set args_value = args_value | tojson | safe if args_value is mapping or (args_value is sequence and args_value is not string) else args_value | string %}\n                                {{- args_value ~ '\n</parameter>\n' -}}\n                            {%- endfor %}\n                        {%- endif %}\n                    {{- '</function>\n</tool_call>\n' -}}\n                {%- endfor %}\n                {{- '<|im_end|>\n' }}\n        {%- else %}\n            {# Assistant message doesn't have tool calls. #}\n            {%- if not (truncate_history_thinking and loop.index0 < ns.last_user_idx) %}\n                {{- '<|im_start|>assistant\n' ~ (content | default('', true) | string | trim) ~ '<|im_end|>\n' }}\n            {%- else %}\n                {%- set c = (content | default('', true) | string) %}\n                {%- if '<think>' in c and '</think>' in c %}\n                    {%- set c = \"<think></think>\" ~ c.split('</think>')[-1] %}\n                {%- endif %}\n                {%- set c = c | trim %}\n                {%- if c | length > 0 %}\n                    {{- '<|im_start|>assistant\n' ~ c ~ '<|im_end|>\n' }}\n                {%- else %}\n                    {{- '<|im_start|>assistant\n<|im_end|>\n' }}\n                {%- endif %}\n            {%- endif %}\n        {%- endif %}\n    {%- elif message.role == \"user\" or message.role == \"system\" %}\n        {{- '<|im_start|>' + message.role + '\n' }}\n        {%- if message.content is string %}\n            {{- message.content }}\n        {%- else %}\n            {%- for content in message.content %}\n                {%- if content.type == 'image' or 'image' in content or 'image_url' in content %}\n                    {%- set image_count.value = image_count.value + 1 %}\n                    {%- if add_vision_id %}Picture {{ image_count.value }}: {% endif -%}\n                    <|vision_start|><|image_pad|><|vision_end|>\n                {%- elif content.type == 'video' or 'video' in content %}\n                    {%- set video_count.value = video_count.value + 1 %}\n                    {%- if add_vision_id %}Video {{ video_count.value }}: {% endif -%}\n                    <|vision_start|><|video_pad|><|vision_end|>\n                {%- elif 'text' in content %}\n                    {{- content.text }}\n                {%- endif %}\n            {%- endfor %}\n        {%- endif %}\n        {{- '<|im_end|>\n' }}\n    {%- elif message.role == \"tool\" %}\n        {%- if loop.previtem and loop.previtem.role != \"tool\" %}\n            {{- '<|im_start|>user\n' }}\n        {%- endif %}\n        {{- '<tool_response>\n' }}\n        {{- message.content }}\n        {{- '\n</tool_response>\n' }}\n        {%- if not loop.last and loop.nextitem.role != \"tool\" %}\n            {{- '<|im_end|>\n' }}\n        {%- elif loop.last %}\n            {{- '<|im_end|>\n' }}\n        {%- endif %}\n    {%- else %}\n        {{- '<|im_start|>' + message.role + '\n' + message.content + '<|im_end|>\n' }}\n    {%- endif %}\n{%- endfor %}\n\n{%- if add_generation_prompt %}\n    {%- if enable_thinking %}\n        {{- '<|im_start|>assistant\n<think>\n' }}\n    {%- else %}\n        {{- '<|im_start|>assistant\n<think></think>' }}\n    {%- endif %}\n{%- endif %}"
+  },
+  "cardData": {
+    "license": "other",
+    "license_name": "openmdw1.1-license",
+    "license_link": "https://openmdw.ai/license/1-1/",
+    "library_name": "cosmos",
+    "tags": [
+      "nvidia",
+      "cosmos",
+      "cosmos3"
+    ]
+  },
+  "siblings": [
+    {
+      "rfilename": ".gitattributes",
+      "blobId": "7faf8d7491ce765a8e1068acf3f50785b8d15c4b",
+      "size": 2896
+    },
+    {
+      "rfilename": "BIAS.md",
+      "blobId": "0a30eddc040494e434e27b3e39aaf62ce907b3c6",
+      "size": 4720
+    },
+    {
+      "rfilename": "EXPLAINABILITY.md",
+      "blobId": "f11cb8f3552fbc6fa450de8fed0e34b5e841fce0",
+      "size": 3189
+    },
+    {
+      "rfilename": "PRIVACY.md",
+      "blobId": "7e2709dadccdd7983634f50e426168d09e3d4970",
+      "size": 1215
+    },
+    {
+      "rfilename": "README.md",
+      "blobId": "512cbd148e89b9ed0738781c067e4885e1ad9e9c",
+      "size": 55328
+    },
+    {
+      "rfilename": "SAFETY.md",
+      "blobId": "44e1a5a58e8a5e76b8f0a6a415be45e59ba9f270",
+      "size": 3677
+    },
+    {
+      "rfilename": "assets/benchmark-image2video.png",
+      "blobId": "ecc46661b6413d19a6f1ab3070368e462564e9ce",
+      "size": 58518
+    },
+    {
+      "rfilename": "assets/benchmark-overall.png",
+      "blobId": "99658826c535dd6067f2ac74aa01c33ca70f8db8",
+      "size": 81007,
+      "lfs": {
+        "sha256": "fdc1dbbeda37163b09aab0b69e22c9cae2880eeb53e2287d71eba77e2985a1c1",
+        "size": 81007,
+        "pointerSize": 130
+      }
+    },
+    {
+      "rfilename": "assets/diffusers_outputs/edge_action_fd_diffusers_chunk_00.mp4",
+      "blobId": "b1caf31ac170c43ae498a7b57fae88e6211baf62",
+      "size": 14797
+    },
+    {
+      "rfilename": "assets/diffusers_outputs/edge_action_fd_diffusers_chunk_01.mp4",
+      "blobId": "a2a8f547797b37271774316732ec97e389a0bd41",
+      "size": 13183
+    },
+    {
+      "rfilename": "assets/diffusers_outputs/edge_action_fd_umi_2chunk_diffusers.mp4",
+      "blobId": "8297b1e8cfa7735a53417e23541239eb066f3d68",
+      "size": 23553
+    },
+    {
+      "rfilename": "assets/diffusers_outputs/edge_action_id_av_inverse_0_diffusers.json",
+      "blobId": "b7b0bfe1b9fb327347fb152e5ad16b83cef29bc0",
+      "size": 15925
+    },
+    {
+      "rfilename": "assets/diffusers_outputs/edge_action_id_av_inverse_1_diffusers.json",
+      "blobId": "c29ae8329b23d8053df18dd29841a96232ca78ea",
+      "size": 15676
+    },
+    {
+      "rfilename": "assets/diffusers_outputs/edge_i2v_diffusers.mp4",
+      "blobId": "60c2ee03245ec182427e26742e799e15ef933d20",
+      "size": 1278049,
+      "lfs": {
+        "sha256": "2fe93251039d8640625f660f42514d8fddd0812ae6918a4ea3cf5fc2363e4a16",
+        "size": 1278049,
+        "pointerSize": 132
+      }
+    },
+    {
+      "rfilename": "assets/edge_action_fd_umi_2chunk_output.mp4",
+      "blobId": "1a47d8c0dfa7dafc6f0ed77a2769cf6aa4d1d2ae",
+      "size": 32755,
+      "lfs": {
+        "sha256": "10037bf0c2a20c46f24e616d7b822932babb45f72113833f320e2bb524c8c57b",
+        "size": 32755,
+        "pointerSize": 130
+      }
+    },
+    {
+      "rfilename": "assets/edge_action_id_av_0_output.json",
+      "blobId": "9a9ee99c0efb12e1e63711f8379e6188526dad36",
+      "size": 11216
+    },
+    {
+      "rfilename": "assets/edge_action_id_av_0_output.png",
+      "blobId": "a2b12acb4171e8c9496b22e28efbebae2b5e1c7a",
+      "size": 113804,
+      "lfs": {
+        "sha256": "18b90a143ee04b6be339caa744d5c0debd3d36e90effa20f09c980c0678fec13",
+        "size": 113804,
+        "pointerSize": 131
+      }
+    },
+    {
+      "rfilename": "assets/edge_action_id_av_1_output.json",
+      "blobId": "d55ea66be74eebc9dd213ca494a4b589878172d8",
+      "size": 10990
+    },
+    {
+      "rfilename": "assets/edge_action_id_av_1_output.png",
+      "blobId": "896d8be695cf54e9b1102889748cc740cc0f3beb",
+      "size": 102489,
+      "lfs": {
+        "sha256": "660085cebabd54658a108922a9ae842c57cc7762291bb500035b3f8b01c22992",
+        "size": 102489,
+        "pointerSize": 131
+      }
+    },
+    {
+      "rfilename": "assets/edge_i2v_output.mp4",
+      "blobId": "b105d1930433ab2439566f26468c227677d11b43",
+      "size": 8053812,
+      "lfs": {
+        "sha256": "d4e87cbc2efe25f40ac31d91a11a872f7b51d262ce764cfd0dde53a7be762998",
+        "size": 8053812,
+        "pointerSize": 132
+      }
+    },
+    {
+      "rfilename": "assets/example_action_fd_umi_action_chunks.json",
+      "blobId": "a1d70feafb5369bf48d36fc9e45322defd8d52e7",
+      "size": 10350
+    },
+    {
+      "rfilename": "assets/example_action_fd_umi_first_frame.png",
+      "blobId": "43888061e8a1265c3ec135425d5d4937706e4887",
+      "size": 67026
+    },
+    {
+      "rfilename": "assets/example_action_id_av_0_input.mp4",
+      "blobId": "8219e837ec8c1162149fa178ecd4e911606b94ed",
+      "size": 1125838,
+      "lfs": {
+        "sha256": "ff205f86ae169031c0e12c8c6bc8aabe24aeb44b84a16cba977669b29912f5fc",
+        "size": 1125838,
+        "pointerSize": 132
+      }
+    },
+    {
+      "rfilename": "assets/example_action_id_av_1_input.mp4",
+      "blobId": "2dfd7a3c8fe9a77221c8fb968d2f9f309ffd7271",
+      "size": 1639407,
+      "lfs": {
+        "sha256": "169e65cee76ef7c6366987a8e4c8e4ec6f803f5e624ba2ef39ba1f0c672925aa",
+        "size": 1639407,
+        "pointerSize": 132
+      }
+    },
+    {
+      "rfilename": "assets/example_i2v_input.jpg",
+      "blobId": "bd1bc04ce3d511224c5e64cceff88126946bcf97",
+      "size": 860765,
+      "lfs": {
+        "sha256": "1de51eb5c6d51ec97aa3351a6685717b0253e36073eb9cdd3ef65affa115a4e2",
+        "size": 860765,
+        "pointerSize": 131
+      }
+    },
+    {
+      "rfilename": "assets/example_i2v_prompt.json",
+      "blobId": "15ff9ea5ad233da518fea09808397a3e6ebf0e5f",
+      "size": 9186
+    },
+    {
+      "rfilename": "assets/example_reasoning_input.png",
+      "blobId": "c9d320b9412f6eaa011279f6f83ca41fc1c583c4",
+      "size": 230656,
+      "lfs": {
+        "sha256": "6686b937bdb28e2c9804c435bd63a7ab56ac1531ffc9b482f2b8a75aed8770f5",
+        "size": 230656,
+        "pointerSize": 131
+      }
+    },
+    {
+      "rfilename": "assets/example_reasoning_prompt.json",
+      "blobId": "3371076f17b1ff8bfff60fb24536b160f637809b",
+      "size": 151
+    },
+    {
+      "rfilename": "assets/negative_prompt.json",
+      "blobId": "b51ecb2195e2f16a89959aa3b757c7d66cac6f22",
+      "size": 17578
+    },
+    {
+      "rfilename": "chat_template.jinja",
+      "blobId": "0a3d5967de71577bd2bb20994cee54c39bed63ba",
+      "size": 12158
+    },
+    {
+      "rfilename": "config.json",
+      "blobId": "dafc77c4e2d80aecea930d8d1f357f6bf60c729b",
+      "size": 1679
+    },
+    {
+      "rfilename": "generation_config.json",
+      "blobId": "7494902456e3a7ce7a82c235b365fdb583e88ca7",
+      "size": 154
+    },
+    {
+      "rfilename": "images/benchmark-reasoning.png",
+      "blobId": "b7203515846ec411b02fb6bb50201a0a9e730383",
+      "size": 265797,
+      "lfs": {
+        "sha256": "75974a959d0eb23edb578dfd2b04656748b8f738f9bc19c2dd97f9d60c886fe1",
+        "size": 265797,
+        "pointerSize": 131
+      }
+    },
+    {
+      "rfilename": "model.safetensors.index.json",
+      "blobId": "b8b757925668e0d356b927c9e026f8b26e1ba7d7",
+      "size": 68564
+    },
+    {
+      "rfilename": "model_index.json",
+      "blobId": "70fd5e0775133f2cbf4fc50c61507e4c49b071dc",
+      "size": 555
+    },
+    {
+      "rfilename": "modular_model_index.json",
+      "blobId": "2c40cc4651d1f7afeaad5cb3753a747e850902fc",
+      "size": 1357
+    },
+    {
+      "rfilename": "preprocessor_config.json",
+      "blobId": "2155266cdf07aa75319c1603011bc5442df50910",
+      "size": 334
+    },
+    {
+      "rfilename": "processor_config.json",
+      "blobId": "acd64f939fb21c0200e727a17dec183aed0fcb87",
+      "size": 875
+    },
+    {
+      "rfilename": "scheduler/scheduler_config.json",
+      "blobId": "27259df12f63f649cfc694ed1c2b9d3ee3ede711",
+      "size": 889
+    },
+    {
+      "rfilename": "special_tokens_map.json",
+      "blobId": "0451f37912edb7f8a4bf04d77eef13f6130f0515",
+      "size": 563
+    },
+    {
+      "rfilename": "text_tokenizer/chat_template.jinja",
+      "blobId": "0a3d5967de71577bd2bb20994cee54c39bed63ba",
+      "size": 12158
+    },
+    {
+      "rfilename": "text_tokenizer/special_tokens_map.json",
+      "blobId": "0451f37912edb7f8a4bf04d77eef13f6130f0515",
+      "size": 563
+    },
+    {
+      "rfilename": "text_tokenizer/tokenizer.json",
+      "blobId": "6d41dc89180808d59f68d435ffdbae0e1619df6f",
+      "size": 17077500,
+      "lfs": {
+        "sha256": "4dc692a99dca6d92a44e9529ffb53541eb79bb260eec7281bc51268c05d7311c",
+        "size": 17077500,
+        "pointerSize": 133
+      }
+    },
+    {
+      "rfilename": "text_tokenizer/tokenizer_config.json",
+      "blobId": "9bf527c33c251e8062bf2cd3c8dd6d2fc0591ea9",
+      "size": 393
+    },
+    {
+      "rfilename": "tokenizer.json",
+      "blobId": "6d41dc89180808d59f68d435ffdbae0e1619df6f",
+      "size": 17077500,
+      "lfs": {
+        "sha256": "4dc692a99dca6d92a44e9529ffb53541eb79bb260eec7281bc51268c05d7311c",
+        "size": 17077500,
+        "pointerSize": 133
+      }
+    },
+    {
+      "rfilename": "tokenizer_config.json",
+      "blobId": "b3477e373eeb0753858974549bf9a67409acda03",
+      "size": 177253
+    },
+    {
+      "rfilename": "transformer/config.json",
+      "blobId": "a2d137764c75e641bbe23def0c8516fbe4591b4b",
+      "size": 1075
+    },
+    {
+      "rfilename": "transformer/diffusion_pytorch_model-00001-of-00002.safetensors",
+      "blobId": "0428010516216042739b4a81a33373696eaeaf23",
+      "size": 5000040072,
+      "lfs": {
+        "sha256": "116134e5492c514df79a2f07214e577c397aa961387dbe1c5dda488e7994ff6b",
+        "size": 5000040072,
+        "pointerSize": 135
+      }
+    },
+    {
+      "rfilename": "transformer/diffusion_pytorch_model-00002-of-00002.safetensors",
+      "blobId": "9fdd75623bcbb8ac13b3d4bf77de04d7f646b8c9",
+      "size": 1739335512,
+      "lfs": {
+        "sha256": "3b4c0aafe2705c900ac7bc743085a8e9e09c906624331bc2baa21e172e5d48e4",
+        "size": 1739335512,
+        "pointerSize": 135
+      }
+    },
+    {
+      "rfilename": "transformer/diffusion_pytorch_model.safetensors.index.json",
+      "blobId": "045e07fe2240c4a9cd26364b47eee8376ca3cf32",
+      "size": 53623
+    },
+    {
+      "rfilename": "vae/config.json",
+      "blobId": "12aeec832f9b85f555b1e2267f84defa2fc91e9e",
+      "size": 1755
+    },
+    {
+      "rfilename": "vae/diffusion_pytorch_model.safetensors",
+      "blobId": "0c71384d6c6985e8a26aa317b48a8155d6e36bcd",
+      "size": 1409400600,
+      "lfs": {
+        "sha256": "230496cb59ff85bc9c040487737c4062480cb61c71e697b197b4c30142f2a0da",
+        "size": 1409400600,
+        "pointerSize": 135
+      }
+    },
+    {
+      "rfilename": "video_preprocessor_config.json",
+      "blobId": "cd3f7bca81b97e3609fa6f372cd55d7654bb0791",
+      "size": 367
+    },
+    {
+      "rfilename": "vision_encoder/model.safetensors",
+      "blobId": "2fcc1c37e9977c106cdd52733a0751774bb12821",
+      "size": 978739880,
+      "lfs": {
+        "sha256": "2180ad739ecc96b5c1e9386892d3c5c08bfa42b9cdab9aabc53b028671db89b3",
+        "size": 978739880,
+        "pointerSize": 134
+      }
+    }
+  ],
+  "spaces": [
+    "hugging-apps/nvidia-cosmos3-edge",
+    "JoshDa-OrionAI/Orion",
+    "soow0n/mission3-ai-imagination"
+  ],
+  "createdAt": "2026-07-01T21:54:04.000Z",
+  "safetensors": {
+    "parameters": {
+      "BF16": 3858999728
+    },
+    "total": 3858999728
+  },
+  "usedStorage": 36266045448
+}

checkpoints/balanced288/text_tokenizer/special_tokens_map.json

@@ -0,0 +1,30 @@
+{
+  "bos_token": {
+    "content": "<s>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "eos_token": {
+    "content": "<|im_end|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "<|im_end|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "unk_token": {
+    "content": "<unk>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

checkpoints/balanced288/text_tokenizer/tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4dc692a99dca6d92a44e9529ffb53541eb79bb260eec7281bc51268c05d7311c
+size 17077500

checkpoints/balanced288/text_tokenizer/tokenizer_config.json

@@ -0,0 +1,17 @@
+{
+  "add_prefix_space": false,
+  "backend": "tokenizers",
+  "bos_token": "<s>",
+  "clean_up_tokenization_spaces": false,
+  "eos_token": "<|im_end|>",
+  "is_local": true,
+  "local_files_only": false,
+  "model_input_names": [
+    "input_ids",
+    "attention_mask"
+  ],
+  "model_max_length": 262144,
+  "pad_token": "<|im_end|>",
+  "tokenizer_class": "TokenizersBackend",
+  "unk_token": "<unk>"
+}

checkpoints/balanced288/tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4dc692a99dca6d92a44e9529ffb53541eb79bb260eec7281bc51268c05d7311c
+size 17077500

checkpoints/balanced288/transformer/config.json

@@ -0,0 +1,46 @@
+{
+  "_class_name": "Cosmos3OmniTransformer",
+  "_diffusers_version": "0.40.0.dev0",
+  "action_dim": 64,
+  "action_gen": true,
+  "attention_bias": false,
+  "attention_dropout": 0.0,
+  "backbone_type": "cosmos3_edge_nemotron_dense",
+  "base_fps": 24,
+  "enable_fps_modulation": true,
+  "head_dim": 128,
+  "hidden_act": "relu2",
+  "hidden_size": 2048,
+  "intermediate_size": 9216,
+  "latent_channel": 48,
+  "latent_patch_size": 2,
+  "num_attention_heads": 16,
+  "num_embodiment_domains": 32,
+  "num_hidden_layers": 28,
+  "num_key_value_heads": 8,
+  "patch_latent_dim": 192,
+  "qk_norm_for_text": false,
+  "rms_norm_eps": 1e-05,
+  "rope_axes_dim": [
+    24,
+    20,
+    20
+  ],
+  "rope_scaling": {
+    "mrope_section": [
+      24,
+      20,
+      20
+    ]
+  },
+  "rope_theta": 100000000,
+  "sound_dim": null,
+  "sound_gen": false,
+  "sound_latent_fps": 25,
+  "temporal_compression_factor": 4,
+  "timestep_scale": 0.001,
+  "unified_3d_mrope_reset_spatial_ids": true,
+  "unified_3d_mrope_temporal_modality_margin": 15000,
+  "use_und_k_norm_for_gen": true,
+  "vocab_size": 131072
+}

checkpoints/balanced288/transformer/diffusion_pytorch_model.safetensors.index.json

@@ -0,0 +1,556 @@
+{
+  "metadata": {
+    "total_size": 6739314048
+  },
+  "weight_map": {
+    "action_modality_embed": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "action_proj_in.bias.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "action_proj_in.fc.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "action_proj_out.bias.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "action_proj_out.fc.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "embed_tokens.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.0.input_layernorm.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.0.input_layernorm_moe_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.0.mlp.down_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.0.mlp.up_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.0.mlp_moe_gen.down_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.0.mlp_moe_gen.up_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.0.post_attention_layernorm.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.0.post_attention_layernorm_moe_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.0.self_attn.add_k_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.0.self_attn.add_q_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.0.self_attn.add_v_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.0.self_attn.k_norm_und_for_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.0.self_attn.norm_added_k.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.0.self_attn.norm_added_q.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.0.self_attn.to_add_out.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.0.self_attn.to_k.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.0.self_attn.to_out.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.0.self_attn.to_q.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.0.self_attn.to_v.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.1.input_layernorm.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.1.input_layernorm_moe_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.1.mlp.down_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.1.mlp.up_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.1.mlp_moe_gen.down_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.1.mlp_moe_gen.up_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.1.post_attention_layernorm.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.1.post_attention_layernorm_moe_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.1.self_attn.add_k_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.1.self_attn.add_q_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.1.self_attn.add_v_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.1.self_attn.k_norm_und_for_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.1.self_attn.norm_added_k.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.1.self_attn.norm_added_q.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.1.self_attn.to_add_out.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.1.self_attn.to_k.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.1.self_attn.to_out.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.1.self_attn.to_q.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.1.self_attn.to_v.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.10.input_layernorm.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.10.input_layernorm_moe_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.10.mlp.down_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.10.mlp.up_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.10.mlp_moe_gen.down_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.10.mlp_moe_gen.up_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.10.post_attention_layernorm.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.10.post_attention_layernorm_moe_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.10.self_attn.add_k_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.10.self_attn.add_q_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.10.self_attn.add_v_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.10.self_attn.k_norm_und_for_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.10.self_attn.norm_added_k.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.10.self_attn.norm_added_q.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.10.self_attn.to_add_out.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.10.self_attn.to_k.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.10.self_attn.to_out.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.10.self_attn.to_q.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.10.self_attn.to_v.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.11.input_layernorm.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.11.input_layernorm_moe_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.11.mlp.down_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.11.mlp.up_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.11.mlp_moe_gen.down_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.11.mlp_moe_gen.up_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.11.post_attention_layernorm.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.11.post_attention_layernorm_moe_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.11.self_attn.add_k_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.11.self_attn.add_q_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.11.self_attn.add_v_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.11.self_attn.k_norm_und_for_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.11.self_attn.norm_added_k.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.11.self_attn.norm_added_q.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.11.self_attn.to_add_out.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.11.self_attn.to_k.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.11.self_attn.to_out.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.11.self_attn.to_q.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.11.self_attn.to_v.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.12.input_layernorm.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.12.input_layernorm_moe_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.12.mlp.down_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.12.mlp.up_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.12.mlp_moe_gen.down_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.12.mlp_moe_gen.up_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.12.post_attention_layernorm.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.12.post_attention_layernorm_moe_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.12.self_attn.add_k_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.12.self_attn.add_q_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.12.self_attn.add_v_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.12.self_attn.k_norm_und_for_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.12.self_attn.norm_added_k.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.12.self_attn.norm_added_q.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.12.self_attn.to_add_out.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.12.self_attn.to_k.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.12.self_attn.to_out.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.12.self_attn.to_q.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.12.self_attn.to_v.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.13.input_layernorm.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.13.input_layernorm_moe_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.13.mlp.down_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.13.mlp.up_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.13.mlp_moe_gen.down_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.13.mlp_moe_gen.up_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.13.post_attention_layernorm.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.13.post_attention_layernorm_moe_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.13.self_attn.add_k_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.13.self_attn.add_q_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.13.self_attn.add_v_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.13.self_attn.k_norm_und_for_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.13.self_attn.norm_added_k.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.13.self_attn.norm_added_q.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.13.self_attn.to_add_out.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.13.self_attn.to_k.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.13.self_attn.to_out.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.13.self_attn.to_q.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.13.self_attn.to_v.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.14.input_layernorm.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.14.input_layernorm_moe_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.14.mlp.down_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.14.mlp.up_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.14.mlp_moe_gen.down_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.14.mlp_moe_gen.up_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.14.post_attention_layernorm.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.14.post_attention_layernorm_moe_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.14.self_attn.add_k_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.14.self_attn.add_q_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.14.self_attn.add_v_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.14.self_attn.k_norm_und_for_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.14.self_attn.norm_added_k.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.14.self_attn.norm_added_q.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.14.self_attn.to_add_out.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.14.self_attn.to_k.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.14.self_attn.to_out.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.14.self_attn.to_q.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.14.self_attn.to_v.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.15.input_layernorm.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.15.input_layernorm_moe_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.15.mlp.down_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.15.mlp.up_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.15.mlp_moe_gen.down_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.15.mlp_moe_gen.up_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.15.post_attention_layernorm.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.15.post_attention_layernorm_moe_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.15.self_attn.add_k_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.15.self_attn.add_q_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.15.self_attn.add_v_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.15.self_attn.k_norm_und_for_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.15.self_attn.norm_added_k.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.15.self_attn.norm_added_q.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.15.self_attn.to_add_out.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.15.self_attn.to_k.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.15.self_attn.to_out.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.15.self_attn.to_q.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.15.self_attn.to_v.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.16.input_layernorm.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.16.input_layernorm_moe_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.16.mlp.down_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.16.mlp.up_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.16.mlp_moe_gen.down_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.16.mlp_moe_gen.up_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.16.post_attention_layernorm.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.16.post_attention_layernorm_moe_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.16.self_attn.add_k_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.16.self_attn.add_q_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.16.self_attn.add_v_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.16.self_attn.k_norm_und_for_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.16.self_attn.norm_added_k.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.16.self_attn.norm_added_q.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.16.self_attn.to_add_out.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.16.self_attn.to_k.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.16.self_attn.to_out.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.16.self_attn.to_q.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.16.self_attn.to_v.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.17.input_layernorm.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.17.input_layernorm_moe_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.17.mlp.down_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.17.mlp.up_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.17.mlp_moe_gen.down_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.17.mlp_moe_gen.up_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.17.post_attention_layernorm.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.17.post_attention_layernorm_moe_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.17.self_attn.add_k_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.17.self_attn.add_q_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.17.self_attn.add_v_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.17.self_attn.k_norm_und_for_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.17.self_attn.norm_added_k.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.17.self_attn.norm_added_q.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.17.self_attn.to_add_out.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.17.self_attn.to_k.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.17.self_attn.to_out.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.17.self_attn.to_q.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.17.self_attn.to_v.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.18.input_layernorm.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.18.input_layernorm_moe_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.18.mlp.down_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.18.mlp.up_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.18.mlp_moe_gen.down_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.18.mlp_moe_gen.up_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.18.post_attention_layernorm.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.18.post_attention_layernorm_moe_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.18.self_attn.add_k_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.18.self_attn.add_q_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.18.self_attn.add_v_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.18.self_attn.k_norm_und_for_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.18.self_attn.norm_added_k.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.18.self_attn.norm_added_q.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.18.self_attn.to_add_out.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.18.self_attn.to_k.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.18.self_attn.to_out.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.18.self_attn.to_q.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.18.self_attn.to_v.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.19.input_layernorm.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.19.input_layernorm_moe_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.19.mlp.down_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.19.mlp.up_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.19.mlp_moe_gen.down_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.19.mlp_moe_gen.up_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.19.post_attention_layernorm.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.19.post_attention_layernorm_moe_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.19.self_attn.add_k_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.19.self_attn.add_q_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.19.self_attn.add_v_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.19.self_attn.k_norm_und_for_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.19.self_attn.norm_added_k.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.19.self_attn.norm_added_q.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.19.self_attn.to_add_out.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.19.self_attn.to_k.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.19.self_attn.to_out.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.19.self_attn.to_q.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.19.self_attn.to_v.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.2.input_layernorm.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.2.input_layernorm_moe_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.2.mlp.down_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.2.mlp.up_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.2.mlp_moe_gen.down_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.2.mlp_moe_gen.up_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.2.post_attention_layernorm.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.2.post_attention_layernorm_moe_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.2.self_attn.add_k_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.2.self_attn.add_q_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.2.self_attn.add_v_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.2.self_attn.k_norm_und_for_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.2.self_attn.norm_added_k.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.2.self_attn.norm_added_q.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.2.self_attn.to_add_out.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.2.self_attn.to_k.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.2.self_attn.to_out.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.2.self_attn.to_q.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.2.self_attn.to_v.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.20.input_layernorm.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.20.input_layernorm_moe_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.20.mlp.down_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.20.mlp.up_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.20.mlp_moe_gen.down_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.20.mlp_moe_gen.up_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.20.post_attention_layernorm.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.20.post_attention_layernorm_moe_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.20.self_attn.add_k_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.20.self_attn.add_q_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.20.self_attn.add_v_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.20.self_attn.k_norm_und_for_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.20.self_attn.norm_added_k.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.20.self_attn.norm_added_q.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.20.self_attn.to_add_out.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.20.self_attn.to_k.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.20.self_attn.to_out.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.20.self_attn.to_q.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.20.self_attn.to_v.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.21.input_layernorm.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.21.input_layernorm_moe_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.21.mlp.down_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.21.mlp.up_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.21.mlp_moe_gen.down_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.21.mlp_moe_gen.up_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.21.post_attention_layernorm.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.21.post_attention_layernorm_moe_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.21.self_attn.add_k_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.21.self_attn.add_q_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.21.self_attn.add_v_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.21.self_attn.k_norm_und_for_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.21.self_attn.norm_added_k.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.21.self_attn.norm_added_q.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.21.self_attn.to_add_out.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.21.self_attn.to_k.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.21.self_attn.to_out.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.21.self_attn.to_q.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.21.self_attn.to_v.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.22.input_layernorm.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.22.input_layernorm_moe_gen.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.22.mlp.down_proj.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.22.mlp.up_proj.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.22.mlp_moe_gen.down_proj.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.22.mlp_moe_gen.up_proj.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.22.post_attention_layernorm.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.22.post_attention_layernorm_moe_gen.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.22.self_attn.add_k_proj.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.22.self_attn.add_q_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.22.self_attn.add_v_proj.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.22.self_attn.k_norm_und_for_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.22.self_attn.norm_added_k.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.22.self_attn.norm_added_q.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.22.self_attn.to_add_out.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.22.self_attn.to_k.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.22.self_attn.to_out.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.22.self_attn.to_q.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.22.self_attn.to_v.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.23.input_layernorm.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.23.input_layernorm_moe_gen.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.23.mlp.down_proj.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.23.mlp.up_proj.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.23.mlp_moe_gen.down_proj.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.23.mlp_moe_gen.up_proj.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.23.post_attention_layernorm.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.23.post_attention_layernorm_moe_gen.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.23.self_attn.add_k_proj.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.23.self_attn.add_q_proj.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.23.self_attn.add_v_proj.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.23.self_attn.k_norm_und_for_gen.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.23.self_attn.norm_added_k.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.23.self_attn.norm_added_q.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.23.self_attn.to_add_out.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.23.self_attn.to_k.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.23.self_attn.to_out.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.23.self_attn.to_q.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.23.self_attn.to_v.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.24.input_layernorm.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.24.input_layernorm_moe_gen.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.24.mlp.down_proj.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.24.mlp.up_proj.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.24.mlp_moe_gen.down_proj.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.24.mlp_moe_gen.up_proj.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.24.post_attention_layernorm.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.24.post_attention_layernorm_moe_gen.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.24.self_attn.add_k_proj.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.24.self_attn.add_q_proj.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.24.self_attn.add_v_proj.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.24.self_attn.k_norm_und_for_gen.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.24.self_attn.norm_added_k.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.24.self_attn.norm_added_q.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.24.self_attn.to_add_out.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.24.self_attn.to_k.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.24.self_attn.to_out.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.24.self_attn.to_q.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.24.self_attn.to_v.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.25.input_layernorm.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.25.input_layernorm_moe_gen.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.25.mlp.down_proj.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.25.mlp.up_proj.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.25.mlp_moe_gen.down_proj.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.25.mlp_moe_gen.up_proj.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.25.post_attention_layernorm.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.25.post_attention_layernorm_moe_gen.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.25.self_attn.add_k_proj.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.25.self_attn.add_q_proj.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.25.self_attn.add_v_proj.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.25.self_attn.k_norm_und_for_gen.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.25.self_attn.norm_added_k.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.25.self_attn.norm_added_q.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.25.self_attn.to_add_out.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.25.self_attn.to_k.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.25.self_attn.to_out.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.25.self_attn.to_q.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.25.self_attn.to_v.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.26.input_layernorm.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.26.input_layernorm_moe_gen.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.26.mlp.down_proj.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.26.mlp.up_proj.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.26.mlp_moe_gen.down_proj.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.26.mlp_moe_gen.up_proj.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.26.post_attention_layernorm.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.26.post_attention_layernorm_moe_gen.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.26.self_attn.add_k_proj.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.26.self_attn.add_q_proj.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.26.self_attn.add_v_proj.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.26.self_attn.k_norm_und_for_gen.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.26.self_attn.norm_added_k.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.26.self_attn.norm_added_q.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.26.self_attn.to_add_out.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.26.self_attn.to_k.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.26.self_attn.to_out.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.26.self_attn.to_q.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.26.self_attn.to_v.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.27.input_layernorm.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.27.input_layernorm_moe_gen.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.27.mlp.down_proj.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.27.mlp.up_proj.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.27.mlp_moe_gen.down_proj.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.27.mlp_moe_gen.up_proj.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.27.post_attention_layernorm.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.27.post_attention_layernorm_moe_gen.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.27.self_attn.add_k_proj.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.27.self_attn.add_q_proj.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.27.self_attn.add_v_proj.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.27.self_attn.k_norm_und_for_gen.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.27.self_attn.norm_added_k.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.27.self_attn.norm_added_q.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.27.self_attn.to_add_out.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.27.self_attn.to_k.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.27.self_attn.to_out.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.27.self_attn.to_q.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.27.self_attn.to_v.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "layers.3.input_layernorm.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.3.input_layernorm_moe_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.3.mlp.down_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.3.mlp.up_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.3.mlp_moe_gen.down_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.3.mlp_moe_gen.up_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.3.post_attention_layernorm.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.3.post_attention_layernorm_moe_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.3.self_attn.add_k_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.3.self_attn.add_q_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.3.self_attn.add_v_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.3.self_attn.k_norm_und_for_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.3.self_attn.norm_added_k.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.3.self_attn.norm_added_q.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.3.self_attn.to_add_out.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.3.self_attn.to_k.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.3.self_attn.to_out.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.3.self_attn.to_q.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.3.self_attn.to_v.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.4.input_layernorm.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.4.input_layernorm_moe_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.4.mlp.down_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.4.mlp.up_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.4.mlp_moe_gen.down_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.4.mlp_moe_gen.up_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.4.post_attention_layernorm.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.4.post_attention_layernorm_moe_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.4.self_attn.add_k_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.4.self_attn.add_q_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.4.self_attn.add_v_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.4.self_attn.k_norm_und_for_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.4.self_attn.norm_added_k.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.4.self_attn.norm_added_q.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.4.self_attn.to_add_out.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.4.self_attn.to_k.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.4.self_attn.to_out.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.4.self_attn.to_q.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.4.self_attn.to_v.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.5.input_layernorm.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.5.input_layernorm_moe_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.5.mlp.down_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.5.mlp.up_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.5.mlp_moe_gen.down_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.5.mlp_moe_gen.up_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.5.post_attention_layernorm.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.5.post_attention_layernorm_moe_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.5.self_attn.add_k_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.5.self_attn.add_q_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.5.self_attn.add_v_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.5.self_attn.k_norm_und_for_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.5.self_attn.norm_added_k.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.5.self_attn.norm_added_q.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.5.self_attn.to_add_out.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.5.self_attn.to_k.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.5.self_attn.to_out.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.5.self_attn.to_q.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.5.self_attn.to_v.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.6.input_layernorm.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.6.input_layernorm_moe_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.6.mlp.down_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.6.mlp.up_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.6.mlp_moe_gen.down_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.6.mlp_moe_gen.up_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.6.post_attention_layernorm.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.6.post_attention_layernorm_moe_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.6.self_attn.add_k_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.6.self_attn.add_q_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.6.self_attn.add_v_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.6.self_attn.k_norm_und_for_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.6.self_attn.norm_added_k.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.6.self_attn.norm_added_q.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.6.self_attn.to_add_out.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.6.self_attn.to_k.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.6.self_attn.to_out.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.6.self_attn.to_q.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.6.self_attn.to_v.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.7.input_layernorm.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.7.input_layernorm_moe_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.7.mlp.down_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.7.mlp.up_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.7.mlp_moe_gen.down_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.7.mlp_moe_gen.up_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.7.post_attention_layernorm.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.7.post_attention_layernorm_moe_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.7.self_attn.add_k_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.7.self_attn.add_q_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.7.self_attn.add_v_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.7.self_attn.k_norm_und_for_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.7.self_attn.norm_added_k.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.7.self_attn.norm_added_q.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.7.self_attn.to_add_out.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.7.self_attn.to_k.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.7.self_attn.to_out.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.7.self_attn.to_q.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.7.self_attn.to_v.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.8.input_layernorm.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.8.input_layernorm_moe_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.8.mlp.down_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.8.mlp.up_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.8.mlp_moe_gen.down_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.8.mlp_moe_gen.up_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.8.post_attention_layernorm.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.8.post_attention_layernorm_moe_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.8.self_attn.add_k_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.8.self_attn.add_q_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.8.self_attn.add_v_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.8.self_attn.k_norm_und_for_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.8.self_attn.norm_added_k.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.8.self_attn.norm_added_q.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.8.self_attn.to_add_out.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.8.self_attn.to_k.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.8.self_attn.to_out.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.8.self_attn.to_q.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.8.self_attn.to_v.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.9.input_layernorm.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.9.input_layernorm_moe_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.9.mlp.down_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.9.mlp.up_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.9.mlp_moe_gen.down_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.9.mlp_moe_gen.up_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.9.post_attention_layernorm.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.9.post_attention_layernorm_moe_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.9.self_attn.add_k_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.9.self_attn.add_q_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.9.self_attn.add_v_proj.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.9.self_attn.k_norm_und_for_gen.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.9.self_attn.norm_added_k.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.9.self_attn.norm_added_q.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.9.self_attn.to_add_out.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.9.self_attn.to_k.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.9.self_attn.to_out.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.9.self_attn.to_q.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "layers.9.self_attn.to_v.weight": "diffusion_pytorch_model-00001-of-00002.safetensors",
+    "lm_head.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "norm.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "norm_moe_gen.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "proj_in.bias": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "proj_in.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "proj_out.bias": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "proj_out.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "time_embedder.linear_1.bias": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "time_embedder.linear_1.weight": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "time_embedder.linear_2.bias": "diffusion_pytorch_model-00002-of-00002.safetensors",
+    "time_embedder.linear_2.weight": "diffusion_pytorch_model-00002-of-00002.safetensors"
+  }
+}

checkpoints/balanced288/vae/config.json

@@ -0,0 +1,129 @@
+{
+  "_class_name": "AutoencoderKLWan",
+  "_diffusers_version": "0.40.0.dev0",
+  "_name_or_path": "Wan-AI/Wan2.2-TI2V-5B-Diffusers",
+  "attn_scales": [],
+  "base_dim": 160,
+  "clip_output": false,
+  "decoder_base_dim": 256,
+  "dim_mult": [
+    1,
+    2,
+    4,
+    4
+  ],
+  "dropout": 0.0,
+  "in_channels": 12,
+  "is_residual": true,
+  "latents_mean": [
+    -0.2289,
+    -0.0052,
+    -0.1323,
+    -0.2339,
+    -0.2799,
+    0.0174,
+    0.1838,
+    0.1557,
+    -0.1382,
+    0.0542,
+    0.2813,
+    0.0891,
+    0.157,
+    -0.0098,
+    0.0375,
+    -0.1825,
+    -0.2246,
+    -0.1207,
+    -0.0698,
+    0.5109,
+    0.2665,
+    -0.2108,
+    -0.2158,
+    0.2502,
+    -0.2055,
+    -0.0322,
+    0.1109,
+    0.1567,
+    -0.0729,
+    0.0899,
+    -0.2799,
+    -0.123,
+    -0.0313,
+    -0.1649,
+    0.0117,
+    0.0723,
+    -0.2839,
+    -0.2083,
+    -0.052,
+    0.3748,
+    0.0152,
+    0.1957,
+    0.1433,
+    -0.2944,
+    0.3573,
+    -0.0548,
+    -0.1681,
+    -0.0667
+  ],
+  "latents_std": [
+    0.4765,
+    1.0364,
+    0.4514,
+    1.1677,
+    0.5313,
+    0.499,
+    0.4818,
+    0.5013,
+    0.8158,
+    1.0344,
+    0.5894,
+    1.0901,
+    0.6885,
+    0.6165,
+    0.8454,
+    0.4978,
+    0.5759,
+    0.3523,
+    0.7135,
+    0.6804,
+    0.5833,
+    1.4146,
+    0.8986,
+    0.5659,
+    0.7069,
+    0.5338,
+    0.4889,
+    0.4917,
+    0.4069,
+    0.4999,
+    0.6866,
+    0.4093,
+    0.5709,
+    0.6065,
+    0.6415,
+    0.4944,
+    0.5726,
+    1.2042,
+    0.5458,
+    1.6887,
+    0.3971,
+    1.06,
+    0.3943,
+    0.5537,
+    0.5444,
+    0.4089,
+    0.7468,
+    0.7744
+  ],
+  "num_res_blocks": 2,
+  "out_channels": 12,
+  "patch_size": 2,
+  "scale_factor_spatial": 16,
+  "scale_factor_temporal": 4,
+  "temperal_downsample": [
+    false,
+    true,
+    true
+  ],
+  "z_dim": 48
+}

checkpoints/balanced288/video_preprocessor_config.json

@@ -0,0 +1,22 @@
+{
+  "image_mean": [
+    0.5,
+    0.5,
+    0.5
+  ],
+  "image_std": [
+    0.5,
+    0.5,
+    0.5
+  ],
+  "merge_size": 2,
+  "patch_size": 16,
+  "processor_class": "Cosmos3EdgeProcessor",
+  "return_metadata": true,
+  "size": {
+    "longest_edge": 25165824,
+    "shortest_edge": 4096
+  },
+  "temporal_patch_size": 1,
+  "video_processor_type": "Cosmos3EdgeVideoProcessor"
+}

checkpoints/mixed240/00000.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5d3e5bc8cb224a478158c5d75e527aa92041098c94fa03be076bc3f3db3bd6b6
+size 4258943864

checkpoints/mixed240/00001.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:389771323cd6d9cba8f3e1ee7c6ee3d18418f32b21e246f8e64377423ce05a68
+size 612372944

checkpoints/mixed240/assets/diffusers_outputs/edge_action_id_av_inverse_0_diffusers.json

@@ -0,0 +1,672 @@
+{
+  "data": [
+    [
+      -0.013148754835128784,
+      -0.007273353636264801,
+      0.008258908987045288,
+      0.9254555702209473,
+      -0.018639683723449707,
+      0.004321083426475525,
+      -0.00694487988948822,
+      0.9603041410446167,
+      0.007375245913863182
+    ],
+    [
+      0.0006928369402885437,
+      0.00114353746175766,
+      0.04833635687828064,
+      0.9550113677978516,
+      0.007736995816230774,
+      -0.0007977494969964027,
+      -0.001905590295791626,
+      0.9611708521842957,
+      -0.0071649253368377686
+    ],
+    [
+      0.00024224817752838135,
+      -0.00632748007774353,
+      0.01743471622467041,
+      0.9503518342971802,
+      0.006431609392166138,
+      -0.0021766857244074345,
+      0.004798382520675659,
+      0.9540749192237854,
+      -0.002829238772392273
+    ],
+    [
+      -0.003921394236385822,
+      0.008617669343948364,
+      -0.012175090610980988,
+      0.9608586430549622,
+      -0.008618205785751343,
+      -0.008708074688911438,
+      -0.013742625713348389,
+      0.9400895833969116,
+      0.006977975368499756
+    ],
+    [
+      0.005376532673835754,
+      0.003240346908569336,
+      0.018488049507141113,
+      0.9523720145225525,
+      0.01081898808479309,
+      -0.00035040080547332764,
+      0.00804641842842102,
+      0.9556390643119812,
+      0.012530684471130371
+    ],
+    [
+      0.005463764071464539,
+      0.0012700557708740234,
+      -0.012111283838748932,
+      0.9668004512786865,
+      0.009593963623046875,
+      0.0014052540063858032,
+      0.00772630050778389,
+      0.935010552406311,
+      0.011620238423347473
+    ],
+    [
+      -0.003778284415602684,
+      0.012686282396316528,
+      0.012819170951843262,
+      0.9748083353042603,
+      -0.015680819749832153,
+      -0.0014512911438941956,
+      -0.004034742712974548,
+      0.9654931426048279,
+      0.0029178932309150696
+    ],
+    [
+      0.009581685066223145,
+      -0.0018721558153629303,
+      0.015696480870246887,
+      0.9498556852340698,
+      -0.007028155028820038,
+      -0.003986746072769165,
+      -0.0010101348161697388,
+      0.9363378286361694,
+      0.0034978240728378296
+    ],
+    [
+      0.011020243167877197,
+      0.015359997749328613,
+      0.0042057037353515625,
+      0.9537041783332825,
+      -0.008601069450378418,
+      -0.0073888301849365234,
+      0.0013249143958091736,
+      0.94188392162323,
+      0.0001823045313358307
+    ],
+    [
+      0.008615091443061829,
+      0.005651026964187622,
+      -0.009945794939994812,
+      0.9452113509178162,
+      0.019210517406463623,
+      0.004503607749938965,
+      0.015948235988616943,
+      0.9488579630851746,
+      0.008347108960151672
+    ],
+    [
+      0.001062244176864624,
+      -0.01891157031059265,
+      -0.0280563086271286,
+      0.9730226993560791,
+      0.011333107948303223,
+      -0.000612400472164154,
+      -0.004964202642440796,
+      0.9605361819267273,
+      0.00998196005821228
+    ],
+    [
+      0.0016751736402511597,
+      -0.024208784103393555,
+      -0.024219349026679993,
+      0.9559570550918579,
+      -0.009602159261703491,
+      -0.004984036087989807,
+      0.0061578452587127686,
+      0.950946033000946,
+      0.008079171180725098
+    ],
+    [
+      -0.011940449476242065,
+      -0.0034200847148895264,
+      0.0017094612121582031,
+      0.9588748812675476,
+      0.006712079048156738,
+      -0.004783693701028824,
+      -0.00014981627464294434,
+      0.9792852997779846,
+      -0.00029080547392368317
+    ],
+    [
+      0.0016713226214051247,
+      -0.0047683920711278915,
+      0.0011281678453087807,
+      0.9475633502006531,
+      0.007233217358589172,
+      -9.954720735549927e-05,
+      -0.0002157837152481079,
+      0.9581102132797241,
+      -0.001299828290939331
+    ],
+    [
+      0.006934747099876404,
+      0.008136779069900513,
+      -0.039625704288482666,
+      0.9607610106468201,
+      0.010957300662994385,
+      0.0001928955316543579,
+      0.004511512815952301,
+      0.9533595442771912,
+      0.011611387133598328
+    ],
+    [
+      0.007694117724895477,
+      -0.01480981707572937,
+      0.01341133564710617,
+      0.9478503465652466,
+      0.0021869465708732605,
+      -0.0011091921478509903,
+      0.003402979113161564,
+      0.9389904737472534,
+      -0.0016643255949020386
+    ],
+    [
+      -0.006875067949295044,
+      0.0049460530281066895,
+      0.0421476811170578,
+      0.9672802090644836,
+      -0.01006162166595459,
+      0.0008940547704696655,
+      0.007537230849266052,
+      0.9556049704551697,
+      0.0027959682047367096
+    ],
+    [
+      -0.0024900436401367188,
+      -0.005135815590620041,
+      0.05198696255683899,
+      0.9647979140281677,
+      0.01649463176727295,
+      0.003368660807609558,
+      -0.019760966300964355,
+      0.9663780331611633,
+      -0.004725992679595947
+    ],
+    [
+      -0.0026149116456508636,
+      -0.007602095603942871,
+      0.03872739523649216,
+      0.9427680969238281,
+      -0.0020749270915985107,
+      -0.004558362066745758,
+      -0.011337906122207642,
+      0.9802517890930176,
+      0.0020113736391067505
+    ],
+    [
+      -0.0024757981300354004,
+      -0.007645174860954285,
+      0.07559360563755035,
+      0.9630593061447144,
+      -0.0025666803121566772,
+      -0.00292031466960907,
+      -0.012108653783798218,
+      0.9655929803848267,
+      0.0013676062226295471
+    ],
+    [
+      0.0007936935871839523,
+      0.0024557560682296753,
+      0.036987900733947754,
+      0.9483445882797241,
+      0.006975963711738586,
+      0.0030634403228759766,
+      -0.0004689544439315796,
+      0.9642810225486755,
+      -0.001054992899298668
+    ],
+    [
+      -0.003186628222465515,
+      0.00013031065464019775,
+      0.06438089907169342,
+      0.967340350151062,
+      -0.008410289883613586,
+      -0.007106497883796692,
+      0.010625198483467102,
+      0.9285515546798706,
+      -0.0012674331665039062
+    ],
+    [
+      -0.02860349416732788,
+      -8.131563663482666e-05,
+      0.08170737326145172,
+      0.9743189811706543,
+      0.004199020564556122,
+      0.006051763892173767,
+      0.004216104745864868,
+      0.9849252700805664,
+      -0.01118806004524231
+    ],
+    [
+      0.00029268115758895874,
+      -0.0008304938673973083,
+      0.08716102689504623,
+      0.9572217464447021,
+      0.00250987708568573,
+      -0.0032331272959709167,
+      -0.004110082983970642,
+      0.9600695371627808,
+      -0.0021736174821853638
+    ],
+    [
+      0.016955643892288208,
+      0.0030432939529418945,
+      0.04992994666099548,
+      0.9569373726844788,
+      -0.011746704578399658,
+      -0.0003188829869031906,
+      -0.007667466998100281,
+      0.9866983890533447,
+      0.004928670823574066
+    ],
+    [
+      -0.0039969682693481445,
+      0.00038054585456848145,
+      0.12631714344024658,
+      0.9718866348266602,
+      0.018440932035446167,
+      -0.005601778626441956,
+      -0.009917289018630981,
+      0.9650411605834961,
+      0.005232140421867371
+    ],
+    [
+      -0.0012138709425926208,
+      -0.011934876441955566,
+      0.11297653615474701,
+      0.9682045578956604,
+      0.0012573739513754845,
+      0.0006018783897161484,
+      0.009243190288543701,
+      0.9470562934875488,
+      0.012865453958511353
+    ],
+    [
+      -0.009654894471168518,
+      0.004492349922657013,
+      0.14582459628582,
+      0.941580057144165,
+      -0.027970850467681885,
+      -0.01605433225631714,
+      -0.003179602324962616,
+      0.9500089883804321,
+      -0.005389504134654999
+    ],
+    [
+      0.014612823724746704,
+      -0.004633047617971897,
+      0.14664553105831146,
+      0.9637702703475952,
+      -0.0011444943957030773,
+      -0.0005822107195854187,
+      0.005188122391700745,
+      0.9636419415473938,
+      -0.007603704929351807
+    ],
+    [
+      -0.014512777328491211,
+      -0.00830838829278946,
+      0.14723633229732513,
+      0.9575201272964478,
+      0.009052962064743042,
+      0.002744898200035095,
+      0.00654207170009613,
+      0.9790866374969482,
+      -0.006706550717353821
+    ],
+    [
+      -0.01381877064704895,
+      0.013246327638626099,
+      0.1438756138086319,
+      0.9541648626327515,
+      0.0031017810106277466,
+      -0.010317087173461914,
+      0.004141256213188171,
+      0.9406745433807373,
+      -0.0032720565795898438
+    ],
+    [
+      0.0049401819705963135,
+      0.016335099935531616,
+      0.1370936781167984,
+      0.9569792747497559,
+      0.009543389081954956,
+      -0.0038724213372915983,
+      -0.011453330516815186,
+      0.9742096066474915,
+      -0.013819366693496704
+    ],
+    [
+      0.016965091228485107,
+      -0.014787629246711731,
+      0.18282562494277954,
+      0.952957034111023,
+      0.00769689679145813,
+      -0.006391674280166626,
+      0.00217418372631073,
+      0.9660205841064453,
+      0.006829023361206055
+    ],
+    [
+      0.00011231936514377594,
+      0.022837340831756592,
+      0.21823179721832275,
+      0.9779958128929138,
+      0.0016702637076377869,
+      -0.01641136407852173,
+      0.008365646004676819,
+      0.9648821949958801,
+      -0.015010237693786621
+    ],
+    [
+      -0.003881126642227173,
+      0.008091509342193604,
+      0.16629643738269806,
+      0.9440470933914185,
+      0.017186373472213745,
+      -0.0032056421041488647,
+      0.015325725078582764,
+      0.9715288877487183,
+      0.005628049373626709
+    ],
+    [
+      0.015618979930877686,
+      -0.016067102551460266,
+      0.1358950436115265,
+      0.9455870985984802,
+      0.015390992164611816,
+      0.0032478421926498413,
+      0.007700107991695404,
+      0.949781060218811,
+      0.00139538012444973
+    ],
+    [
+      0.003707513213157654,
+      0.0012879809364676476,
+      0.18519513309001923,
+      0.9606454968452454,
+      -0.016481131315231323,
+      -0.0009821802377700806,
+      -0.0053266435861587524,
+      0.9794431924819946,
+      0.002626672387123108
+    ],
+    [
+      0.016481012105941772,
+      -0.017973721027374268,
+      0.14953568577766418,
+      0.9501946568489075,
+      0.013054758310317993,
+      -0.0001233518123626709,
+      0.002798639237880707,
+      0.963482141494751,
+      0.0029630735516548157
+    ],
+    [
+      0.027081698179244995,
+      -0.008018411695957184,
+      0.19762511551380157,
+      0.9853548407554626,
+      0.007277920842170715,
+      0.0018384754657745361,
+      -0.0006946176290512085,
+      0.9530956149101257,
+      -0.00409291684627533
+    ],
+    [
+      0.009928137063980103,
+      -0.01654413342475891,
+      0.18209686875343323,
+      0.9711376428604126,
+      0.01371067762374878,
+      -0.01334737241268158,
+      -0.011193245649337769,
+      0.9716130495071411,
+      0.005922876298427582
+    ],
+    [
+      0.012314438819885254,
+      -0.0027115456759929657,
+      0.18243494629859924,
+      0.9741570949554443,
+      0.008049450814723969,
+      -0.004693128168582916,
+      -0.003039032220840454,
+      0.9581626057624817,
+      0.012616187334060669
+    ],
+    [
+      0.0076538920402526855,
+      -0.003307037055492401,
+      0.20810538530349731,
+      0.948331892490387,
+      -0.015447914600372314,
+      -0.01176406443119049,
+      -0.0022220220416784286,
+      0.9713965058326721,
+      -0.0014124363660812378
+    ],
+    [
+      0.022586889564990997,
+      -0.008036494255065918,
+      0.21718934178352356,
+      0.9554579257965088,
+      0.028451621532440186,
+      -0.008404174819588661,
+      -0.0012748166918754578,
+      0.9658167362213135,
+      -0.0026244521141052246
+    ],
+    [
+      0.015891581773757935,
+      0.0012519285082817078,
+      0.2355501353740692,
+      0.9612299799919128,
+      -0.005295991897583008,
+      0.00039255619049072266,
+      -0.00497812032699585,
+      0.9328453540802002,
+      -0.002513475716114044
+    ],
+    [
+      0.024546697735786438,
+      0.004739120602607727,
+      0.24198676645755768,
+      0.9556739926338196,
+      0.001108948141336441,
+      -0.010602131485939026,
+      -0.0015903003513813019,
+      0.9675569534301758,
+      0.004108220338821411
+    ],
+    [
+      0.02232934534549713,
+      0.018866419792175293,
+      0.24329781532287598,
+      0.9607975482940674,
+      -0.008478760719299316,
+      -0.00401577353477478,
+      0.005954533815383911,
+      0.961711585521698,
+      -0.008179426193237305
+    ],
+    [
+      0.014459583908319473,
+      0.013193011283874512,
+      0.2807546854019165,
+      0.9628647565841675,
+      0.02138429880142212,
+      -0.009663410484790802,
+      0.012736231088638306,
+      0.9604622721672058,
+      0.004635050892829895
+    ],
+    [
+      0.03173169493675232,
+      -0.008499197661876678,
+      0.2548338770866394,
+      0.9557382464408875,
+      0.0049033742398023605,
+      0.006540834903717041,
+      0.013527542352676392,
+      0.9523492455482483,
+      0.0032977014780044556
+    ],
+    [
+      0.03362193703651428,
+      0.005373731255531311,
+      0.28878676891326904,
+      0.9541832804679871,
+      0.00421798974275589,
+      -0.022053956985473633,
+      -0.007141679525375366,
+      0.9740029573440552,
+      0.002051055431365967
+    ],
+    [
+      0.0156448632478714,
+      0.007966414093971252,
+      0.26515382528305054,
+      0.9523801803588867,
+      0.0037920400500297546,
+      -0.011845819652080536,
+      -0.005416005849838257,
+      0.9764019846916199,
+      0.0025727003812789917
+    ],
+    [
+      0.025211334228515625,
+      -0.0038858801126480103,
+      0.3200596272945404,
+      0.9874192476272583,
+      0.01006472110748291,
+      -0.005867555737495422,
+      0.0030220672488212585,
+      0.950593113899231,
+      -0.002622779458761215
+    ],
+    [
+      0.016667742282152176,
+      0.016612201929092407,
+      0.3063710629940033,
+      0.9813263416290283,
+      0.010637477040290833,
+      -0.0004864633083343506,
+      0.009502381086349487,
+      0.9399935007095337,
+      -0.0036408603191375732
+    ],
+    [
+      0.03205466270446777,
+      -0.005740225315093994,
+      0.3219253718852997,
+      0.9442741870880127,
+      -0.0003297049552202225,
+      -0.007991593331098557,
+      -0.012274682521820068,
+      0.9457107782363892,
+      0.001197025179862976
+    ],
+    [
+      0.019879944622516632,
+      -0.00796326994895935,
+      0.34765785932540894,
+      0.9492185711860657,
+      0.008849918842315674,
+      -0.003306932747364044,
+      0.005508631467819214,
+      0.9591333866119385,
+      0.008243441581726074
+    ],
+    [
+      0.015053778886795044,
+      -0.00721488893032074,
+      0.3408358097076416,
+      0.9282618761062622,
+      0.002898307517170906,
+      -0.00362338125705719,
+      0.027731001377105713,
+      0.9604060053825378,
+      -0.00824989378452301
+    ],
+    [
+      0.015081822872161865,
+      -0.006049111485481262,
+      0.35627633333206177,
+      0.9522294998168945,
+      0.014767050743103027,
+      -0.013559997081756592,
+      -0.0005444735288619995,
+      0.9336357116699219,
+      -0.008866548538208008
+    ],
+    [
+      0.012881480157375336,
+      -0.008715510368347168,
+      0.35815778374671936,
+      0.9767504334449768,
+      0.011995196342468262,
+      -0.0015369206666946411,
+      -0.00036385655403137207,
+      0.9670126438140869,
+      0.006960272789001465
+    ],
+    [
+      0.022443406283855438,
+      -0.002777688205242157,
+      0.3705684542655945,
+      0.9601130485534668,
+      -0.010128200054168701,
+      -0.00759703665971756,
+      0.0009619146585464478,
+      0.968835711479187,
+      -0.006335556507110596
+    ],
+    [
+      0.0191623717546463,
+      -0.003963552415370941,
+      0.3500891327857971,
+      0.9584890007972717,
+      -0.0029276683926582336,
+      -0.015166878700256348,
+      -0.002148374915122986,
+      0.9575344920158386,
+      0.010722845792770386
+    ],
+    [
+      0.006769150495529175,
+      -0.0050390660762786865,
+      0.4090595245361328,
+      0.9641549587249756,
+      -0.002060607075691223,
+      -0.015374422073364258,
+      0.005776405334472656,
+      0.9640921354293823,
+      0.0018393322825431824
+    ]
+  ],
+  "shape": [
+    60,
+    9
+  ],
+  "dtype": "torch.float32",
+  "raw_action_dim": 9,
+  "action_mode": "inverse_dynamics",
+  "domain_id": 1
+}

checkpoints/mixed240/assets/diffusers_outputs/edge_action_id_av_inverse_1_diffusers.json

@@ -0,0 +1,672 @@
+{
+  "data": [
+    [
+      0.059141844511032104,
+      -0.003840334713459015,
+      1.0373594760894775,
+      0.9279366731643677,
+      -0.01645451784133911,
+      -0.020578712224960327,
+      -0.010958120226860046,
+      0.9640744924545288,
+      0.0024261921644210815
+    ],
+    [
+      0.07163303345441818,
+      0.002209894359111786,
+      1.0704994201660156,
+      0.9624326229095459,
+      0.011429950594902039,
+      -0.02556397207081318,
+      -0.005203992128372192,
+      0.968371570110321,
+      -0.005390077829360962
+    ],
+    [
+      0.06948350369930267,
+      -0.014859065413475037,
+      1.0249040126800537,
+      0.9573811292648315,
+      0.007525742053985596,
+      -0.027830475941300392,
+      0.006637901067733765,
+      0.9581300616264343,
+      0.00023680925369262695
+    ],
+    [
+      0.07753375917673111,
+      0.004523158073425293,
+      0.9877839684486389,
+      0.9649670124053955,
+      -0.006604701280593872,
+      -0.037096068263053894,
+      -0.021954774856567383,
+      0.9435235261917114,
+      0.013597071170806885
+    ],
+    [
+      0.09455021470785141,
+      -0.0016047954559326172,
+      1.0100252628326416,
+      0.9584341645240784,
+      0.014761030673980713,
+      -0.029446259140968323,
+      0.00870533287525177,
+      0.968270480632782,
+      0.0247458815574646
+    ],
+    [
+      0.10178711265325546,
+      -0.0029810070991516113,
+      0.9616026878356934,
+      0.9771547913551331,
+      0.01504051685333252,
+      -0.031167365610599518,
+      0.0053897276520729065,
+      0.9344217777252197,
+      0.012324824929237366
+    ],
+    [
+      0.10360411554574966,
+      0.01793801784515381,
+      0.9839838743209839,
+      0.986229658126831,
+      -0.011833727359771729,
+      -0.038624923676252365,
+      -0.007526323199272156,
+      0.9758810997009277,
+      0.005369395017623901
+    ],
+    [
+      0.12239452451467514,
+      0.010958259925246239,
+      0.9665457010269165,
+      0.9559676647186279,
+      -0.0019251927733421326,
+      -0.039464741945266724,
+      -0.005040377378463745,
+      0.9393422603607178,
+      0.00036060065031051636
+    ],
+    [
+      0.13781818747520447,
+      0.04306331276893616,
+      0.9548782110214233,
+      0.9634062051773071,
+      -0.0013715922832489014,
+      -0.045522540807724,
+      -0.0034839287400245667,
+      0.9445981979370117,
+      -0.0009270161390304565
+    ],
+    [
+      0.13575460016727448,
+      0.026487261056900024,
+      0.9226974844932556,
+      0.9517682790756226,
+      0.024003714323043823,
+      -0.03737533092498779,
+      0.013349950313568115,
+      0.9547375440597534,
+      0.00824420154094696
+    ],
+    [
+      0.12451967597007751,
+      -0.0071739256381988525,
+      0.9000017642974854,
+      0.9793621301651001,
+      0.011195510625839233,
+      -0.04407672584056854,
+      -0.00877419114112854,
+      0.9616803526878357,
+      0.011973768472671509
+    ],
+    [
+      0.12706036865711212,
+      -0.014932453632354736,
+      0.9002858400344849,
+      0.9622393250465393,
+      -0.00951644778251648,
+      -0.04734916239976883,
+      0.003892853856086731,
+      0.9567041397094727,
+      0.013047799468040466
+    ],
+    [
+      0.11344760656356812,
+      0.01170305535197258,
+      0.9190186858177185,
+      0.9637442231178284,
+      0.011624082922935486,
+      -0.04697572439908981,
+      -0.0024839788675308228,
+      0.9862824082374573,
+      0.0046536242589354515
+    ],
+    [
+      0.1317308247089386,
+      0.01151534914970398,
+      0.9060279726982117,
+      0.950132429599762,
+      0.013150960206985474,
+      -0.042732544243335724,
+      -0.006613433361053467,
+      0.9610092043876648,
+      0.0009927898645401
+    ],
+    [
+      0.13878925144672394,
+      0.027730464935302734,
+      0.8691807985305786,
+      0.9631220698356628,
+      0.016683101654052734,
+      -0.038141220808029175,
+      -0.002742782235145569,
+      0.9560869932174683,
+      0.009326145052909851
+    ],
+    [
+      0.13446137309074402,
+      0.0007270127534866333,
+      0.9065344333648682,
+      0.9507459402084351,
+      0.007336311042308807,
+      -0.04232313856482506,
+      -0.001765731256455183,
+      0.9377214908599854,
+      -0.004297852516174316
+    ],
+    [
+      0.11476296186447144,
+      0.02131199836730957,
+      0.9385601878166199,
+      0.9792501926422119,
+      -0.0066051185131073,
+      -0.04161176085472107,
+      0.0019875168800354004,
+      0.9670274257659912,
+      0.005515553057193756
+    ],
+    [
+      0.12210288643836975,
+      0.014036169275641441,
+      0.9407962560653687,
+      0.9701698422431946,
+      0.020105689764022827,
+      -0.040228381752967834,
+      -0.020383119583129883,
+      0.9672138094902039,
+      0.0005619972944259644
+    ],
+    [
+      0.12542369961738586,
+      0.012022823095321655,
+      0.9342747926712036,
+      0.9483041763305664,
+      0.0013997424393892288,
+      -0.046562936156988144,
+      -0.02045336365699768,
+      0.9865255355834961,
+      0.00695318728685379
+    ],
+    [
+      0.11753255128860474,
+      0.016480877995491028,
+      0.977397084236145,
+      0.9714816212654114,
+      0.0014084279537200928,
+      -0.04178629815578461,
+      -0.01719522476196289,
+      0.9729042649269104,
+      0.004064872860908508
+    ],
+    [
+      0.12327518314123154,
+      0.026617400348186493,
+      0.9441711902618408,
+      0.9547913670539856,
+      0.009748861193656921,
+      -0.03178030252456665,
+      -0.005975648760795593,
+      0.9724594950675964,
+      0.0015931297093629837
+    ],
+    [
+      0.11693878471851349,
+      0.021891258656978607,
+      0.9779582023620605,
+      0.9773543477058411,
+      -0.0021515488624572754,
+      -0.043881744146347046,
+      0.005668759346008301,
+      0.9312025308609009,
+      -0.0018804669380187988
+    ],
+    [
+      0.09713619947433472,
+      0.022913970053195953,
+      0.9865879416465759,
+      0.984277606010437,
+      0.008582152426242828,
+      -0.035678133368492126,
+      -0.003005385398864746,
+      0.9906625747680664,
+      -0.010433465242385864
+    ],
+    [
+      0.11487491428852081,
+      0.02062314748764038,
+      1.004561185836792,
+      0.9658318161964417,
+      0.00811738520860672,
+      -0.0393141433596611,
+      -0.008064255118370056,
+      0.9643077850341797,
+      -0.00047591328620910645
+    ],
+    [
+      0.12689977884292603,
+      0.02446255087852478,
+      0.9813741445541382,
+      0.9599205255508423,
+      -0.007350906729698181,
+      -0.03434314206242561,
+      -0.0102815181016922,
+      0.99027019739151,
+      0.002850934863090515
+    ],
+    [
+      0.10348488390445709,
+      0.01788690686225891,
+      1.0414836406707764,
+      0.9772853851318359,
+      0.019330114126205444,
+      -0.041947878897190094,
+      -0.013509660959243774,
+      0.9699065089225769,
+      0.005952954292297363
+    ],
+    [
+      0.10493399202823639,
+      0.010198116302490234,
+      1.0407824516296387,
+      0.9719204902648926,
+      0.0058035897091031075,
+      -0.03458989039063454,
+      0.003740936517715454,
+      0.9522305130958557,
+      0.012766420841217041
+    ],
+    [
+      0.09770180284976959,
+      0.024997010827064514,
+      1.0794150829315186,
+      0.9405001401901245,
+      -0.02436143159866333,
+      -0.04618346691131592,
+      -0.008885281160473824,
+      0.9424073696136475,
+      -0.0033924728631973267
+    ],
+    [
+      0.11438962817192078,
+      0.01623646914958954,
+      1.0927131175994873,
+      0.9766831398010254,
+      0.0005866186693310738,
+      -0.030141858384013176,
+      0.0021623969078063965,
+      0.9683176875114441,
+      -0.0047433823347091675
+    ],
+    [
+      0.07521477341651917,
+      0.008214041590690613,
+      1.098933219909668,
+      0.9660043120384216,
+      0.007547542452812195,
+      -0.025479033589363098,
+      0.004106804728507996,
+      0.9826686978340149,
+      -0.001127287745475769
+    ],
+    [
+      0.07278415560722351,
+      0.0321023166179657,
+      1.1175589561462402,
+      0.9674540758132935,
+      0.005659177899360657,
+      -0.038438498973846436,
+      -0.0007940381765365601,
+      0.9435781240463257,
+      -0.0032588541507720947
+    ],
+    [
+      0.08530683070421219,
+      0.02760574221611023,
+      1.123960018157959,
+      0.9651504158973694,
+      0.010333657264709473,
+      -0.02847376838326454,
+      -0.014152109622955322,
+      0.9765793681144714,
+      -0.007708162069320679
+    ],
+    [
+      0.08623477816581726,
+      -2.8833746910095215e-05,
+      1.1860765218734741,
+      0.9632298350334167,
+      0.009518980979919434,
+      -0.028353288769721985,
+      0.0003351382911205292,
+      0.9702121019363403,
+      0.011311382055282593
+    ],
+    [
+      0.06764379888772964,
+      0.028459995985031128,
+      1.228102207183838,
+      0.9854918718338013,
+      0.004853567108511925,
+      -0.030850589275360107,
+      0.005490615963935852,
+      0.9692810773849487,
+      -0.004521816968917847
+    ],
+    [
+      0.05355161428451538,
+      0.020747363567352295,
+      1.2010810375213623,
+      0.951269805431366,
+      0.016863375902175903,
+      -0.017977416515350342,
+      0.01373264193534851,
+      0.9801374077796936,
+      0.014254122972488403
+    ],
+    [
+      0.07317647337913513,
+      0.0030185580253601074,
+      1.18898344039917,
+      0.9577667713165283,
+      0.01679345965385437,
+      -0.010508865118026733,
+      0.006877075880765915,
+      0.9590687155723572,
+      0.005443556234240532
+    ],
+    [
+      0.04951860010623932,
+      0.01835135743021965,
+      1.2524373531341553,
+      0.9677692651748657,
+      -0.012610375881195068,
+      -0.01456555724143982,
+      -0.005562201142311096,
+      0.9804211854934692,
+      0.005360782146453857
+    ],
+    [
+      0.057762667536735535,
+      -0.0012004673480987549,
+      1.2260611057281494,
+      0.9578285217285156,
+      0.0164794921875,
+      -0.00892224907875061,
+      -0.002040460705757141,
+      0.9750438332557678,
+      0.010551542043685913
+    ],
+    [
+      0.0635719895362854,
+      0.009304247796535492,
+      1.2985970973968506,
+      0.997957170009613,
+      0.005984649062156677,
+      -0.006568968296051025,
+      -0.005957365036010742,
+      0.9624383449554443,
+      0.0034569650888442993
+    ],
+    [
+      0.030685484409332275,
+      -0.0031789839267730713,
+      1.2745897769927979,
+      0.9833477735519409,
+      0.015771299600601196,
+      -0.02075822651386261,
+      -0.018386155366897583,
+      0.9756336212158203,
+      0.011255372315645218
+    ],
+    [
+      0.023339152336120605,
+      0.010662931948900223,
+      1.300084114074707,
+      0.989835262298584,
+      0.006620235741138458,
+      -0.0073957666754722595,
+      -0.006816834211349487,
+      0.9638521075248718,
+      0.01855221390724182
+    ],
+    [
+      0.012639999389648438,
+      0.007987678050994873,
+      1.3306738138198853,
+      0.9491333961486816,
+      -0.020535647869110107,
+      -0.01028469204902649,
+      -0.002563953399658203,
+      0.9858134388923645,
+      0.0020048022270202637
+    ],
+    [
+      0.02348978817462921,
+      -0.0019411742687225342,
+      1.3654818534851074,
+      0.969693124294281,
+      0.027309060096740723,
+      -0.004834961146116257,
+      -0.0036605969071388245,
+      0.9743373990058899,
+      0.003153502941131592
+    ],
+    [
+      0.013904020190238953,
+      0.013629376888275146,
+      1.394413948059082,
+      0.972601592540741,
+      -0.00408954918384552,
+      0.004027083516120911,
+      -0.008378058671951294,
+      0.9446616172790527,
+      0.0034879446029663086
+    ],
+    [
+      0.02238820493221283,
+      0.01910078525543213,
+      1.4235327243804932,
+      0.968029797077179,
+      0.004553822800517082,
+      -0.0062204450368881226,
+      -0.003272419795393944,
+      0.977702260017395,
+      0.00832560658454895
+    ],
+    [
+      0.02112443745136261,
+      0.04720121622085571,
+      1.4362165927886963,
+      0.9765746593475342,
+      -0.013532817363739014,
+      0.001711629331111908,
+      0.007163316011428833,
+      0.9686256647109985,
+      -0.010016411542892456
+    ],
+    [
+      0.007742851972579956,
+      0.03149166703224182,
+      1.4930720329284668,
+      0.9732664823532104,
+      0.01966017484664917,
+      -0.0022897571325302124,
+      0.011702001094818115,
+      0.96928870677948,
+      0.006121553480625153
+    ],
+    [
+      0.022700637578964233,
+      0.010335221886634827,
+      1.4739594459533691,
+      0.9702088832855225,
+      0.0024269153364002705,
+      0.01349705457687378,
+      0.013742953538894653,
+      0.9670001864433289,
+      0.006703421473503113
+    ],
+    [
+      0.02724406123161316,
+      0.02931670844554901,
+      1.5207319259643555,
+      0.9660757184028625,
+      0.004963122308254242,
+      -0.017152994871139526,
+      -0.009395450353622437,
+      0.9865334630012512,
+      0.009139366447925568
+    ],
+    [
+      0.008380383253097534,
+      0.024726346135139465,
+      1.4987715482711792,
+      0.9654471278190613,
+      0.0028583072125911713,
+      -0.005337700247764587,
+      -0.0050354450941085815,
+      0.9871041774749756,
+      0.006967529654502869
+    ],
+    [
+      0.01739254593849182,
+      0.012995205819606781,
+      1.5692707300186157,
+      1.0089263916015625,
+      0.013926923274993896,
+      0.0009343177080154419,
+      0.004500538110733032,
+      0.9502257108688354,
+      0.006055116653442383
+    ],
+    [
+      0.009858133271336555,
+      0.03461769223213196,
+      1.5677274465560913,
+      0.9968569278717041,
+      0.011664733290672302,
+      0.004488259553909302,
+      0.00662684440612793,
+      0.9470456838607788,
+      0.0005231946706771851
+    ],
+    [
+      0.02299785614013672,
+      0.009481832385063171,
+      1.5700998306274414,
+      0.9577478766441345,
+      0.00069449283182621,
+      -0.0011343881487846375,
+      -0.016278564929962158,
+      0.958492636680603,
+      0.006463430821895599
+    ],
+    [
+      0.005318776238709688,
+      0.008516699075698853,
+      1.615574836730957,
+      0.9617098569869995,
+      0.007522448897361755,
+      0.0025394558906555176,
+      0.005760625004768372,
+      0.9720036387443542,
+      0.015061944723129272
+    ],
+    [
+      0.007067561149597168,
+      0.0065644532442092896,
+      1.6096922159194946,
+      0.9413715600967407,
+      -0.0019346103072166443,
+      0.002095624804496765,
+      0.02600991725921631,
+      0.974121630191803,
+      -0.006266683340072632
+    ],
+    [
+      0.007169589400291443,
+      0.009554922580718994,
+      1.6439979076385498,
+      0.964790403842926,
+      0.014039307832717896,
+      -0.006732136011123657,
+      0.00041218847036361694,
+      0.9473226070404053,
+      -0.01044127345085144
+    ],
+    [
+      0.007147058844566345,
+      0.00785742700099945,
+      1.644051194190979,
+      0.985714852809906,
+      0.0075702965259552,
+      0.0006187558174133301,
+      -0.000648103654384613,
+      0.9734295010566711,
+      0.009049922227859497
+    ],
+    [
+      0.015374734997749329,
+      0.014419212937355042,
+      1.6574026346206665,
+      0.9712061285972595,
+      -0.01914668083190918,
+      -0.0018936395645141602,
+      -0.0007403641939163208,
+      0.9860180616378784,
+      -0.006495922803878784
+    ],
+    [
+      0.013697490096092224,
+      0.013768978416919708,
+      1.642235517501831,
+      0.9747515916824341,
+      -0.002270542085170746,
+      -0.011506795883178711,
+      -0.006279811263084412,
+      0.9668055772781372,
+      0.013116374611854553
+    ],
+    [
+      -0.0011235475540161133,
+      0.013980269432067871,
+      1.7224175930023193,
+      0.9761761426925659,
+      -0.0001882612705230713,
+      -0.008678078651428223,
+      0.002798914909362793,
+      0.9733132719993591,
+      0.00561833381652832
+    ]
+  ],
+  "shape": [
+    60,
+    9
+  ],
+  "dtype": "torch.float32",
+  "raw_action_dim": 9,
+  "action_mode": "inverse_dynamics",
+  "domain_id": 1
+}

checkpoints/mixed240/assets/edge_action_id_av_0_output.json

@@ -0,0 +1,672 @@
+{
+  "data": [
+    [
+      0.0107421875,
+      -0.00048828125,
+      0.0859375,
+      0.95703125,
+      0.0025634765625,
+      0.00390625,
+      0.0087890625,
+      0.9609375,
+      0.00390625
+    ],
+    [
+      -0.004638671875,
+      0.005859375,
+      -0.0146484375,
+      0.96875,
+      0.01171875,
+      -0.0009765625,
+      -0.0029296875,
+      0.9609375,
+      0.0068359375
+    ],
+    [
+      0.0078125,
+      0.0009765625,
+      0.0048828125,
+      0.921875,
+      0.015625,
+      -0.013671875,
+      0.0234375,
+      0.9765625,
+      -0.00341796875
+    ],
+    [
+      -0.003173828125,
+      0.005859375,
+      0.0078125,
+      0.9609375,
+      -0.0029296875,
+      -0.000244140625,
+      0.009765625,
+      0.9609375,
+      0.0029296875
+    ],
+    [
+      -0.005615234375,
+      -0.01953125,
+      -0.00927734375,
+      0.9609375,
+      0.005859375,
+      -0.009765625,
+      -0.0087890625,
+      0.9609375,
+      -0.001953125
+    ],
+    [
+      -0.013671875,
+      -0.01953125,
+      -0.012939453125,
+      0.9453125,
+      -0.001953125,
+      0.001953125,
+      -0.0029296875,
+      0.92578125,
+      -0.001953125
+    ],
+    [
+      0.00341796875,
+      -0.0086669921875,
+      0.0078125,
+      0.9609375,
+      0.00244140625,
+      0.0048828125,
+      0.009765625,
+      0.9453125,
+      0.00146484375
+    ],
+    [
+      -0.015625,
+      0.00390625,
+      -0.02734375,
+      0.94140625,
+      -0.0048828125,
+      -0.0029296875,
+      -0.0078125,
+      0.96484375,
+      0.0028076171875
+    ],
+    [
+      0.013671875,
+      0.0009765625,
+      -0.0390625,
+      0.9453125,
+      0.0078125,
+      0.005859375,
+      -0.01953125,
+      0.921875,
+      -0.009765625
+    ],
+    [
+      0.005859375,
+      0.005859375,
+      -0.006591796875,
+      0.9765625,
+      -0.0029296875,
+      -0.00244140625,
+      -0.0009765625,
+      0.96875,
+      0.015625
+    ],
+    [
+      -0.013671875,
+      -0.013671875,
+      -0.0078125,
+      0.96875,
+      -0.0009765625,
+      0.002197265625,
+      -0.015625,
+      0.95703125,
+      -0.01171875
+    ],
+    [
+      0.001708984375,
+      0.01953125,
+      -0.0078125,
+      0.9453125,
+      -0.0087890625,
+      0.005859375,
+      0.0126953125,
+      0.9375,
+      0.013671875
+    ],
+    [
+      0.005859375,
+      -0.0009765625,
+      -0.0111083984375,
+      0.94921875,
+      -0.013671875,
+      -0.001708984375,
+      0.009765625,
+      0.953125,
+      0.002197265625
+    ],
+    [
+      -0.0009765625,
+      -0.021484375,
+      0.021484375,
+      0.96484375,
+      -0.0087890625,
+      -0.0078125,
+      0.00341796875,
+      0.953125,
+      -0.005859375
+    ],
+    [
+      0.02734375,
+      -0.01953125,
+      0.0068359375,
+      0.95703125,
+      0.009765625,
+      0.00244140625,
+      -0.0078125,
+      0.953125,
+      0.013671875
+    ],
+    [
+      0.017578125,
+      -0.00927734375,
+      0.046875,
+      0.95703125,
+      0.0087890625,
+      0.001953125,
+      -0.009765625,
+      0.9453125,
+      0.01171875
+    ],
+    [
+      0.01171875,
+      0.0087890625,
+      0.01611328125,
+      0.9453125,
+      -0.004638671875,
+      -0.0087890625,
+      0.00537109375,
+      0.953125,
+      -0.01171875
+    ],
+    [
+      0.001220703125,
+      0.00390625,
+      0.0458984375,
+      0.9609375,
+      0.0078125,
+      0.0029296875,
+      0.0087890625,
+      0.94921875,
+      0.0048828125
+    ],
+    [
+      -0.005859375,
+      0.001953125,
+      0.02392578125,
+      0.98046875,
+      0.01953125,
+      0.005859375,
+      0.00634765625,
+      0.95703125,
+      0.005859375
+    ],
+    [
+      -0.0068359375,
+      -0.003662109375,
+      0.0634765625,
+      0.9296875,
+      -0.0068359375,
+      0.0001220703125,
+      0.015625,
+      0.94921875,
+      0.000244140625
+    ],
+    [
+      0.0068359375,
+      0.005859375,
+      0.06591796875,
+      0.9296875,
+      -0.01171875,
+      0.0029296875,
+      0.013671875,
+      0.953125,
+      -0.00390625
+    ],
+    [
+      0.01171875,
+      -0.02734375,
+      0.07421875,
+      0.9609375,
+      0.0078125,
+      0.0078125,
+      0.013671875,
+      0.9765625,
+      0.00390625
+    ],
+    [
+      -0.0018310546875,
+      0.013671875,
+      0.0888671875,
+      0.95703125,
+      -0.015625,
+      0.001953125,
+      0.009765625,
+      0.96875,
+      0.0078125
+    ],
+    [
+      0.015625,
+      -0.025390625,
+      0.08251953125,
+      0.94921875,
+      0.0068359375,
+      -0.013671875,
+      -0.002197265625,
+      0.96875,
+      0.001953125
+    ],
+    [
+      0.017578125,
+      0.00146484375,
+      0.09619140625,
+      0.94140625,
+      0.0029296875,
+      0.01171875,
+      0.0067138671875,
+      0.9296875,
+      0.0029296875
+    ],
+    [
+      -0.0001220703125,
+      -0.025390625,
+      0.111328125,
+      0.96875,
+      0.00390625,
+      -0.001220703125,
+      0.0006103515625,
+      0.94140625,
+      0.00048828125
+    ],
+    [
+      0.00146484375,
+      0.0078125,
+      0.08935546875,
+      0.94921875,
+      -0.00238037109375,
+      -0.0087890625,
+      -0.005859375,
+      0.95703125,
+      0.0029296875
+    ],
+    [
+      -0.00390625,
+      0.0078125,
+      0.10302734375,
+      0.9609375,
+      0.005859375,
+      0.0078125,
+      0.0068359375,
+      0.9453125,
+      -0.0009765625
+    ],
+    [
+      -0.0087890625,
+      0.0029296875,
+      0.10986328125,
+      0.9765625,
+      0.00048828125,
+      -0.0078125,
+      0.017578125,
+      0.95703125,
+      -0.0087890625
+    ],
+    [
+      -0.00665283203125,
+      0.0078125,
+      0.1064453125,
+      0.953125,
+      0.00244140625,
+      -0.015625,
+      0.000244140625,
+      0.96875,
+      0.00146484375
+    ],
+    [
+      -0.00146484375,
+      -0.00384521484375,
+      0.15625,
+      0.9609375,
+      -0.01171875,
+      0.01171875,
+      0.013671875,
+      0.95703125,
+      -0.0029296875
+    ],
+    [
+      0.0048828125,
+      0.013671875,
+      0.1318359375,
+      0.94921875,
+      0.00439453125,
+      -0.005859375,
+      0.003662109375,
+      0.96875,
+      -0.00244140625
+    ],
+    [
+      -0.01171875,
+      0.01171875,
+      0.138671875,
+      0.953125,
+      -0.0078125,
+      0.0009765625,
+      0.009765625,
+      0.953125,
+      0.0078125
+    ],
+    [
+      -0.00390625,
+      -0.006103515625,
+      0.138671875,
+      0.97265625,
+      0.002197265625,
+      0.0009765625,
+      0.0048828125,
+      0.9453125,
+      0.00341796875
+    ],
+    [
+      0.0009765625,
+      -0.0028076171875,
+      0.17578125,
+      0.953125,
+      0.00048828125,
+      0.0,
+      0.005859375,
+      0.96875,
+      0.0009765625
+    ],
+    [
+      0.0078125,
+      -0.00439453125,
+      0.150390625,
+      0.953125,
+      -0.0068359375,
+      0.0,
+      -0.0078125,
+      0.95703125,
+      0.0029296875
+    ],
+    [
+      -0.0009765625,
+      0.0048828125,
+      0.15234375,
+      0.9453125,
+      -0.0068359375,
+      -0.005859375,
+      0.00390625,
+      0.92578125,
+      0.0078125
+    ],
+    [
+      0.00341796875,
+      0.001953125,
+      0.14453125,
+      0.96484375,
+      0.0009765625,
+      -0.017578125,
+      -0.001953125,
+      0.96875,
+      0.00146484375
+    ],
+    [
+      0.009765625,
+      0.0,
+      0.197265625,
+      0.9609375,
+      0.00341796875,
+      -0.00390625,
+      0.005859375,
+      0.96484375,
+      0.00390625
+    ],
+    [
+      0.0087890625,
+      -0.0015869140625,
+      0.1826171875,
+      0.97265625,
+      0.0054931640625,
+      -0.00390625,
+      0.00048828125,
+      0.9765625,
+      0.009765625
+    ],
+    [
+      0.00390625,
+      0.0001220703125,
+      0.19921875,
+      0.9609375,
+      0.015625,
+      -0.0126953125,
+      -0.0078125,
+      0.984375,
+      0.015625
+    ],
+    [
+      0.0205078125,
+      0.005859375,
+      0.21875,
+      0.9609375,
+      0.01953125,
+      -0.01025390625,
+      -0.0029296875,
+      0.96875,
+      0.00390625
+    ],
+    [
+      0.029296875,
+      -0.00927734375,
+      0.22265625,
+      0.9609375,
+      0.00341796875,
+      -0.001953125,
+      0.00390625,
+      0.96484375,
+      -0.00390625
+    ],
+    [
+      0.021484375,
+      -0.004638671875,
+      0.1875,
+      0.9765625,
+      0.004638671875,
+      -0.0126953125,
+      -0.003173828125,
+      0.97265625,
+      0.001708984375
+    ],
+    [
+      0.01239013671875,
+      0.0068359375,
+      0.236328125,
+      0.96875,
+      -0.009765625,
+      -0.013671875,
+      0.01953125,
+      0.953125,
+      0.0068359375
+    ],
+    [
+      0.025390625,
+      -0.017578125,
+      0.244140625,
+      0.95703125,
+      -0.01953125,
+      -0.0087890625,
+      0.01171875,
+      0.95703125,
+      0.01953125
+    ],
+    [
+      0.0194091796875,
+      0.0078125,
+      0.251953125,
+      0.953125,
+      -0.00048828125,
+      0.001953125,
+      0.00152587890625,
+      0.95703125,
+      -0.0078125
+    ],
+    [
+      0.0166015625,
+      -0.0068359375,
+      0.2265625,
+      0.9453125,
+      0.000732421875,
+      -0.01953125,
+      0.00390625,
+      0.9453125,
+      -0.00341796875
+    ],
+    [
+      0.016845703125,
+      0.00341796875,
+      0.26171875,
+      0.9453125,
+      -0.001953125,
+      -0.005859375,
+      0.00390625,
+      0.9375,
+      0.00390625
+    ],
+    [
+      0.014892578125,
+      0.0087890625,
+      0.298828125,
+      0.953125,
+      0.005859375,
+      -0.009033203125,
+      0.0009765625,
+      0.953125,
+      -0.0029296875
+    ],
+    [
+      0.0224609375,
+      -0.0234375,
+      0.30078125,
+      0.9609375,
+      0.005859375,
+      -0.0048828125,
+      -0.0003662109375,
+      0.9609375,
+      0.009765625
+    ],
+    [
+      0.017822265625,
+      0.005859375,
+      0.322265625,
+      0.9609375,
+      -0.0029296875,
+      -0.00634765625,
+      -0.001220703125,
+      0.96875,
+      0.0029296875
+    ],
+    [
+      0.02392578125,
+      -0.00390625,
+      0.30078125,
+      0.9375,
+      0.0006103515625,
+      0.00390625,
+      -0.005859375,
+      0.93359375,
+      0.003662109375
+    ],
+    [
+      0.0185546875,
+      -0.0020751953125,
+      0.333984375,
+      0.94921875,
+      0.001220703125,
+      -0.015625,
+      -0.00048828125,
+      0.96875,
+      0.0048828125
+    ],
+    [
+      0.0185546875,
+      0.01171875,
+      0.326171875,
+      0.9453125,
+      0.0023193359375,
+      -0.008056640625,
+      0.00146484375,
+      0.95703125,
+      -0.0068359375
+    ],
+    [
+      0.0162353515625,
+      0.015625,
+      0.35546875,
+      0.953125,
+      0.009765625,
+      -0.0068359375,
+      0.01171875,
+      0.96875,
+      0.0
+    ],
+    [
+      0.02099609375,
+      0.000244140625,
+      0.375,
+      0.95703125,
+      -0.0009765625,
+      -0.0029296875,
+      -0.0009765625,
+      0.96484375,
+      0.00390625
+    ],
+    [
+      0.0145263671875,
+      -0.015625,
+      0.369140625,
+      0.96484375,
+      0.00164794921875,
+      -0.01171875,
+      -0.00537109375,
+      0.953125,
+      -0.0009765625
+    ],
+    [
+      0.021484375,
+      0.00390625,
+      0.37109375,
+      0.953125,
+      0.00048828125,
+      -0.013671875,
+      0.0048828125,
+      0.95703125,
+      0.001953125
+    ],
+    [
+      0.018798828125,
+      -0.0078125,
+      0.41015625,
+      0.95703125,
+      -0.01171875,
+      -0.00390625,
+      -0.0068359375,
+      0.9609375,
+      0.005859375
+    ]
+  ],
+  "shape": [
+    60,
+    9
+  ],
+  "dtype": "torch.bfloat16",
+  "raw_action_dim": 9,
+  "action_mode": "inverse_dynamics",
+  "domain_id": 1
+}

checkpoints/mixed240/assets/edge_action_id_av_1_output.json

@@ -0,0 +1,672 @@
+{
+  "data": [
+    [
+      0.076171875,
+      0.0,
+      1.0859375,
+      0.96875,
+      0.004150390625,
+      -0.017578125,
+      0.005859375,
+      0.9765625,
+      0.0078125
+    ],
+    [
+      0.0654296875,
+      0.00390625,
+      0.9921875,
+      0.9765625,
+      0.0107421875,
+      -0.02490234375,
+      -0.0048828125,
+      0.96875,
+      0.0107421875
+    ],
+    [
+      0.087890625,
+      -0.0068359375,
+      1.0,
+      0.9375,
+      0.013671875,
+      -0.037109375,
+      0.01953125,
+      0.984375,
+      0.00146484375
+    ],
+    [
+      0.08203125,
+      -0.001953125,
+      0.984375,
+      0.97265625,
+      -0.0029296875,
+      -0.027099609375,
+      0.009765625,
+      0.97265625,
+      0.0126953125
+    ],
+    [
+      0.0849609375,
+      -0.0322265625,
+      0.95703125,
+      0.97265625,
+      0.009765625,
+      -0.04296875,
+      -0.0126953125,
+      0.96875,
+      0.00537109375
+    ],
+    [
+      0.080078125,
+      -0.021484375,
+      0.9375,
+      0.953125,
+      0.000732421875,
+      -0.03271484375,
+      -0.0068359375,
+      0.93359375,
+      -0.0009765625
+    ],
+    [
+      0.1015625,
+      -0.0042724609375,
+      0.9453125,
+      0.97265625,
+      0.00244140625,
+      -0.03173828125,
+      0.0078125,
+      0.953125,
+      0.00244140625
+    ],
+    [
+      0.09375,
+      0.0224609375,
+      0.91015625,
+      0.9453125,
+      -0.001953125,
+      -0.0361328125,
+      -0.015625,
+      0.96875,
+      0.0018310546875
+    ],
+    [
+      0.1318359375,
+      0.017578125,
+      0.90625,
+      0.95703125,
+      0.0107421875,
+      -0.0322265625,
+      -0.0234375,
+      0.93359375,
+      -0.017578125
+    ],
+    [
+      0.130859375,
+      0.025390625,
+      0.91796875,
+      0.984375,
+      0.0009765625,
+      -0.04345703125,
+      -0.0078125,
+      0.9765625,
+      0.017578125
+    ],
+    [
+      0.107421875,
+      -0.001953125,
+      0.90234375,
+      0.9765625,
+      0.002685546875,
+      -0.04443359375,
+      -0.017578125,
+      0.95703125,
+      -0.009765625
+    ],
+    [
+      0.1220703125,
+      0.03125,
+      0.90234375,
+      0.94921875,
+      -0.0078125,
+      -0.037109375,
+      0.0087890625,
+      0.9453125,
+      0.017578125
+    ],
+    [
+      0.130859375,
+      0.009765625,
+      0.88671875,
+      0.953125,
+      -0.009765625,
+      -0.040283203125,
+      0.0029296875,
+      0.953125,
+      0.005126953125
+    ],
+    [
+      0.12353515625,
+      -0.0078125,
+      0.91015625,
+      0.96875,
+      0.0029296875,
+      -0.0478515625,
+      -0.00537109375,
+      0.95703125,
+      -0.0029296875
+    ],
+    [
+      0.15625,
+      -0.001953125,
+      0.8828125,
+      0.96484375,
+      0.0126953125,
+      -0.038330078125,
+      -0.01171875,
+      0.953125,
+      0.01171875
+    ],
+    [
+      0.1328125,
+      0.005859375,
+      0.9140625,
+      0.96875,
+      0.0087890625,
+      -0.03955078125,
+      -0.013671875,
+      0.953125,
+      0.013671875
+    ],
+    [
+      0.1318359375,
+      0.0205078125,
+      0.8984375,
+      0.953125,
+      0.0,
+      -0.0458984375,
+      0.0009765625,
+      0.95703125,
+      -0.0078125
+    ],
+    [
+      0.119140625,
+      0.013671875,
+      0.921875,
+      0.96875,
+      0.0087890625,
+      -0.037109375,
+      0.001953125,
+      0.95703125,
+      0.0068359375
+    ],
+    [
+      0.115234375,
+      0.015625,
+      0.91015625,
+      0.984375,
+      0.01953125,
+      -0.0361328125,
+      -0.000732421875,
+      0.9609375,
+      0.0078125
+    ],
+    [
+      0.1103515625,
+      0.01312255859375,
+      0.9453125,
+      0.9375,
+      -0.00244140625,
+      -0.038330078125,
+      0.005859375,
+      0.953125,
+      -0.001068115234375
+    ],
+    [
+      0.1220703125,
+      0.0244140625,
+      0.953125,
+      0.9375,
+      -0.005859375,
+      -0.033203125,
+      0.005859375,
+      0.95703125,
+      -0.00390625
+    ],
+    [
+      0.1279296875,
+      -0.00390625,
+      0.96875,
+      0.96875,
+      0.0087890625,
+      -0.029296875,
+      0.00390625,
+      0.98046875,
+      0.0048828125
+    ],
+    [
+      0.11572265625,
+      0.033203125,
+      0.984375,
+      0.9609375,
+      -0.0078125,
+      -0.0341796875,
+      0.0029296875,
+      0.97265625,
+      0.009765625
+    ],
+    [
+      0.126953125,
+      -0.00390625,
+      0.9765625,
+      0.9609375,
+      0.0087890625,
+      -0.044921875,
+      -0.00390625,
+      0.9765625,
+      0.00244140625
+    ],
+    [
+      0.12109375,
+      0.01953125,
+      0.9921875,
+      0.953125,
+      0.0048828125,
+      -0.0234375,
+      0.0010986328125,
+      0.9375,
+      0.0029296875
+    ],
+    [
+      0.10546875,
+      -0.0078125,
+      1.015625,
+      0.9765625,
+      0.0078125,
+      -0.03466796875,
+      -0.0035400390625,
+      0.94921875,
+      0.0029296875
+    ],
+    [
+      0.1064453125,
+      0.0263671875,
+      1.0078125,
+      0.94921875,
+      0.00042724609375,
+      -0.0400390625,
+      -0.013671875,
+      0.9609375,
+      0.005859375
+    ],
+    [
+      0.095703125,
+      0.0244140625,
+      1.03125,
+      0.96875,
+      0.0068359375,
+      -0.0234375,
+      0.00048828125,
+      0.953125,
+      0.002197265625
+    ],
+    [
+      0.08837890625,
+      0.02099609375,
+      1.0390625,
+      0.984375,
+      0.0052490234375,
+      -0.03515625,
+      0.009765625,
+      0.96484375,
+      -0.0048828125
+    ],
+    [
+      0.08154296875,
+      0.029296875,
+      1.0625,
+      0.953125,
+      0.0048828125,
+      -0.04296875,
+      -0.005615234375,
+      0.96875,
+      0.00634765625
+    ],
+    [
+      0.0849609375,
+      0.00823974609375,
+      1.109375,
+      0.96875,
+      -0.0078125,
+      -0.01953125,
+      0.00390625,
+      0.96484375,
+      0.00146484375
+    ],
+    [
+      0.08203125,
+      0.029296875,
+      1.1171875,
+      0.95703125,
+      0.0048828125,
+      -0.02734375,
+      0.0,
+      0.97265625,
+      0.004852294921875
+    ],
+    [
+      0.056640625,
+      0.021484375,
+      1.1328125,
+      0.9609375,
+      -0.005859375,
+      -0.02001953125,
+      0.0078125,
+      0.9609375,
+      0.015625
+    ],
+    [
+      0.060546875,
+      0.001220703125,
+      1.140625,
+      0.984375,
+      0.0029296875,
+      -0.017578125,
+      0.001953125,
+      0.94921875,
+      0.009765625
+    ],
+    [
+      0.060546875,
+      0.007568359375,
+      1.1875,
+      0.96484375,
+      -0.000732421875,
+      -0.0166015625,
+      0.0029296875,
+      0.96875,
+      0.005615234375
+    ],
+    [
+      0.060302734375,
+      0.01123046875,
+      1.1875,
+      0.9609375,
+      -0.0087890625,
+      -0.0166015625,
+      -0.01171875,
+      0.9609375,
+      0.0078125
+    ],
+    [
+      0.046875,
+      0.01953125,
+      1.2109375,
+      0.953125,
+      -0.0048828125,
+      -0.0184326171875,
+      0.0029296875,
+      0.9296875,
+      0.009765625
+    ],
+    [
+      0.04248046875,
+      0.01953125,
+      1.2109375,
+      0.97265625,
+      0.005859375,
+      -0.029296875,
+      -0.0068359375,
+      0.9765625,
+      0.0078125
+    ],
+    [
+      0.041015625,
+      0.01611328125,
+      1.2734375,
+      0.96875,
+      0.0048828125,
+      -0.00927734375,
+      0.0009765625,
+      0.97265625,
+      0.0087890625
+    ],
+    [
+      0.0302734375,
+      0.009521484375,
+      1.265625,
+      0.984375,
+      0.004638671875,
+      -0.005859375,
+      -0.00537109375,
+      0.98046875,
+      0.013671875
+    ],
+    [
+      0.015625,
+      0.0086669921875,
+      1.296875,
+      0.96875,
+      0.013671875,
+      -0.013671875,
+      -0.015625,
+      0.984375,
+      0.0234375
+    ],
+    [
+      0.0283203125,
+      0.0146484375,
+      1.3359375,
+      0.96875,
+      0.01953125,
+      -0.0068359375,
+      -0.0078125,
+      0.9765625,
+      0.01318359375
+    ],
+    [
+      0.033203125,
+      0.0,
+      1.34375,
+      0.97265625,
+      0.00146484375,
+      0.00390625,
+      0.001953125,
+      0.97265625,
+      0.005615234375
+    ],
+    [
+      0.0234375,
+      0.0048828125,
+      1.328125,
+      0.9921875,
+      0.00439453125,
+      -0.0078125,
+      -0.003662109375,
+      0.98046875,
+      0.010009765625
+    ],
+    [
+      0.009033203125,
+      0.0166015625,
+      1.3984375,
+      0.984375,
+      -0.01171875,
+      -0.009765625,
+      0.0234375,
+      0.96484375,
+      0.01171875
+    ],
+    [
+      0.021484375,
+      -0.01171875,
+      1.40625,
+      0.96875,
+      -0.01953125,
+      -0.0048828125,
+      0.01171875,
+      0.96484375,
+      0.0234375
+    ],
+    [
+      0.0155029296875,
+      0.021484375,
+      1.4375,
+      0.9609375,
+      -0.00341796875,
+      0.009765625,
+      0.0006103515625,
+      0.96484375,
+      -0.00390625
+    ],
+    [
+      0.0108642578125,
+      0.005859375,
+      1.421875,
+      0.953125,
+      -0.002685546875,
+      -0.013671875,
+      0.0068359375,
+      0.953125,
+      -0.00048828125
+    ],
+    [
+      0.01068115234375,
+      0.01171875,
+      1.46875,
+      0.953125,
+      -0.00341796875,
+      -0.00048828125,
+      0.005859375,
+      0.9453125,
+      0.009765625
+    ],
+    [
+      0.00830078125,
+      0.0224609375,
+      1.515625,
+      0.96875,
+      0.005859375,
+      0.00048828125,
+      0.0009765625,
+      0.96484375,
+      0.001953125
+    ],
+    [
+      0.01171875,
+      -0.015625,
+      1.515625,
+      0.9765625,
+      0.0029296875,
+      0.001953125,
+      -0.001220703125,
+      0.96875,
+      0.01171875
+    ],
+    [
+      0.010986328125,
+      0.0185546875,
+      1.546875,
+      0.97265625,
+      -0.00390625,
+      0.00244140625,
+      -0.00390625,
+      0.984375,
+      0.0078125
+    ],
+    [
+      0.01318359375,
+      0.0087890625,
+      1.5390625,
+      0.94921875,
+      0.0,
+      0.015625,
+      -0.0078125,
+      0.953125,
+      0.005859375
+    ],
+    [
+      0.00830078125,
+      0.01165771484375,
+      1.578125,
+      0.953125,
+      0.0003662109375,
+      -0.009765625,
+      0.0,
+      0.9765625,
+      0.0087890625
+    ],
+    [
+      0.011962890625,
+      0.025390625,
+      1.5703125,
+      0.953125,
+      -0.00164794921875,
+      -0.000244140625,
+      0.001953125,
+      0.96875,
+      -0.0068359375
+    ],
+    [
+      0.00970458984375,
+      0.025390625,
+      1.6171875,
+      0.9609375,
+      0.0068359375,
+      0.0009765625,
+      0.0078125,
+      0.984375,
+      0.0048828125
+    ],
+    [
+      0.01220703125,
+      0.014892578125,
+      1.640625,
+      0.96875,
+      -0.00390625,
+      0.0,
+      -0.0048828125,
+      0.97265625,
+      0.0078125
+    ],
+    [
+      0.006103515625,
+      -0.001953125,
+      1.640625,
+      0.9765625,
+      0.002471923828125,
+      -0.001953125,
+      -0.00537109375,
+      0.96875,
+      0.00341796875
+    ],
+    [
+      0.0166015625,
+      0.017578125,
+      1.640625,
+      0.96875,
+      0.00146484375,
+      -0.009765625,
+      0.0048828125,
+      0.96484375,
+      0.0087890625
+    ],
+    [
+      0.005126953125,
+      0.0087890625,
+      1.6796875,
+      0.9609375,
+      -0.005859375,
+      -0.00146484375,
+      -0.005859375,
+      0.96875,
+      0.0068359375
+    ]
+  ],
+  "shape": [
+    60,
+    9
+  ],
+  "dtype": "torch.bfloat16",
+  "raw_action_dim": 9,
+  "action_mode": "inverse_dynamics",
+  "domain_id": 1
+}

checkpoints/mixed240/assets/example_action_fd_umi_action_chunks.json

@@ -0,0 +1,404 @@
+{
+  "prompt": "mouse arrangement",
+  "domain_name": "umi",
+  "view_point": "ego_view",
+  "fps": 20,
+  "image_size": 256,
+  "action_chunk_size": 16,
+  "num_chunks": 2,
+  "action_shape_per_chunk": [
+    16,
+    10
+  ],
+  "description": "Two normalized 10-D UMI action chunks for a single-view ego_view rollout. Use the first frame as the initial conditioning image. For chunk 1, condition on the final generated frame from chunk 0.",
+  "action_chunks": [
+    [
+      [
+        0.053812503814697266,
+        -0.004779123235493898,
+        0.002008301904425025,
+        0.9671046733856201,
+        0.03711317479610443,
+        -0.17747420072555542,
+        -0.036594998091459274,
+        0.9977647662162781,
+        0.02953636832535267,
+        -0.13823197782039642
+      ],
+      [
+        0.07370813935995102,
+        -0.00015990791143849492,
+        -0.00526643730700016,
+        0.966162919998169,
+        0.05513376370072365,
+        -0.17547594010829926,
+        -0.05433010682463646,
+        0.994891881942749,
+        0.04623955488204956,
+        -0.13932132720947266
+      ],
+      [
+        0.1894039809703827,
+        -0.0023578035179525614,
+        0.012279288843274117,
+        0.9756994843482971,
+        0.09475686401128769,
+        -0.12368101626634598,
+        -0.09487718343734741,
+        0.9908984303474426,
+        -0.009143882431089878,
+        -0.14122092723846436
+      ],
+      [
+        0.1646755337715149,
+        0.014868665486574173,
+        -0.02827119641005993,
+        0.9662106037139893,
+        0.11741045117378235,
+        -0.14138658344745636,
+        -0.11718737334012985,
+        0.9859751462936401,
+        0.01658531278371811,
+        -0.14161521196365356
+      ],
+      [
+        0.20245812833309174,
+        0.039910294115543365,
+        -0.025805803015828133,
+        0.8995737433433533,
+        0.16153031587600708,
+        -0.27254194021224976,
+        -0.1620442271232605,
+        0.9734464883804321,
+        -0.016664521768689156,
+        -0.14406844973564148
+      ],
+      [
+        0.18459202349185944,
+        0.03604526445269585,
+        -0.02222990058362484,
+        0.941689670085907,
+        0.08134357631206512,
+        -0.22731782495975494,
+        -0.08176705986261368,
+        0.9929845333099365,
+        -0.01771094650030136,
+        -0.14325366914272308
+      ],
+      [
+        0.19590386748313904,
+        0.02676231600344181,
+        -0.02729889750480652,
+        0.8968558311462402,
+        0.16832612454891205,
+        -0.2734377384185791,
+        -0.16814984381198883,
+        0.97162264585495,
+        0.008744634687900543,
+        -0.1433658003807068
+      ],
+      [
+        0.2117065191268921,
+        0.019320685416460037,
+        -0.013418853282928467,
+        0.8548710346221924,
+        0.22257667779922485,
+        -0.30904778838157654,
+        -0.22233201563358307,
+        0.9504156708717346,
+        0.011350061744451523,
+        -0.1437632143497467
+      ],
+      [
+        0.22299973666667938,
+        0.0327562540769577,
+        -0.009134029038250446,
+        0.8706302046775818,
+        0.21322639286518097,
+        -0.28956693410873413,
+        -0.21412642300128937,
+        0.953336238861084,
+        -0.02801540493965149,
+        -0.14188432693481445
+      ],
+      [
+        0.2140849381685257,
+        0.02660888060927391,
+        -0.01170671172440052,
+        0.8908835649490356,
+        0.20415504276752472,
+        -0.2596054971218109,
+        -0.20452779531478882,
+        0.9580091238021851,
+        -0.01170840673148632,
+        -0.14164277911186218
+      ],
+      [
+        0.22304928302764893,
+        0.028626402840018272,
+        -0.006994225084781647,
+        0.8915749192237854,
+        0.12412955611944199,
+        -0.30490365624427795,
+        -0.12411271035671234,
+        0.9845566153526306,
+        0.0024451441131532192,
+        -0.14154405891895294
+      ],
+      [
+        0.2222731113433838,
+        0.025864848867058754,
+        -0.03064606711268425,
+        0.8916106820106506,
+        0.11292119324207306,
+        -0.3092045783996582,
+        -0.11282884329557419,
+        0.9872149229049683,
+        0.004730388056486845,
+        -0.14219173789024353
+      ],
+      [
+        0.2097492665052414,
+        0.05057718604803085,
+        -0.007311991881579161,
+        0.9075368046760559,
+        0.1548784226179123,
+        -0.26160797476768494,
+        -0.15552769601345062,
+        0.9752822518348694,
+        -0.022801857441663742,
+        -0.1428474634885788
+      ],
+      [
+        0.2123514711856842,
+        0.042986635118722916,
+        0.006450705695897341,
+        0.9269675612449646,
+        0.16701975464820862,
+        -0.2123788744211197,
+        -0.16792836785316467,
+        0.9700967669487,
+        -0.041070736944675446,
+        -0.14396123588085175
+      ],
+      [
+        0.2005469650030136,
+        0.04303627461194992,
+        0.0021174526773393154,
+        0.9145819544792175,
+        0.15997713804244995,
+        -0.24451406300067902,
+        -0.16089586913585663,
+        0.9728385210037231,
+        -0.0356520377099514,
+        -0.143580824136734
+      ],
+      [
+        0.1828203797340393,
+        0.06162899360060692,
+        0.015765784308314323,
+        0.9442406892776489,
+        0.12680575251579285,
+        -0.199128195643425,
+        -0.12898683547973633,
+        0.9715272784233093,
+        -0.10863088071346283,
+        -0.14364691078662872
+      ]
+    ],
+    [
+      [
+        0.1800091415643692,
+        0.05415700003504753,
+        0.0220723208039999,
+        0.9427744746208191,
+        0.15702207386493683,
+        -0.18039608001708984,
+        -0.1585177183151245,
+        0.9681656360626221,
+        -0.08177943527698517,
+        -0.14226296544075012
+      ],
+      [
+        0.1782533973455429,
+        0.046168215572834015,
+        0.03214065358042717,
+        0.9491162896156311,
+        0.15013249218463898,
+        -0.16828377544879913,
+        -0.15176372230052948,
+        0.9677245616912842,
+        -0.09608176350593567,
+        -0.1437339335680008
+      ],
+      [
+        0.17733417451381683,
+        0.05023511126637459,
+        0.042507752776145935,
+        0.9599641561508179,
+        0.11787547171115875,
+        -0.16160599887371063,
+        -0.11985509097576141,
+        0.9706928133964539,
+        -0.12208050489425659,
+        -0.14515265822410583
+      ],
+      [
+        0.17919816076755524,
+        0.07686550915241241,
+        0.06860226392745972,
+        0.9644821286201477,
+        0.10539975762367249,
+        -0.15618394315242767,
+        -0.10708234459161758,
+        0.9769988656044006,
+        -0.10728096216917038,
+        -0.1453562080860138
+      ],
+      [
+        0.1575465053319931,
+        0.029737284407019615,
+        0.05468235909938812,
+        0.9541349411010742,
+        0.15530435740947723,
+        -0.14736345410346985,
+        -0.1561610847711563,
+        0.9723378419876099,
+        -0.057166263461112976,
+        -0.14554671943187714
+      ],
+      [
+        0.17658387124538422,
+        -0.0008871768950484693,
+        0.09531591832637787,
+        0.983400285243988,
+        0.09690801054239273,
+        -0.08479148149490356,
+        -0.09749053418636322,
+        0.9857844114303589,
+        -0.06855253875255585,
+        -0.1436685174703598
+      ],
+      [
+        0.1308804750442505,
+        0.016017800197005272,
+        0.04266123101115227,
+        0.9813141822814941,
+        0.10064378380775452,
+        -0.09238820523023605,
+        -0.10080896317958832,
+        0.9895036816596985,
+        -0.017434898763895035,
+        -0.14607854187488556
+      ],
+      [
+        0.12789754569530487,
+        0.0020461133681237698,
+        0.06620839238166809,
+        0.99201899766922,
+        0.03137550875544548,
+        -0.08352884650230408,
+        -0.03163702413439751,
+        0.9980270266532898,
+        -0.031180214136838913,
+        -0.14278197288513184
+      ],
+      [
+        0.11177432537078857,
+        -0.02513059414923191,
+        0.08431962132453918,
+        0.9990403056144714,
+        -0.010432509705424309,
+        -0.02879752404987812,
+        0.010669702664017677,
+        0.9930679798126221,
+        0.08243173360824585,
+        -0.14342190325260162
+      ],
+      [
+        0.0631430447101593,
+        -0.010469917207956314,
+        0.08317670226097107,
+        0.999850869178772,
+        -0.011552712880074978,
+        0.0031132197473198175,
+        0.011538979597389698,
+        0.9979555010795593,
+        0.04372014105319977,
+        -0.1447361707687378
+      ],
+      [
+        0.09046280384063721,
+        -0.012558498419821262,
+        0.09904492646455765,
+        0.998515784740448,
+        0.032513268291950226,
+        0.02011110819876194,
+        -0.0324835367500782,
+        0.9986945986747742,
+        -0.01484532468020916,
+        -0.14469973742961884
+      ],
+      [
+        0.07805871963500977,
+        -0.019602082669734955,
+        0.11864962428808212,
+        0.9934136867523193,
+        0.054121777415275574,
+        0.06036890670657158,
+        -0.05413716286420822,
+        0.9970375895500183,
+        0.002376429969444871,
+        -0.1444096863269806
+      ],
+      [
+        0.08657136559486389,
+        -0.0348740816116333,
+        0.12534210085868835,
+        0.9954044818878174,
+        0.005703791975975037,
+        0.067320816218853,
+        -0.00547851761803031,
+        0.9988376498222351,
+        -0.033448826521635056,
+        -0.14501787722110748
+      ],
+      [
+        0.07565143704414368,
+        -0.044480662792921066,
+        0.1283297836780548,
+        0.9972044825553894,
+        0.022084418684244156,
+        0.04793533310294151,
+        -0.02211857959628105,
+        0.999433696269989,
+        0.007050265092402697,
+        -0.14408022165298462
+      ],
+      [
+        0.06433551013469696,
+        -0.04466487839818001,
+        0.13651199638843536,
+        0.9936521053314209,
+        -0.04951975867152214,
+        0.0623551569879055,
+        0.049662359058856964,
+        0.9970018267631531,
+        -0.022745873779058456,
+        -0.14406241476535797
+      ],
+      [
+        0.05908937379717827,
+        -0.05935889855027199,
+        0.1395753026008606,
+        0.9970375895500183,
+        -0.024985427036881447,
+        0.04805263504385948,
+        0.02504965290427208,
+        0.9991833567619324,
+        -0.013274282217025757,
+        -0.14403760433197021
+      ]
+    ]
+  ]
+}

checkpoints/mixed240/assets/example_i2v_prompt.json

@@ -0,0 +1,124 @@
+{
+    "subjects": [
+      {
+        "description": "A car (viewed from the driver's perspective/dashcam) traveling along a coastal mountain road. The vehicle's grey dashboard and windshield frame are visible at the bottom of the frame.",
+        "appearance_details": "Grey/dark interior dashboard, windshield wipers visible, clean windshield providing clear view of the road ahead",
+        "relationship": "Primary subject and point-of-view vehicle navigating the mountain road",
+        "location": "Bottom foreground, providing the POV perspective",
+        "relative_size": "Large within frame (dashboard occupies bottom portion)",
+        "orientation": "Facing forward along the road direction",
+        "pose": "",
+        "action": "Driving fast along the curved coastal road, then making a sudden emergency stop",
+        "state_changes": "Transitions from fast forward motion to abrupt deceleration and complete stop",
+        "clothing": "",
+        "expression": "",
+        "gender": "",
+        "age": "",
+        "skin_tone_and_texture": "",
+        "facial_features": "",
+        "number_of_subjects": 1,
+        "number_of_arms": 0,
+        "number_of_legs": 0
+      },
+      {
+        "description": "Falling rocks and debris from the steep rocky mountain cliff face, creating a landslide that tumbles down toward the road surface",
+        "appearance_details": "Grey and brown angular rocks of various sizes, accompanied by dust and smaller debris, mixed with displaced green vegetation",
+        "relationship": "Obstacle that forces the car to make an emergency stop",
+        "location": "Center and center-right of frame, falling from the mountain cliff face toward the road",
+        "relative_size": "Medium within frame, growing larger as rocks approach the road",
+        "orientation": "Falling downward from the cliff face",
+        "pose": "",
+        "action": "Tumbling and cascading down the steep rocky mountainside toward the road",
+        "state_changes": "Begins as small movement on the cliff face, escalates into a significant rockfall with dust cloud",
+        "clothing": "",
+        "expression": "",
+        "gender": "",
+        "age": "",
+        "skin_tone_and_texture": "",
+        "facial_features": "",
+        "number_of_subjects": 0,
+        "number_of_arms": 0,
+        "number_of_legs": 0
+      }
+    ],
+    "background_setting": "A dramatic coastal mountain highway carved along steep rocky cliffs. The road is a well-maintained two-lane highway with white dashed center lines, solid white edge lines, and raised reflective road markers. A metal guardrail runs along the right side protecting from a drop toward the ocean. The mountain rises steeply on the left with exposed grey and brown rock faces partially covered with lush green native vegetation including ferns and shrubs. The ocean is visible in the distance to the right under a partly cloudy blue sky. The road curves sharply to the left around the mountain headland.",
+    "lighting": {
+      "conditions": "Bright natural daylight with partly cloudy skies, strong ambient illumination",
+      "direction": "Top-lit and slightly front-lit from the sun positioned high in the sky",
+      "shadows": "Moderate shadows cast by the mountain cliff creating areas of shade on the road and vegetation, soft shadows from clouds",
+      "illumination_effect": "Bright, clear visibility with good contrast between the sunlit road surface and shaded mountain areas, natural coastal light"
+    },
+    "aesthetics": {
+      "composition": "Driver's POV/dashcam perspective with the road curving ahead as the central leading line, mountain dominating the upper-left portion, ocean visible to the right, dashboard framing the bottom",
+      "color_scheme": "Dominant greens from vegetation, grey-brown rocky cliff faces, dark grey asphalt road with white markings, blue sky and ocean, yellow warning sign providing accent color",
+      "mood_atmosphere": "Initially scenic and adventurous, transitioning to tense and dangerous as the landslide occurs",
+      "patterns": "Repeating metal guardrail posts along the right side, dashed center line markings, layered rock strata on the cliff face"
+    },
+    "cinematography": {
+      "camera_motion": "Forward-moving dashcam perspective with slight vibration from vehicle speed, sudden forward lurch during emergency braking",
+      "framing": "Wide shot from driver's POV through windshield",
+      "camera_angle": "Eye-level from driver's seated position",
+      "depth_of_field": "Deep",
+      "focus": "Road ahead and mountain cliff face in sharp focus",
+      "lens_focal_length": "Wide-angle (approximately 28-35mm equivalent)"
+    },
+    "style_medium": "Live-action video",
+    "artistic_style": "Realistic dashcam footage, dramatic documentary style",
+    "context": "Dashcam footage capturing a dangerous landslide event on a coastal mountain highway, requiring emergency driving maneuver",
+    "actions": [
+      {
+        "time": "0:00-0:02",
+        "description": "The car drives fast along the winding coastal mountain road, approaching the left curve with the road rushing beneath"
+      },
+      {
+        "time": "0:02-0:04",
+        "description": "Rocks begin to dislodge from the steep cliff face ahead, tumbling down with increasing intensity as a landslide develops, dust rising from impacts"
+      },
+      {
+        "time": "0:04-0:05",
+        "description": "The car makes a sudden emergency stop, the camera lurching forward from the deceleration as rocks and debris continue falling onto the road ahead"
+      }
+    ],
+    "text_and_signage_elements": [
+      {
+        "text": "Left curve arrow",
+        "category": "scene_sign",
+        "appearance": "Black arrow on yellow diamond-shaped warning sign, mounted on a metal pole",
+        "spatial_temporal": "Left side of road, visible from 0:00 and passing by as car moves forward",
+        "context": "Road warning sign indicating a sharp left curve ahead, standard highway signage"
+      }
+    ],
+    "segments": [
+      {
+        "segment_index": 0,
+        "time_range": "0:00-0:02",
+        "description": "The car speeds along the scenic coastal mountain highway, navigating the curve. The road surface rushes beneath, white lines blur slightly from speed, and the mountain looms ahead.",
+        "key_changes": "Road perspective shifts as car navigates the curve, passing the warning sign, guardrail moves in peripheral view",
+        "camera": "Forward-moving dashcam with slight road vibration, steady forward momentum"
+      },
+      {
+        "segment_index": 1,
+        "time_range": "0:02-0:04",
+        "description": "Rocks begin breaking loose from the cliff face ahead. Small stones first, then larger boulders cascade down the mountainside creating a growing dust cloud and debris field on and near the road.",
+        "key_changes": "Mountain transitions from static backdrop to active hazard, dust cloud forms, debris appears on road surface ahead",
+        "camera": "Still moving forward but beginning to slow, slight camera shake increases"
+      },
+      {
+        "segment_index": 2,
+        "time_range": "0:04-0:05",
+        "description": "The car performs an emergency stop. The camera pitches forward from sudden braking force. The vehicle comes to a complete halt with the landslide debris visible on the road ahead, dust still settling.",
+        "key_changes": "Rapid deceleration, camera lurches forward then settles, motion stops completely, dust and small rocks still visible falling",
+        "camera": "Abrupt forward pitch from braking, then stabilizes to static as vehicle stops"
+      }
+    ],
+    "transitions": [],
+    "temporal_caption": "The video begins with a dashcam view of a car driving fast along a scenic coastal mountain road, the asphalt rushing beneath and a sharp left curve sign visible on the left. The car navigates the curve at speed with the steep rocky cliff towering above and the ocean visible to the right. Around the 2-second mark, small rocks begin to dislodge from the cliff face ahead, quickly escalating into a significant rockfall with larger boulders tumbling down the mountainside and a dust cloud forming. By second 4, the driver reacts with emergency braking - the camera lurches forward dramatically from the sudden deceleration. The car comes to a complete stop between seconds 4 and 5, with the road ahead partially blocked by fallen rocks and debris, dust still settling in the air around the landslide zone.",
+    "audio_description": "Initially the sound of a car engine at moderate-high RPM and tire noise on asphalt with wind passing over the vehicle. Around second 2, the rumbling and cracking sounds of rocks breaking loose begin, growing louder with impacts of stones hitting the road surface and each other. Loud thuds and crashes as larger rocks land. At second 4, the sharp screech of tires braking hard on asphalt, followed by the settling sounds of smaller pebbles and dust, with distant rumbling of the remaining rockfall subsiding.",
+    "resolution": {
+      "W": 1280,
+      "H": 720
+    },
+    "aspect_ratio": "16,9",
+    "duration": "5s",
+    "fps": 24
+  }

checkpoints/mixed240/assets/example_reasoning_prompt.json

@@ -0,0 +1,4 @@
+{
+  "prompt": "The task is to put flower into the red bottle. Generate a plan consisting of subtasks for accomplish the task.",
+  "max_tokens": 4096
+}

checkpoints/mixed240/assets/negative_prompt.json

@@ -0,0 +1,131 @@
+{
+  "subjects": [
+    {
+      "description": "A subject suffering from extreme temporal instability — flickering outlines, morphing silhouette, and visible frame-to-frame discontinuities that make it look like a corrupted video file.",
+      "appearance_details": "Distorted features, visible compression artifacts, muddy textures lacking fine detail, color bleeding between elements, and unnatural skin tones or surface textures that appear artificial or computer-generated.",
+      "relationship": "Subjects appear disconnected from the environment, floating or improperly grounded in the scene without proper occlusion or spatial coherence.",
+      "location": "Subjects are poorly placed within the frame, appearing at awkward positions that violate basic compositional rules.",
+      "relative_size": "Inconsistent scale relationships between subjects and the environment, with objects appearing too large or too small relative to their surroundings.",
+      "orientation": "Unnatural orientations that defy physics and spatial logic.",
+      "pose": "Poses snap between positions with no interpolation, creating a strobe-like effect.",
+      "action": "Motion is completely incoherent — limbs teleport between positions, movement appears as discrete jumps rather than continuous flow, and speed varies wildly between frames.",
+      "state_changes": "The subject flickers between completely different visual states every few frames, as if multiple renders were randomly interleaved.",
+      "clothing": "Garments phase in and out of visibility, textures swim across surfaces untethered to the geometry.",
+      "expression": "Frozen, uncanny valley expressions or expressions that change abruptly without natural transition.",
+      "gender": "",
+      "age": "",
+      "skin_tone_and_texture": "Waxy, plastic-looking skin with visible artifacts and inconsistent texture resolution across the frame.",
+      "facial_features": "Asymmetric facial features, extra fingers or limbs, teeth that appear blurry or malformed.",
+      "number_of_subjects": 0,
+      "number_of_arms": 0,
+      "number_of_legs": 0
+    },
+    {
+      "description": "A subject with catastrophically broken surface rendering — visible polygon edges, texture seams, UV mapping errors, and normal map inversions.",
+      "appearance_details": "Distorted features, visible compression artifacts, muddy textures lacking fine detail, color bleeding between elements, and unnatural skin tones or surface textures that appear artificial or computer-generated.",
+      "relationship": "Subjects appear disconnected from the environment, floating or improperly grounded in the scene without proper occlusion or spatial coherence.",
+      "location": "Subjects are poorly placed within the frame, appearing at awkward positions that violate basic compositional rules.",
+      "relative_size": "Inconsistent scale relationships between subjects and the environment, with objects appearing too large or too small relative to their surroundings.",
+      "orientation": "Unnatural orientations that defy physics and spatial logic.",
+      "pose": "Static poses reveal texture swimming, moire patterns, and aliased edges on every contour.",
+      "action": "Movement reveals progressively worse texture breakdown — stretching, tearing, and resolution collapse in deformed regions.",
+      "state_changes": "Surface materials randomly swap between frames — metal becomes cloth, glass becomes stone, with no transition.",
+      "clothing": "Fabric renders as a flat solid color with no folds, wrinkles, or material response to form.",
+      "expression": "Frozen, uncanny valley expressions or expressions that change abruptly without natural transition.",
+      "gender": "",
+      "age": "",
+      "skin_tone_and_texture": "Waxy, plastic-looking skin with visible artifacts and inconsistent texture resolution across the frame.",
+      "facial_features": "Asymmetric facial features, extra fingers or limbs, teeth that appear blurry or malformed.",
+      "number_of_subjects": 0,
+      "number_of_arms": 0,
+      "number_of_legs": 0
+    },
+    {
+      "description": "A subject that appears composited into the scene rather than belonging to it — mismatched lighting direction, wrong color temperature, and edges that bleed into the background.",
+      "appearance_details": "Distorted features, visible compression artifacts, muddy textures lacking fine detail, color bleeding between elements, and unnatural skin tones or surface textures that appear artificial or computer-generated.",
+      "relationship": "Subjects appear disconnected from the environment, floating or improperly grounded in the scene without proper occlusion or spatial coherence.",
+      "location": "Subjects are poorly placed within the frame, appearing at awkward positions that violate basic compositional rules.",
+      "relative_size": "Inconsistent scale relationships between subjects and the environment, with objects appearing too large or too small relative to their surroundings.",
+      "orientation": "Unnatural orientations that defy physics and spatial logic.",
+      "pose": "Proportions shift between frames — limbs lengthen and shorten, heads resize, creating an unsettling instability.",
+      "action": "Movement creates visible matting artifacts — green screen fringe, edge chattering, and translucent boundaries.",
+      "state_changes": "The subject randomly changes size, opacity, and z-depth relative to other scene elements.",
+      "clothing": "Clothing appears to be from a different render pass — different noise level, different motion blur kernel, different color space.",
+      "expression": "Frozen, uncanny valley expressions or expressions that change abruptly without natural transition.",
+      "gender": "",
+      "age": "",
+      "skin_tone_and_texture": "Waxy, plastic-looking skin with visible artifacts and inconsistent texture resolution across the frame.",
+      "facial_features": "Asymmetric facial features, extra fingers or limbs, teeth that appear blurry or malformed.",
+      "number_of_subjects": 0,
+      "number_of_arms": 0,
+      "number_of_legs": 0
+    }
+  ],
+  "background_setting": "A poorly rendered, flat background with visible seams, repeated textures, and inconsistent depth cues. The environment lacks volumetric depth and appears as a painted backdrop rather than a three-dimensional space. Vegetation looks like flat cutouts with no volumetric depth. The background appears to have been composited from multiple source materials at different resolutions, creating visible seams and edge artifacts where elements meet. Textures swim and shift across surfaces in a way that breaks the illusion of solidity — patterns drift laterally rather than staying anchored to the geometry they belong to. Background elements flicker in and out of existence between frames, particularly at the edges of the field of view. The rendering resolution is visibly lower for distant elements, creating a jarring transition between near and far objects. Cloud textures repeat obviously in the sky with visible tiling. Water surfaces lack proper reflection and refraction, appearing as flat animated textures. Fog and atmospheric effects pop in and out rather than smoothly transitioning. Trees and vegetation exhibit obvious LOD (level-of-detail) switching. Building facades have inconsistent window spacing and pattern repetition. The overall scene feels like a poorly assembled collage of individually rendered elements rather than a coherent whole.",
+  "lighting": {
+    "conditions": "Harsh, flat lighting with no natural variation. The scene appears uniformly lit as if by a single overhead fluorescent light, removing all sense of depth and atmosphere.",
+    "direction": "Inconsistent light sources — shadows point in multiple contradictory directions, breaking physical plausibility.",
+    "shadows": "Hard-edged, unrealistic shadows that pop in and out of existence between frames. Some objects cast no shadows while others have impossibly dark ones that don't animate smoothly with the object's motion. Shadow edges exhibit visible staircase aliasing artifacts. Shadow maps appear to have been rendered at extremely low resolution, creating blocky patterns. Self-shadowing on characters shows visible peter-panning artifacts where shadows detach from their source. Contact shadows between objects and the ground appear and disappear as objects move slightly. Shadow color is pure black with no ambient contribution, creating an unnaturally harsh contrast that flattens the image. Multiple shadow cascades have visible boundaries where resolution changes. The shadow rendering appears to be temporally unstable — even static objects have shadows that shimmer and crawl frame to frame, breaking the illusion of a stable light source.",
+    "illumination_effect": "No bounce light, no ambient occlusion, no subtle color interactions between surfaces. The scene looks like a poorly lit 3D render from the early 2000s."
+  },
+  "aesthetics": {
+    "composition": "Cluttered, poorly framed composition with no clear focal point. Important elements are cut off by the frame edges. The rule of thirds is completely ignored, leading to an unbalanced and visually unpleasant arrangement.",
+    "color_scheme": "Oversaturated, garish colors that clash violently. Color banding is visible in gradient areas. The overall palette feels artificial and digitally processed rather than natural.",
+    "mood_atmosphere": "Unsettling, uncanny atmosphere that fails to evoke any intended emotional response. The scene feels lifeless and sterile despite attempting to portray dynamic action.",
+    "patterns": "Visible tiling artifacts in textures, moiré patterns, and aliasing on edges."
+  },
+  "cinematography": {
+    "camera_motion": "Extremely shaky, unstable camera with visible rolling shutter artifacts. The motion is jerky and discontinuous, causing motion sickness and making the scene impossible to follow. The camera also executes an over-aggressive, unrelenting push-in: it dollies and optically zooms toward the subject far too fast — magnifying the scene roughly 2.5x to 6x within a few seconds — combined with a large, uncontrolled lateral drift, so the framing never settles. Instead of holding a stable composition, the viewpoint continuously accelerates forward and slides sideways, blowing past the intended framing into an unwanted extreme close-up by the end of the clip. This push-in is a distinct failure mode from the shake/jitter described above — it has little to no rotational wobble — a smooth but excessive, monotonic magnitude of forward dolly, zoom, and translation that never eases off, never holds, and never returns to a steady frame. On scenes with strong perspective lines (conveyor belts, quarries, aerial industrial sites, long corridors) the runaway zoom-and-translate makes the perspective rush inward, reading as erratic, claustrophobic, nauseating camerawork.",
+    "framing": "Poorly framed shots that cut off important elements and include unnecessary empty space. The shot also relentlessly tightens into an unintended extreme close-up as the camera barrels forward, cropping out the intended subject and context because the push-in never stops.",
+    "camera_angle": "Awkward, disorienting camera angles that provide no useful spatial information about the scene. The camera path exhibits visible mathematical artifacts suggesting simple interpolation between keyframes rather than natural camera operation. Camera motion is completely disconnected from the scene content — panning away from action, dollying during dialogue, and shaking during still moments. The camera appears to pass through solid objects occasionally. Zoom is applied digitally rather than optically, revealing progressively worse resolution. Camera motion exhibits non-physical acceleration profiles — instant starts and stops rather than smooth ease-in/ease-out. Rolling shutter simulation is applied inconsistently, present in some frames but not others. The camera occasionally exhibits impossible motion like teleporting between positions. Virtual camera stabilization creates an uncanny floating sensation disconnected from any physical camera rig.",
+    "depth_of_field": "Uniform focus throughout, creating a flat, documentary-like appearance with no cinematic depth separation.",
+    "focus": "Soft, out-of-focus imagery with visible chromatic aberration and lens distortion that was not corrected in post-processing.",
+    "lens_focal_length": "Inappropriate focal length causing barrel distortion and unnatural perspective compression."
+  },
+  "style_medium": "Low quality compressed digital video with visible encoding artifacts",
+  "artistic_style": "Amateur, unpolished with inconsistent visual style",
+  "context": "A poorly produced video with numerous technical and artistic flaws that detract from any intended narrative or visual impact.",
+  "actions": [
+    {
+      "time": "0:00-0:02",
+      "description": "As the camera starts moving, rigid foreground objects (cars, signs) warp and change shape; straight painted road lines bend and smear."
+    },
+    {
+      "time": "0:02-0:04",
+      "description": "A clearly-present background object vanishes without occlusion while a new object pops into the frame edge; feet/wheels slide over the ground without contact."
+    },
+    {
+      "time": "0:04-0:06",
+      "description": "A hand manipulating an object fuses with it into a morphing blob; poured/chopped material changes mass, portions disappearing and multiplying."
+    },
+    {
+      "time": "0:06-0:08",
+      "description": "Thin structures (wires, lane lines, foliage) flicker and shimmer; object count and world geometry no longer match the opening frame."
+    },
+    {
+      "time": "0:00-0:06",
+      "description": "Throughout, the camera pushes in far too aggressively — a fast continuous forward dolly and zoom (about 2.5x-6x) with a large lateral drift and no rotational shake — never holding a steady framing and ending in an unwanted extreme close-up."
+    }
+  ],
+  "text_and_signage_elements": [],
+  "segments": [
+    {
+      "segment_index": 0,
+      "time_range": "0:00-0:04",
+      "description": "Camera-motion segment where rigid-body stability collapses: vehicles, signage, and road markings morph, warp, and slide as the viewpoint translates.",
+      "key_changes": "World geometry un-locks — ground plane and lane lines drift; a background object vanishes and another appears without cause.",
+      "camera": "Forward-moving camera that drives rigid-object deformation; simultaneously an over-fast forward dolly-and-zoom with lateral drift that magnifies the scene far too quickly and never holds a stable frame."
+    },
+    {
+      "segment_index": 1,
+      "time_range": "0:04-0:08",
+      "description": "Manipulation and material-transfer segment where hand-object contact fails.",
+      "key_changes": "Hand and handled object merge into a morphing blob; transferred food/liquid violates mass conservation, portions vanishing and multiplying; thin high-frequency structures flicker.",
+      "camera": "Unstable framing with incorrect motion blur; the excessive push-in continues, sliding sideways and blowing past the composition into an extreme close-up."
+    }
+  ],
+  "transitions": [],
+  "temporal_caption": "The clip opens with objects appearing sharp and stable, but as the camera moves forward every rigid object begins to betray its geometry: parked cars warp and bulge, painted lane markings smear and slide across the asphalt, stop signs and poles bend and reshape frame to frame. Midway, a vehicle that was clearly present silently vanishes while a new object pops into existence at the frame edge without cause. Hands manipulating objects fuse with them into a morphing blob; poured or chopped food changes mass and volume, portions disappearing and multiplying. Thin structures — wires, foliage, railings, lane lines — flicker and shimmer throughout. Feet, wheels, and paws glide over the ground without firm contact. By the end, world geometry, object count, and material mass are all inconsistent with how the clip began. Over the whole clip the camera also barrels forward far too fast: a smooth, unrelenting push-in — fast forward dolly plus optical zoom, roughly 2.5x to 6x magnification in a few seconds — paired with a large lateral drift, with essentially no rotational shake. The framing never stabilizes; the viewpoint continuously accelerates past the intended composition and collapses into an uncomfortable extreme close-up by the end, which on industrial and aerial scenes with strong perspective lines reads as erratic, disorienting camerawork.",
+  "audio_description": "",
+  "physical_realism": "No adherence to physical laws. Objects defy gravity, pass through solid surfaces, and change mass and momentum without cause. Fluid dynamics, cloth simulation, and rigid body physics are all fundamentally broken. Furthermore, conservation of energy is violated as objects gain or lose kinetic energy spontaneously. Elastic collisions produce inelastic results and vice versa. Surface friction is inconsistent — objects slide on rough surfaces while sticking to smooth ones. Air resistance appears to affect only some objects while others move through the atmosphere unimpeded. Rigid bodies morph under camera motion; objects slide without ground contact; mass is not conserved in transfer; objects enter/vanish breaking permanence; thin structures flicker."
+}

checkpoints/mixed240/chat_template.jinja

@@ -0,0 +1,324 @@
+
+{% macro render_extra_keys(json_dict, handled_keys) %}
+    {%- if json_dict is mapping %}
+        {%- for json_key in json_dict if json_key not in handled_keys %}
+            {%- if json_dict[json_key] is mapping or (json_dict[json_key] is sequence and json_dict[json_key] is not string) %}
+                {{- '
+<' ~ json_key ~ '>' ~ (json_dict[json_key] | tojson | safe) ~ '</' ~ json_key ~ '>' }}
+            {%- else %}
+                {{-'
+<' ~ json_key ~ '>' ~ (json_dict[json_key] | string) ~ '</' ~ json_key ~ '>' }}
+            {%- endif %}
+        {%- endfor %}
+    {%- endif %}
+{% endmacro %}
+{%- set enable_thinking = enable_thinking if enable_thinking is defined else True %}
+{%- set truncate_history_thinking = truncate_history_thinking if truncate_history_thinking is defined else True %}
+
+{%- set ns = namespace(last_user_idx = -1) %}
+{%- set loop_messages = messages %}
+{%- for m in loop_messages %}
+  {%- if m["role"] == "user" %}
+    {%- set ns.last_user_idx = loop.index0 %}
+  {%- endif %}
+{%- endfor %}
+
+{%- if messages[0]["role"] == "system" %}
+    {%- if messages[0]["content"] is string %}
+        {%- set system_message = messages[0]["content"] %}
+    {%- else %}
+        {%- set ns = namespace(system_text="") %}
+        {%- for part in messages[0]["content"] %}
+            {%- if 'text' in part %}
+                {%- set ns.system_text = ns.system_text + part.text %}
+            {%- endif %}
+        {%- endfor %}
+        {%- set system_message = ns.system_text %}
+    {%- endif %}
+
+    {%- set loop_messages = messages[1:] %}
+{%- else %}
+    {%- set system_message = "" %}
+    {%- set loop_messages = messages %}
+{%- endif %}
+{%- if not tools is defined %}
+    {%- set tools = [] %}
+{%- endif %}
+{# Recompute last_user_idx relative to loop_messages after handling system #}
+{%- set ns = namespace(last_user_idx = -1) %}
+{%- for m in loop_messages %}
+  {%- if m["role"] == "user" %}
+    {%- set ns.last_user_idx = loop.index0 %}
+  {%- endif %}
+{%- endfor %}
+{%- if system_message is defined %}
+    {{- "<|im_start|>system
+" + system_message }}
+{%- else %}
+    {%- if tools is iterable and tools | length > 0 %}
+        {{- "<|im_start|>system
+" }}
+    {%- endif %}
+{%- endif %}
+{%- if tools is iterable and tools | length > 0 %}
+    {%- if system_message is defined and system_message | length > 0 %}
+        {{- "
+
+" }}
+    {%- endif %}
+    {{- "# Tools
+
+You have access to the following functions:
+
+" }}
+    {{- "<tools>" }}
+    {%- for tool in tools %}
+        {%- if tool.function is defined %}
+            {%- set tool = tool.function %}
+        {%- endif %}
+        {{- "
+<function>
+<name>" ~ tool.name ~ "</name>" }}
+        {%- if tool.description is defined %}
+            {{- '
+<description>' ~ (tool.description | trim) ~ '</description>' }}
+        {%- endif %}
+        {{- '
+<parameters>' }}
+        {%- if tool.parameters is defined and tool.parameters is mapping and tool.parameters.properties is defined and tool.parameters.properties is mapping %}
+            {%- for param_name, param_fields in tool.parameters.properties|items %}
+                {{- '
+<parameter>' }}
+                {{- '
+<name>' ~ param_name ~ '</name>' }}
+                {%- if param_fields.type is defined %}
+                    {{- '
+<type>' ~ (param_fields.type | string) ~ '</type>' }}
+                {%- endif %}
+                {%- if param_fields.description is defined %}
+                    {{- '
+<description>' ~ (param_fields.description | trim) ~ '</description>' }}
+                {%- endif %}
+                {%- if param_fields.enum is defined %}
+                    {{- '
+<enum>' ~ (param_fields.enum | tojson | safe) ~ '</enum>' }}
+                {%- endif %}
+                {%- set handled_keys = ['name', 'type', 'description', 'enum'] %}
+                {{- render_extra_keys(param_fields, handled_keys) }}
+                {{- '
+</parameter>' }}
+            {%- endfor %}
+        {%- endif %}
+        {% set handled_keys = ['type', 'properties', 'required'] %}
+        {{- render_extra_keys(tool.parameters, handled_keys) }}
+        {%- if tool.parameters is defined and tool.parameters.required is defined %}
+            {{- '
+<required>' ~ (tool.parameters.required | tojson | safe) ~ '</required>' }}
+        {%- endif %}
+        {{- '
+</parameters>' }}
+        {%- set handled_keys = ['type', 'name', 'description', 'parameters'] %}
+        {{- render_extra_keys(tool, handled_keys) }}
+        {{- '
+</function>' }}
+    {%- endfor %}
+    {{- "
+</tools>" }}
+
+    {{- '
+
+If you choose to call a function ONLY reply in the following format with NO suffix:
+
+<tool_call>
+<function=example_function_name>
+<parameter=example_parameter_1>
+value_1
+</parameter>
+<parameter=example_parameter_2>
+This is the value for the second parameter
+that can span
+multiple lines
+</parameter>
+</function>
+</tool_call>
+
+<IMPORTANT>
+Reminder:
+- Function calls MUST follow the specified format: an inner <function=...></function> block must be nested within <tool_call></tool_call> XML tags
+- Required parameters MUST be specified
+- You may provide optional reasoning for your function call in natural language BEFORE the function call, but NOT after
+- If there is no function call available, answer the question like normal with your current knowledge and do not tell the user about function calls
+</IMPORTANT>' }}
+{%- endif %}
+
+
+{%- if system_message is defined %}
+    {{- '<|im_end|>
+' }}
+{%- else %}
+    {%- if tools is iterable and tools | length > 0 %}
+        {{- '<|im_end|>
+' }}
+    {%- endif %}
+{%- endif %}
+
+{%- set image_count = namespace(value=0) %}
+{%- set video_count = namespace(value=0) %}
+{%- for message in loop_messages %}
+    {%- if message.role == "assistant" %}
+        {# Add reasoning content in to content field for unified processing below. #}
+        {%- set text_content = namespace(text_content="") -%}
+        {%- if message.content is string %}
+            {%- set text_content.text_content = message.content %}
+        {%- else %}
+            {%- for content in message.content %}
+                {%- if 'text' in content %}
+                    {%- set text_content.text_content = content.text %}
+                    {%- break %}
+                {%- endif %}
+            {%- endfor %}
+        {%- endif %}
+        {%- if message.reasoning_content is defined and message.reasoning_content is string and message.reasoning_content | trim | length > 0 %}
+            {%- set content = "<think>
+" ~ message.reasoning_content ~ "
+</think>
+" ~ (text_content.text_content | default('', true)) %}
+        {%- else %}
+            {%- set content = text_content.text_content | default('', true) %}
+            {# Allow downstream logic to to take care of broken thought, only handle coherent reasoning here. #}
+            {%- if '<think>' not in content and '</think>' not in content %}
+                {%- set content = "<think></think>" ~ content %}
+            {%- else %}
+                {%- set content = content %}
+            {%- endif -%}
+        {%- endif %}
+        {%- if message.tool_calls is defined and message.tool_calls is iterable and message.tool_calls | length > 0 %}
+            {# Assistant message has tool calls. #}
+            {{- '<|im_start|>assistant
+' }}
+                {%- set include_content = not (truncate_history_thinking and loop.index0 < ns.last_user_idx) %}
+                {%- if content is string and content | trim | length > 0 %}
+                    {%- if include_content %}
+                        {{- (content | trim) ~ '
+' -}}
+                    {%- else %}
+                        {%- set c = (content | string) %}
+                        {%- if '</think>' in c %}
+                            {# Keep only content after the last closing think. Also generation prompt causes this. #}
+                            {%- set c = c.split('</think>')[-1] %}
+                        {%- elif '<think>' in c %}
+                            {# If <think> was opened but never closed, drop the trailing think segment #}
+                            {%- set c = c.split('<think>')[0] %}
+                        {%- endif %}
+                        {%- set c = "<think></think>" ~ c | trim %}
+                        {%- if c | length > 0 %}
+                            {{- c ~ '
+' -}}
+                        {%- endif %}
+                    {%- endif %}
+                {%- else %}
+                    {{- "<think></think>" -}}
+                {%- endif %}
+                {%- for tool_call in message.tool_calls %}
+                    {%- if tool_call.function is defined %}
+                        {%- set tool_call = tool_call.function %}
+                    {%- endif %}
+                    {{- '<tool_call>
+<function=' ~ tool_call.name ~ '>
+' -}}
+                        {%- if tool_call.arguments is defined %}
+                            {%- for args_name, args_value in tool_call.arguments|items %}
+                                {{- '<parameter=' ~ args_name ~ '>
+' -}}
+                                    {%- set args_value = args_value | tojson | safe if args_value is mapping or (args_value is sequence and args_value is not string) else args_value | string %}
+                                {{- args_value ~ '
+</parameter>
+' -}}
+                            {%- endfor %}
+                        {%- endif %}
+                    {{- '</function>
+</tool_call>
+' -}}
+                {%- endfor %}
+                {{- '<|im_end|>
+' }}
+        {%- else %}
+            {# Assistant message doesn't have tool calls. #}
+            {%- if not (truncate_history_thinking and loop.index0 < ns.last_user_idx) %}
+                {{- '<|im_start|>assistant
+' ~ (content | default('', true) | string | trim) ~ '<|im_end|>
+' }}
+            {%- else %}
+                {%- set c = (content | default('', true) | string) %}
+                {%- if '<think>' in c and '</think>' in c %}
+                    {%- set c = "<think></think>" ~ c.split('</think>')[-1] %}
+                {%- endif %}
+                {%- set c = c | trim %}
+                {%- if c | length > 0 %}
+                    {{- '<|im_start|>assistant
+' ~ c ~ '<|im_end|>
+' }}
+                {%- else %}
+                    {{- '<|im_start|>assistant
+<|im_end|>
+' }}
+                {%- endif %}
+            {%- endif %}
+        {%- endif %}
+    {%- elif message.role == "user" or message.role == "system" %}
+        {{- '<|im_start|>' + message.role + '
+' }}
+        {%- if message.content is string %}
+            {{- message.content }}
+        {%- else %}
+            {%- for content in message.content %}
+                {%- if content.type == 'image' or 'image' in content or 'image_url' in content %}
+                    {%- set image_count.value = image_count.value + 1 %}
+                    {%- if add_vision_id %}Picture {{ image_count.value }}: {% endif -%}
+                    <|vision_start|><|image_pad|><|vision_end|>
+                {%- elif content.type == 'video' or 'video' in content %}
+                    {%- set video_count.value = video_count.value + 1 %}
+                    {%- if add_vision_id %}Video {{ video_count.value }}: {% endif -%}
+                    <|vision_start|><|video_pad|><|vision_end|>
+                {%- elif 'text' in content %}
+                    {{- content.text }}
+                {%- endif %}
+            {%- endfor %}
+        {%- endif %}
+        {{- '<|im_end|>
+' }}
+    {%- elif message.role == "tool" %}
+        {%- if loop.previtem and loop.previtem.role != "tool" %}
+            {{- '<|im_start|>user
+' }}
+        {%- endif %}
+        {{- '<tool_response>
+' }}
+        {{- message.content }}
+        {{- '
+</tool_response>
+' }}
+        {%- if not loop.last and loop.nextitem.role != "tool" %}
+            {{- '<|im_end|>
+' }}
+        {%- elif loop.last %}
+            {{- '<|im_end|>
+' }}
+        {%- endif %}
+    {%- else %}
+        {{- '<|im_start|>' + message.role + '
+' + message.content + '<|im_end|>
+' }}
+    {%- endif %}
+{%- endfor %}
+
+{%- if add_generation_prompt %}
+    {%- if enable_thinking %}
+        {{- '<|im_start|>assistant
+<think>
+' }}
+    {%- else %}
+        {{- '<|im_start|>assistant
+<think></think>' }}
+    {%- endif %}
+{%- endif %}

checkpoints/mixed240/config.json

@@ -0,0 +1,69 @@
+{
+  "allow_patterns_overrides": [
+    "*/*.safetensors"
+  ],
+  "architectures": [
+    "Cosmos3EdgeForConditionalGeneration"
+  ],
+  "image_token_id": 19,
+  "model_type": "cosmos3_edge",
+  "projector_config": {
+    "input_hidden_size": 1152,
+    "merger_intermediate_size": 11520,
+    "model_type": "cosmos3_edge_projector",
+    "out_hidden_size": 2048,
+    "spatial_merge_size": 2,
+    "use_postshuffle_norm": false
+  },
+  "projector_hidden_size": 11520,
+  "text_config": {
+    "attention_bias": false,
+    "attention_dropout": 0.0,
+    "dtype": "bfloat16",
+    "head_dim": 128,
+    "hidden_act": "relu2",
+    "hidden_dropout": 0.0,
+    "hidden_size": 2048,
+    "initializer_range": 0.02,
+    "intermediate_size": 9216,
+    "max_position_embeddings": 131072,
+    "mlp_bias": false,
+    "model_type": "cosmos3_edge_text",
+    "num_attention_heads": 16,
+    "num_hidden_layers": 28,
+    "num_key_value_heads": 8,
+    "residual_in_fp32": false,
+    "rms_norm_eps": 1e-05,
+    "rope_parameters": {
+      "mrope_section": [
+        24,
+        20,
+        20
+      ],
+      "rope_theta": 100000000,
+      "rope_type": "default"
+    },
+    "sliding_window": null,
+    "use_cache": true,
+    "vocab_size": 131072
+  },
+  "tie_word_embeddings": false,
+  "transformers_version": "4.57.6",
+  "video_token_id": 18,
+  "vision_config": {
+    "attention_dropout": 0.0,
+    "hidden_act": "gelu_pytorch_tanh",
+    "hidden_size": 1152,
+    "intermediate_size": 4304,
+    "layer_norm_eps": 1e-06,
+    "model_type": "cosmos3_edge_vision",
+    "num_attention_heads": 16,
+    "num_channels": 3,
+    "num_hidden_layers": 27,
+    "num_patches": 256,
+    "patch_size": 16,
+    "spatial_merge_size": 2
+  },
+  "vision_end_token_id": 21,
+  "vision_start_token_id": 20
+}