Commit Β·
b60b796
0
Parent(s):
Duplicate from WarmBloodAban/Minimax-h3_Singularity
Browse filesCo-authored-by: AIGC Singularity <WarmBloodAban@users.noreply.huggingface.co>
- .gitattributes +42 -0
- Minimax-h3_Singularity_ref2va_Pruned_v1.3_int8.safetensors +3 -0
- Minimax-h3_Singularity_ref2va_v1.3_int8.safetensors +3 -0
- README.md +98 -0
- video/.gitkeep +0 -0
- video/1.mp4 +3 -0
- video/2.mp4 +3 -0
- video/3.mp4 +3 -0
- video/AIGCTYD2_00001_p84-audio_ganvc_1788634594 (1).mp4 +3 -0
- video/AIGCTYD2_00001_p85-audio_jrski_1788643962 (1).mp4 +3 -0
- video/AIGCTYD2_00003_p82-audio_aqukl_1788646377 (29).mp4 +3 -0
- video/AIGCTYD2_00010_p87-audio_alipa_1788652671.mp4 +3 -0
.gitattributes
ADDED
|
@@ -0,0 +1,42 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
*.7z filter=lfs diff=lfs merge=lfs -text
|
| 2 |
+
*.arrow filter=lfs diff=lfs merge=lfs -text
|
| 3 |
+
*.bin filter=lfs diff=lfs merge=lfs -text
|
| 4 |
+
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
| 5 |
+
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
| 6 |
+
*.ftz filter=lfs diff=lfs merge=lfs -text
|
| 7 |
+
*.gz filter=lfs diff=lfs merge=lfs -text
|
| 8 |
+
*.h5 filter=lfs diff=lfs merge=lfs -text
|
| 9 |
+
*.joblib filter=lfs diff=lfs merge=lfs -text
|
| 10 |
+
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
| 11 |
+
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
| 12 |
+
*.model filter=lfs diff=lfs merge=lfs -text
|
| 13 |
+
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
| 14 |
+
*.npy filter=lfs diff=lfs merge=lfs -text
|
| 15 |
+
*.npz filter=lfs diff=lfs merge=lfs -text
|
| 16 |
+
*.onnx filter=lfs diff=lfs merge=lfs -text
|
| 17 |
+
*.ot filter=lfs diff=lfs merge=lfs -text
|
| 18 |
+
*.parquet filter=lfs diff=lfs merge=lfs -text
|
| 19 |
+
*.pb filter=lfs diff=lfs merge=lfs -text
|
| 20 |
+
*.pickle filter=lfs diff=lfs merge=lfs -text
|
| 21 |
+
*.pkl filter=lfs diff=lfs merge=lfs -text
|
| 22 |
+
*.pt filter=lfs diff=lfs merge=lfs -text
|
| 23 |
+
*.pth filter=lfs diff=lfs merge=lfs -text
|
| 24 |
+
*.rar filter=lfs diff=lfs merge=lfs -text
|
| 25 |
+
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
| 26 |
+
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
| 27 |
+
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
| 28 |
+
*.tar filter=lfs diff=lfs merge=lfs -text
|
| 29 |
+
*.tflite filter=lfs diff=lfs merge=lfs -text
|
| 30 |
+
*.tgz filter=lfs diff=lfs merge=lfs -text
|
| 31 |
+
*.wasm filter=lfs diff=lfs merge=lfs -text
|
| 32 |
+
*.xz filter=lfs diff=lfs merge=lfs -text
|
| 33 |
+
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
+
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
+
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
| 36 |
+
video/1.mp4 filter=lfs diff=lfs merge=lfs -text
|
| 37 |
+
video/2.mp4 filter=lfs diff=lfs merge=lfs -text
|
| 38 |
+
video/3.mp4 filter=lfs diff=lfs merge=lfs -text
|
| 39 |
+
video/AIGCTYD2_00001_p84-audio_ganvc_1788634594[[:space:]](1).mp4 filter=lfs diff=lfs merge=lfs -text
|
| 40 |
+
video/AIGCTYD2_00001_p85-audio_jrski_1788643962[[:space:]](1).mp4 filter=lfs diff=lfs merge=lfs -text
|
| 41 |
+
video/AIGCTYD2_00003_p82-audio_aqukl_1788646377[[:space:]](29).mp4 filter=lfs diff=lfs merge=lfs -text
|
| 42 |
+
video/AIGCTYD2_00010_p87-audio_alipa_1788652671.mp4 filter=lfs diff=lfs merge=lfs -text
|
Minimax-h3_Singularity_ref2va_Pruned_v1.3_int8.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:412a7b126595a958964193f3b42513d7cf2df4196ef04223a0f05e3622949cce
|
| 3 |
+
size 20967647456
|
Minimax-h3_Singularity_ref2va_v1.3_int8.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:551915097b8727537a82f3a2c5acec965165ec84e780b3e9a5f28ce867fddf08
|
| 3 |
+
size 34004507622
|
README.md
ADDED
|
@@ -0,0 +1,98 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: apache-2.0
|
| 3 |
+
language:
|
| 4 |
+
- en
|
| 5 |
+
- zh
|
| 6 |
+
pipeline_tag: image-to-video
|
| 7 |
+
tags:
|
| 8 |
+
- video-generation
|
| 9 |
+
- text-to-video
|
| 10 |
+
- image-to-video
|
| 11 |
+
- video-to-video
|
| 12 |
+
- reference-to-video
|
| 13 |
+
- minimax-h3
|
| 14 |
+
- comfyui
|
| 15 |
+
- fine-tuned
|
| 16 |
+
- hdr
|
| 17 |
+
- singularity
|
| 18 |
+
---
|
| 19 |
+
|
| 20 |
+
# Minimax-h3_Singularity
|
| 21 |
+
|
| 22 |
+
<p align="center">
|
| 23 |
+
<a href="https://www.runninghub.ai/post/2096339589492432897/?inviteCode=rh-v1559">
|
| 24 |
+
<img src="https://img.shields.io/badge/π_Online_Demo-RunningHub-blue.svg" alt="Online Demo">
|
| 25 |
+
</a>
|
| 26 |
+
<a href="https://youtube.com/@AIGC-Singularity">
|
| 27 |
+
<img src="https://img.shields.io/badge/YouTube-AIGC--Singularity-red.svg" alt="YouTube">
|
| 28 |
+
</a>
|
| 29 |
+
<a href="https://space.bilibili.com">
|
| 30 |
+
<img src="https://img.shields.io/badge/Bilibili-AIGC--Singularity_Space-00a1d6.svg" alt="Bilibili">
|
| 31 |
+
</a>
|
| 32 |
+
</p>
|
| 33 |
+
|
| 34 |
+
## π Model Overview
|
| 35 |
+
|
| 36 |
+
**Minimax-h3_Singularity** is a comprehensive fine-tuned fusion model specialized in enhancing the capabilities of **MiniMax-H3**. Designed as a versatile **multimodal video generation model**, it natively supports **Text-to-Video (T2V)**, **Image-to-Video (I2V)**, **Reference-to-Video (Ref2V)**, and **Video-to-Video (V2V)** workflows within **ComfyUI**.
|
| 37 |
+
|
| 38 |
+
Built upon a strategic fusion of key checkpoints (including `ref`, `fl`, `b25-49`, etc.), this model underwent deep high-step fine-tuning. To preserve the original model's foundational strengths and broad generalization while solving artifacts introduced by high-step training, we spent **3 full days on precise model pruning and weight optimization**. The result is a clean, sharp, and highly dynamic video generation model.
|
| 39 |
+
|
| 40 |
+
---
|
| 41 |
+
|
| 42 |
+
## β¨ Key Improvements & Features
|
| 43 |
+
|
| 44 |
+
* π¬ **HDR Image Quality & Blur Reduction**: Fine-tuned on high-dynamic-range (HDR) video datasets to significantly enhance visual clarity and eliminate motion blur during high-speed action.
|
| 45 |
+
* π€ **Distant Face Restoration**: Drastically reduces facial distortion, blurriness, and collapsing in medium-to-long shots.
|
| 46 |
+
* π¨ **Clean & De-Oiled Aesthetic**: Removes heavy, unnatural skin shine and glossy textures, rendering natural lighting and photorealistic materials.
|
| 47 |
+
* βοΈ **Enhanced Dynamic Motion**: Boosts motion fluidity and physical impact, excels in complex action sequences such as **sword fighting and martial arts/melee combat**.
|
| 48 |
+
* π **VFX & Fantasy Effects**: Specifically optimized for fantasy spellcasting, particle aura, and magical combat visual effects.
|
| 49 |
+
* π **Expressive Facial Dynamics**: Captures subtle facial expressions and emotional nuances more vividly.
|
| 50 |
+
* πΉ **Cinematography & Camera Control**: Strengthens responsiveness to camera movements (pan, tilt, zoom, tracking shots) for cinematic storytelling.
|
| 51 |
+
* π‘οΈ **Full Base Capability Retention**: 100% preserves MiniMax-H3's original prompt adherence, style adaptability, and base multimodal generation strength.
|
| 52 |
+
|
| 53 |
+
---
|
| 54 |
+
|
| 55 |
+
## π¬ Showcase
|
| 56 |
+
|
| 57 |
+
<video src="https://huggingface.co/WarmBloodAban/Minimax-h3_Singularity/resolve/main/video/1.mp4" controls autoplay loop muted width="20%"></video>
|
| 58 |
+
<video src="https://huggingface.co/WarmBloodAban/Minimax-h3_Singularity/resolve/main/video/3.mp4" controls autoplay loop muted width="20%"></video>
|
| 59 |
+
<video src="https://huggingface.co/WarmBloodAban/Minimax-h3_Singularity/resolve/main/video/AIGCTYD2_00001_p84-audio_ganvc_1788634594%20(1).mp4" controls autoplay loop muted width="20%"></video>
|
| 60 |
+
<video src="https://huggingface.co/WarmBloodAban/Minimax-h3_Singularity/resolve/main/video/AIGCTYD2_00010_p87-audio_alipa_1788652671.mp4" controls autoplay loop muted width="20%"></video>
|
| 61 |
+
|
| 62 |
+
---
|
| 63 |
+
|
| 64 |
+
## π‘ Usage Guide
|
| 65 |
+
|
| 66 |
+
### Multimodal Pipeline Support
|
| 67 |
+
This model is fully compatible with **ComfyUI** and supports:
|
| 68 |
+
* **Text-to-Video (T2V)**
|
| 69 |
+
* **Image-to-Video (I2V)**
|
| 70 |
+
* **Reference-to-Video (Ref2V)**
|
| 71 |
+
* **Video-to-Video (V2V)**
|
| 72 |
+
|
| 73 |
+
### π Recommended Acceleration LoRA
|
| 74 |
+
For high-speed generation with minimal quality loss, we strongly recommend pairing with:
|
| 75 |
+
* **`minimax_h3_ref2v_turbo_4step_v0.1`** (Enables 4-step fast inference)
|
| 76 |
+
|
| 77 |
+
### π Online Interactive Demo
|
| 78 |
+
Test the model directly in your browser without local GPU setup:
|
| 79 |
+
π [**Try it on RunningHub Workflows**](https://www.runninghub.ai/post/2096339589492432897/?inviteCode=rh-v1559)
|
| 80 |
+
|
| 81 |
+
---
|
| 82 |
+
|
| 83 |
+
## π Acknowledgements
|
| 84 |
+
|
| 85 |
+
Special thanks to the **MiniMax** open-source team for creating and releasing the powerful `MiniMax-H3` multimodal video model, providing a solid foundation for the open-source community! π€
|
| 86 |
+
|
| 87 |
+
---
|
| 88 |
+
|
| 89 |
+
## π€ Community & Commercial Inquiries
|
| 90 |
+
|
| 91 |
+
Feel free to connect for tutorials, community discussions, workflow sharing, or commercial collaborations:
|
| 92 |
+
|
| 93 |
+
* **YouTube Channel**: [AIGC-Singularity](https://youtube.com/@AIGC-Singularity)
|
| 94 |
+
* **Bilibili Channel**: AIGC-Singularity Space
|
| 95 |
+
* **QQ Group 1**: `1058747239` (Request to join)
|
| 96 |
+
* **QQ Group 2**: `1072010342` (Request to join)
|
| 97 |
+
* **Business Inquiries (WeChat)**: `aigctyd`
|
| 98 |
+
* **Email**: `a592991299@gmail.com`
|
video/.gitkeep
ADDED
|
File without changes
|
video/1.mp4
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:48e1856ff43c796da2609a3f05ee6b09567bc8e537cbd8204b13bb21b36496a0
|
| 3 |
+
size 10942666
|
video/2.mp4
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:005c07600e9aefd3cbb40e71f89b84d07a5a7c9c8cc039236ea92c118af972cb
|
| 3 |
+
size 8539965
|
video/3.mp4
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4569d372d41402d17c2fa127dc46104b491a690023567a023432ab92a42f625b
|
| 3 |
+
size 12322575
|
video/AIGCTYD2_00001_p84-audio_ganvc_1788634594 (1).mp4
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8fa0174b2f055c24f6103fe7815b9236b2f9785ebb6c1e6a695001c3ef32e3e7
|
| 3 |
+
size 7177840
|
video/AIGCTYD2_00001_p85-audio_jrski_1788643962 (1).mp4
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5da1f0ac234db8d8e38ccd659323d7a1b9309590c18d6f82046c3133a94b718e
|
| 3 |
+
size 12167506
|
video/AIGCTYD2_00003_p82-audio_aqukl_1788646377 (29).mp4
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ff231c3b0bc4d29a385747f0ab1deb96b283232cf7379d9dc1bd4d965b8ba26e
|
| 3 |
+
size 8319209
|
video/AIGCTYD2_00010_p87-audio_alipa_1788652671.mp4
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:fe63d409463388a58ad8d0b4ea1ed19c0d777933eb884f098c7f87425a462e89
|
| 3 |
+
size 4586206
|