caiovicentino1 commited on
Commit
4460913
Β·
verified Β·
1 Parent(s): 1dbf152

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +73 -11
README.md CHANGED
@@ -16,24 +16,72 @@ arxiv: "2603.29078"
16
 
17
  **PQ5 quantized** LTX-2.3 β€” joint audio-video generation, 22B params.
18
 
19
- **46 GB β†’ ~19 GB (-59%)** | cos_sim **0.9986** | 1347 layers quantized
 
 
 
 
20
 
21
  ## Compression
22
 
23
- | Component | Original | PQ5 Packed |
24
- |---|---|---|
25
- | **Transformer (48 blocks)** | ~44 GB | ~17 GB |
26
- | **Audio/Video VAE** | ~0.1 GB | 0.1 GB (BF16) |
27
- | **Text embeddings** | ~2 GB | 2 GB (BF16) |
28
- | **Upscalers** | ~2.3 GB | 2.3 GB (BF16) |
29
- | **Total** | **46.2 GB** | **~19 GB (-59%)** |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
30
 
31
  ## Architecture
32
 
 
33
  - 48 transformer blocks, hidden=4096, MLP=16384
34
- - Joint audio-video generation
35
- - Single safetensors file (5947 tensors)
36
- - BF16 native
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
37
 
38
  ## Links
39
 
@@ -42,3 +90,17 @@ arxiv: "2603.29078"
42
  - [Original LTX-2.3](https://huggingface.co/Lightricks/LTX-2.3)
43
  - [LTX-2 Paper](https://arxiv.org/abs/2601.03233)
44
  - [LTX GitHub](https://github.com/Lightricks/LTX-2)
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
16
 
17
  **PQ5 quantized** LTX-2.3 β€” joint audio-video generation, 22B params.
18
 
19
+ **46 GB β†’ 15 GB (-68%)** | cos_sim **0.9986** | 1,347 layers quantized
20
+
21
+ ## Download Size
22
+
23
+ ![Download](https://huggingface.co/caiovicentino1/LTX-2.3-22B-PolarQuant-Q5/resolve/main/assets/chart_download.png)
24
 
25
  ## Compression
26
 
27
+ ![Compression](https://huggingface.co/caiovicentino1/LTX-2.3-22B-PolarQuant-Q5/resolve/main/assets/chart_compression.png)
28
+
29
+ | Component | Original | PQ5 Packed | Reduction |
30
+ |---|---|---|---|
31
+ | **Transformer (1,347 layers)** | 37 GB | 4.6 GB | -88% |
32
+ | **VAE + Skip (4,600 layers)** | 9.1 GB | 9.1 GB | BF16 kept |
33
+ | **Upscalers** | 1.3 GB | 1.3 GB | BF16 kept |
34
+ | **Total** | **46.2 GB** | **15 GB** | **-68%** |
35
+
36
+ ## Quick Start
37
+
38
+ ```bash
39
+ # 1. Install
40
+ pip install safetensors huggingface_hub scipy
41
+
42
+ # 2. Download & setup (15 GB)
43
+ git clone https://huggingface.co/caiovicentino1/LTX-2.3-22B-PolarQuant-Q5 ./LTX-PQ5
44
+ cd LTX-PQ5 && python setup.py
45
+
46
+ # 3. Generate video
47
+ python generate_ltx.py --prompt "A cat playing piano in a jazz club"
48
+ ```
49
 
50
  ## Architecture
51
 
52
+ - **22B parameters** β€” largest video model we've quantized
53
  - 48 transformer blocks, hidden=4096, MLP=16384
54
+ - **Joint audio-video generation** β€” synchronized audio + video
55
+ - head_dim=64 (Hadamard-compatible)
56
+ - 5,947 tensors total (BF16)
57
+ - Spatial + temporal upscalers included
58
+
59
+ ## Files
60
+
61
+ ```
62
+ LTX-2.3-22B-PolarQuant-Q5/
63
+ β”œβ”€β”€ setup.py # One-command setup
64
+ β”œβ”€β”€ generate_ltx.py # Easy generation wrapper
65
+ β”œβ”€β”€ polarquant/
66
+ β”‚ β”œβ”€β”€ codes/
67
+ β”‚ β”‚ β”œβ”€β”€ chunk_00_codes.safetensors (1.5 GB)
68
+ β”‚ β”‚ β”œβ”€β”€ chunk_01_codes.safetensors (1.5 GB)
69
+ β”‚ β”‚ β”œβ”€β”€ chunk_02_codes.safetensors (1.5 GB)
70
+ β”‚ β”‚ └── chunk_03_codes.safetensors (0.1 GB)
71
+ β”‚ └── bf16/
72
+ β”‚ └── ltx23_bf16.safetensors (9.1 GB)
73
+ └── upscalers/
74
+ β”œβ”€β”€ ltx-2.3-spatial-upscaler-x2-1.1.safetensors (1.0 GB)
75
+ └── ltx-2.3-temporal-upscaler-x2-1.0.safetensors (0.3 GB)
76
+ ```
77
+
78
+ ## Hardware
79
+
80
+ | GPU | VRAM | Status |
81
+ |-----|------|--------|
82
+ | A100 (40 GB) | 40 GB | Recommended |
83
+ | A100 (80 GB) | 80 GB | Full speed |
84
+ | RTX 4090 (24 GB) | 24 GB | With offloading |
85
 
86
  ## Links
87
 
 
90
  - [Original LTX-2.3](https://huggingface.co/Lightricks/LTX-2.3)
91
  - [LTX-2 Paper](https://arxiv.org/abs/2601.03233)
92
  - [LTX GitHub](https://github.com/Lightricks/LTX-2)
93
+
94
+ ## Citation
95
+
96
+ ```bibtex
97
+ @article{polarquant2026,
98
+ title={PolarQuant: Hadamard-Rotated Lloyd-Max Quantization},
99
+ author={Vicentino, Caio},
100
+ journal={arXiv preprint arXiv:2603.29078},
101
+ year={2026}
102
+ }
103
+ ```
104
+
105
+ ---
106
+ *46 GB β†’ 15 GB with cos_sim 0.9986. Quantized with [PolarQuant](https://github.com/caiovicentino/polarengine-vllm).*