Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -16,24 +16,72 @@ arxiv: "2603.29078"
|
|
| 16 |
|
| 17 |
**PQ5 quantized** LTX-2.3 β joint audio-video generation, 22B params.
|
| 18 |
|
| 19 |
-
**46 GB β
|
|
|
|
|
|
|
|
|
|
|
|
|
| 20 |
|
| 21 |
## Compression
|
| 22 |
|
| 23 |
-
|
| 24 |
-
|
| 25 |
-
|
|
| 26 |
-
|
|
| 27 |
-
| **
|
| 28 |
-
| **
|
| 29 |
-
| **
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 30 |
|
| 31 |
## Architecture
|
| 32 |
|
|
|
|
| 33 |
- 48 transformer blocks, hidden=4096, MLP=16384
|
| 34 |
-
- Joint audio-video generation
|
| 35 |
-
-
|
| 36 |
-
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 37 |
|
| 38 |
## Links
|
| 39 |
|
|
@@ -42,3 +90,17 @@ arxiv: "2603.29078"
|
|
| 42 |
- [Original LTX-2.3](https://huggingface.co/Lightricks/LTX-2.3)
|
| 43 |
- [LTX-2 Paper](https://arxiv.org/abs/2601.03233)
|
| 44 |
- [LTX GitHub](https://github.com/Lightricks/LTX-2)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 16 |
|
| 17 |
**PQ5 quantized** LTX-2.3 β joint audio-video generation, 22B params.
|
| 18 |
|
| 19 |
+
**46 GB β 15 GB (-68%)** | cos_sim **0.9986** | 1,347 layers quantized
|
| 20 |
+
|
| 21 |
+
## Download Size
|
| 22 |
+
|
| 23 |
+

|
| 24 |
|
| 25 |
## Compression
|
| 26 |
|
| 27 |
+

|
| 28 |
+
|
| 29 |
+
| Component | Original | PQ5 Packed | Reduction |
|
| 30 |
+
|---|---|---|---|
|
| 31 |
+
| **Transformer (1,347 layers)** | 37 GB | 4.6 GB | -88% |
|
| 32 |
+
| **VAE + Skip (4,600 layers)** | 9.1 GB | 9.1 GB | BF16 kept |
|
| 33 |
+
| **Upscalers** | 1.3 GB | 1.3 GB | BF16 kept |
|
| 34 |
+
| **Total** | **46.2 GB** | **15 GB** | **-68%** |
|
| 35 |
+
|
| 36 |
+
## Quick Start
|
| 37 |
+
|
| 38 |
+
```bash
|
| 39 |
+
# 1. Install
|
| 40 |
+
pip install safetensors huggingface_hub scipy
|
| 41 |
+
|
| 42 |
+
# 2. Download & setup (15 GB)
|
| 43 |
+
git clone https://huggingface.co/caiovicentino1/LTX-2.3-22B-PolarQuant-Q5 ./LTX-PQ5
|
| 44 |
+
cd LTX-PQ5 && python setup.py
|
| 45 |
+
|
| 46 |
+
# 3. Generate video
|
| 47 |
+
python generate_ltx.py --prompt "A cat playing piano in a jazz club"
|
| 48 |
+
```
|
| 49 |
|
| 50 |
## Architecture
|
| 51 |
|
| 52 |
+
- **22B parameters** β largest video model we've quantized
|
| 53 |
- 48 transformer blocks, hidden=4096, MLP=16384
|
| 54 |
+
- **Joint audio-video generation** β synchronized audio + video
|
| 55 |
+
- head_dim=64 (Hadamard-compatible)
|
| 56 |
+
- 5,947 tensors total (BF16)
|
| 57 |
+
- Spatial + temporal upscalers included
|
| 58 |
+
|
| 59 |
+
## Files
|
| 60 |
+
|
| 61 |
+
```
|
| 62 |
+
LTX-2.3-22B-PolarQuant-Q5/
|
| 63 |
+
βββ setup.py # One-command setup
|
| 64 |
+
βββ generate_ltx.py # Easy generation wrapper
|
| 65 |
+
βββ polarquant/
|
| 66 |
+
β βββ codes/
|
| 67 |
+
β β βββ chunk_00_codes.safetensors (1.5 GB)
|
| 68 |
+
β β βββ chunk_01_codes.safetensors (1.5 GB)
|
| 69 |
+
β β βββ chunk_02_codes.safetensors (1.5 GB)
|
| 70 |
+
β β βββ chunk_03_codes.safetensors (0.1 GB)
|
| 71 |
+
β βββ bf16/
|
| 72 |
+
β βββ ltx23_bf16.safetensors (9.1 GB)
|
| 73 |
+
βββ upscalers/
|
| 74 |
+
βββ ltx-2.3-spatial-upscaler-x2-1.1.safetensors (1.0 GB)
|
| 75 |
+
βββ ltx-2.3-temporal-upscaler-x2-1.0.safetensors (0.3 GB)
|
| 76 |
+
```
|
| 77 |
+
|
| 78 |
+
## Hardware
|
| 79 |
+
|
| 80 |
+
| GPU | VRAM | Status |
|
| 81 |
+
|-----|------|--------|
|
| 82 |
+
| A100 (40 GB) | 40 GB | Recommended |
|
| 83 |
+
| A100 (80 GB) | 80 GB | Full speed |
|
| 84 |
+
| RTX 4090 (24 GB) | 24 GB | With offloading |
|
| 85 |
|
| 86 |
## Links
|
| 87 |
|
|
|
|
| 90 |
- [Original LTX-2.3](https://huggingface.co/Lightricks/LTX-2.3)
|
| 91 |
- [LTX-2 Paper](https://arxiv.org/abs/2601.03233)
|
| 92 |
- [LTX GitHub](https://github.com/Lightricks/LTX-2)
|
| 93 |
+
|
| 94 |
+
## Citation
|
| 95 |
+
|
| 96 |
+
```bibtex
|
| 97 |
+
@article{polarquant2026,
|
| 98 |
+
title={PolarQuant: Hadamard-Rotated Lloyd-Max Quantization},
|
| 99 |
+
author={Vicentino, Caio},
|
| 100 |
+
journal={arXiv preprint arXiv:2603.29078},
|
| 101 |
+
year={2026}
|
| 102 |
+
}
|
| 103 |
+
```
|
| 104 |
+
|
| 105 |
+
---
|
| 106 |
+
*46 GB β 15 GB with cos_sim 0.9986. Quantized with [PolarQuant](https://github.com/caiovicentino/polarengine-vllm).*
|