Felldude commited on
Commit
46ddddd
·
verified ·
1 Parent(s): 33d3338

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +320 -1
README.md CHANGED
@@ -1,3 +1,322 @@
 
1
  ---
2
- license: apache-2.0
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ```yaml
2
  ---
3
+ license: other
4
+ language:
5
+ - en
6
+ library_name: diffusers
7
+ pipeline_tag: text-to-image
8
+ tags:
9
+ - flux
10
+ - flux2
11
+ - vae
12
+ - hdr
13
+ - ultrahd
14
+ - cinematic
15
+ - high-detail
16
+ - image-enhancement
17
+ - texture-recovery
18
+ - sharpness-enhancement
19
+ - color-enhancement
20
+ - microcontrast
21
+ - raw
22
+ - generative-ai
23
+ - stable-diffusion
24
+ - diffusion
25
+ - latent-space
26
+ - photorealistic
27
+ - neural-compression
28
+ - reconstruction
29
+ - fp16
30
+ - inference
31
+ - image-generation
32
+ - visual-quality
33
+ - machine-learning
34
+ - ai-art
35
+ - flux-compatible
36
+ base_model:
37
+ - FLUX.2
38
+ - FLUX.2 Klein
39
+ - Ernie
40
+ model_type: Variational Autoencoder (VAE)
41
+ datasets:
42
+ - internal-evaluation-suite
43
+ metrics:
44
+ - lpips
45
+ - gradient-energy
46
+ - unique-colors
47
+ - brightness-bias
48
+ - contrast-gain
49
+ - rgb-channel-shift
50
+ inference: true
51
  ---
52
+
53
+ # FLUX.2 UltraHD RAW VAE
54
+
55
+ ## Overview
56
+
57
+ FLUX.2 UltraHD RAW VAE is a high-fidelity enhancement-focused Variational Autoencoder engineered for the FLUX.2 ecosystem. Unlike reconstruction-pure VAEs optimized exclusively for perceptual similarity, UltraHD RAW VAE is tuned for cinematic rendering, HDR enhancement, sharper edge response, texture recovery, and richer gradient reproduction.
58
+
59
+ The model is fully compatible with all FLUX.2 variants including:
60
+
61
+ - FLUX.2
62
+ - FLUX.2 Klein
63
+ - FLUX.2 Ernie
64
+
65
+ ---
66
+
67
+ # Scientific Assessment
68
+
69
+ ## Design Objective
70
+
71
+ The primary design goal of UltraHD RAW VAE is not strict latent reconstruction accuracy, but perceptual enhancement quality.
72
+
73
+ Key optimization targets include:
74
+
75
+ - Increased texture fidelity
76
+ - Enhanced microcontrast
77
+ - Expanded color richness
78
+ - Sharper edge gradients
79
+ - Improved HDR-style rendering
80
+ - Stable luminance preservation
81
+ - Dynamic range consistency
82
+
83
+ ---
84
+
85
+ # Quick Assessment
86
+
87
+ ## Observed Visual Characteristics
88
+
89
+ ### Color Enhancement
90
+
91
+ UltraHD RAW VAE increases effective color richness through:
92
+
93
+ - Higher unique color utilization
94
+ - Expanded HDR gradient smoothness
95
+ - Slight saturation enhancement
96
+ - Preserved luminance integrity
97
+ - Preserved dynamic range behavior
98
+
99
+ ### Detail Recovery
100
+
101
+ The VAE demonstrates:
102
+
103
+ - Stronger edge energy
104
+ - Sharper fine detail reconstruction
105
+ - Increased perceived texture depth
106
+ - Enhanced microcontrast behavior
107
+
108
+ ---
109
+
110
+ # Training Notes
111
+
112
+ Although the visual enhancement effect may appear subtler compared to previous enhancement VAEs, the underlying optimization process was substantially more difficult.
113
+
114
+ More than double-digit failed training attempts were required to achieve:
115
+
116
+ - Stable HDR enhancement
117
+ - Low LPIPS divergence
118
+ - Contrast preservation
119
+ - Brightness neutrality
120
+ - Balanced channel behavior
121
+
122
+ Achieving an LPIPS value near the already extremely low FLUX.2 baseline proved exceptionally challenging.
123
+
124
+ ---
125
+
126
+ # Direct Metric Comparison
127
+
128
+ ## Evaluation Setup
129
+
130
+ - 150-image benchmark comparison
131
+ - Tested directly against Base FLUX.2 VAE
132
+ - Metrics computed across identical latent reconstruction conditions
133
+
134
+ ---
135
+
136
+ # LPIPS (Perceptual Similarity)
137
+
138
+ | Model | LPIPS |
139
+ |---|---|
140
+ | FLUX Base | 0.0073 |
141
+ | UltraHD RAW VAE | 0.0303 |
142
+
143
+ ### Difference
144
+
145
+ - 4.1× higher than FLUX Base
146
+
147
+ ### Interpretation
148
+
149
+ The model intentionally trades strict reconstruction fidelity for perceptual enhancement quality.
150
+
151
+ Despite the increase, both values remain significantly below typical human perceptual thresholds.
152
+
153
+ ---
154
+
155
+ # Gradient Energy
156
+
157
+ | Model | Gradient Energy |
158
+ |---|---|
159
+ | FLUX Base | 405.5 |
160
+ | UltraHD RAW VAE | 633.5 |
161
+
162
+ ### Difference
163
+
164
+ - +56% increase
165
+
166
+ ### Interpretation
167
+
168
+ Substantially sharper detail rendering and stronger edge definition.
169
+
170
+ ---
171
+
172
+ # Unique Colors
173
+
174
+ | Model | Unique Colors |
175
+ |---|---|
176
+ | FLUX Base | 37,369 |
177
+ | UltraHD RAW VAE | 39,184 |
178
+
179
+ ### Difference
180
+
181
+ - +4.9% increase
182
+
183
+ ### Interpretation
184
+
185
+ Improved color richness and smoother HDR tonal transitions.
186
+
187
+ ---
188
+
189
+ # Brightness Bias
190
+
191
+ | Model | Brightness Bias |
192
+ |---|---|
193
+ | FLUX Base | 0.0047 |
194
+ | UltraHD RAW VAE | 0.0030 |
195
+
196
+ ### Interpretation
197
+
198
+ Excellent luminance preservation with slightly improved brightness neutrality.
199
+
200
+ ---
201
+
202
+ # Contrast Gain
203
+
204
+ | Model | Contrast Gain |
205
+ |---|---|
206
+ | FLUX Base | 0.984 |
207
+ | UltraHD RAW VAE | 0.983 |
208
+
209
+ ### Interpretation
210
+
211
+ Near-identical dynamic range and HDR tone retention.
212
+
213
+ ---
214
+
215
+ # RGB Channel Shift Analysis
216
+
217
+ ## Red Shift
218
+
219
+ | Model | Red Shift |
220
+ |---|---|
221
+ | FLUX Base | +0.0048 |
222
+ | UltraHD RAW VAE | +0.0188 |
223
+
224
+ Interpretation:
225
+
226
+ - Slightly warmer red response
227
+ - Improved cinematic warmth
228
+
229
+ ---
230
+
231
+ ## Green Shift
232
+
233
+ | Model | Green Shift |
234
+ |---|---|
235
+ | FLUX Base | -0.0037 |
236
+ | UltraHD RAW VAE | -0.0104 |
237
+
238
+ Interpretation:
239
+
240
+ - Minor reduction in green balance
241
+ - Helps reduce sterile tonal appearance
242
+
243
+ ---
244
+
245
+ ## Blue Shift
246
+
247
+ | Model | Blue Shift |
248
+ |---|---|
249
+ | FLUX Base | +0.0181 |
250
+ | UltraHD RAW VAE | +0.0434 |
251
+
252
+ Interpretation:
253
+
254
+ - Stronger blue/cyan HDR emphasis
255
+ - Enhanced atmospheric rendering
256
+
257
+ ---
258
+
259
+ # Summary
260
+
261
+ FLUX.2 UltraHD RAW VAE is an enhancement-oriented VAE optimized for:
262
+
263
+ - HDR rendering
264
+ - Texture recovery
265
+ - Cinematic sharpness
266
+ - Richer gradients
267
+ - Enhanced microcontrast
268
+ - Improved perceptual detail
269
+
270
+ Compared to the base FLUX VAE, UltraHD RAW VAE produces:
271
+
272
+ - Significantly stronger edge detail
273
+ - Improved color richness
274
+ - Better texture clarity
275
+ - Enhanced HDR-style rendering
276
+ - Stable brightness preservation
277
+ - Preserved contrast behavior
278
+
279
+ The model is best suited for users prioritizing perceptual image quality and cinematic rendering over strict pixel-perfect reconstruction fidelity.
280
+
281
+ ---
282
+
283
+ # Recommended Usage
284
+
285
+ Recommended for:
286
+
287
+ - Photorealistic generations
288
+ - Cinematic compositions
289
+ - HDR workflows
290
+ - Texture-heavy scenes
291
+ - High-detail portrait rendering
292
+ - Atmospheric lighting
293
+ - Stylized realism
294
+
295
+ Less suitable for:
296
+
297
+ - Pixel-faithful reconstruction tasks
298
+ - Scientific image preservation
299
+ - Reconstruction benchmarking applications
300
+
301
+ ---
302
+
303
+ # Compatibility
304
+
305
+ Compatible with:
306
+
307
+ - FLUX.2
308
+ - FLUX.2 Klein
309
+ - Ernie
310
+
311
+ Precision support:
312
+
313
+ - FP16
314
+ - BF16
315
+ - FP32
316
+
317
+ ---
318
+
319
+ # Disclaimer
320
+
321
+ This VAE intentionally modifies reconstruction characteristics to improve perceptual aesthetics. Metric increases in LPIPS are expected and are part of the enhancement-oriented design philosophy.
322
+ ```