Image21-INT4 / evaluation /qualitative.md
ixim's picture
Release verified Image21-INT4 conversion
9116984 verified
|
Raw History Blame Contribute Delete
3.94 kB

Visual inspection

These notes describe images I looked at. They are not a score, and they do not cover every seed. Pixel drift for all 14 pairs is in comparison.csv.

portrait, seed 42: Both are waist-up photographs of an older woman in a blue wool sweater beside a window. The face, the hair, and how much of the window is in frame differ. Skin and knit texture stay photographic in both.

english_text, seed 42: Both render the headline CREATE WITH LIGHT and the subtitle September 2026. The orange lamp, books, and notebook are arranged differently. I did not see an extra headline.

chinese_text, seed 42: Both render 慢下来,喝杯咖啡 and 小店今日营业 above a latte. Both also add a footer of unwanted, partly illegible text, so neither follows “不添加其他文字” completely.

composition, seed 42: Both show exactly three cups, red then blue then yellow, and one green apple in front of the blue cup. Cup shape and spacing differ. The INT4 cups have handles; the BF16 cups do not.

texture, seed 42: Both are plausible kingfishers on a mossy branch over water. The INT4 bird faces left and the BF16 bird faces right. Feather and bark detail are visible in both.

rgba, seed 42: Both are full-body green cartoon dragons with orange wings, saved as RGBA. Measured alpha runs from 0 to 255. Pixels with alpha at or below 5 are 63.5% of the BF16 image and 73.0% of the INT4 image. The BF16 dragon has a white sticker outline.

edit, seed 1000042: The input is the BF16 portrait from seed 42, and the edit seed is not 42. Both change the sweater from blue to red and keep the same face, window light, and pose. This pair is not visibly oversharpened. That does not show that every edit will preserve identity.

The 8GB-cap portrait (group offload, CPU VAE encode and decode) is a separate run from this paired set. On that image the woman, blue sweater, and window are all present. The same cap also completed both edit seeds, 1000042 and 1000123, at 1024 for 40 steps. Allocated peaks were 3.48 GiB and reserved peaks were 4.08 and 4.24 GiB.

目视记录

下面只记录看过的图,不是评分,也没有逐张覆盖第二个种子。14 对的像素差在 comparison.csv。

portrait,种子 42:两种精度都是窗边、蓝毛衣、半身的老年女性照片。脸、头发和窗户入画的多少不同。皮肤和针织纹理都还像照片。

english_text,种子 42:两种精度都写出了 CREATE WITH LIGHT 和 September 2026。橙色台灯、书和笔记本的摆放不同。没有看到多出来的主标题。

chinese_text,种子 42:两种精度都写出了“慢下来,喝杯咖啡”和“小店今日营业”,中间是拿铁。两种精度的页脚都出现了多余且部分无法辨认的文字,都没有完全遵守“不添加其他文字”。

composition,种子 42:两种精度都是左红、中蓝、右黄三个杯子,蓝杯前有一个青苹果。杯子形状和间距不同。INT4 的杯子有把手,BF16 没有。

texture,种子 42:两种精度都是水边苔枝上的翠鸟。INT4 的鸟朝左,BF16 的鸟朝右。羽毛和树皮细节都还在。

rgba,种子 42:两种精度都是全身、绿鳞、橙翼的卡通龙,文件为 RGBA。alpha 范围是 0 到 255。alpha 小于等于 5 的像素,BF16 占 63.5%,INT4 占 73.0%。BF16 的龙有一圈白色贴纸描边。

edit,种子 1000042:输入是 BF16 种子 42 的肖像,编辑种子不是 42。两种精度都把蓝毛衣改成了红毛衣,脸、窗光和姿态还在。这一对没有明显过锐。这不能说明每次编辑都会保住身份。

8GB 分配上限下的肖像是另一次运行(分组卸载,VAE 的编码和解码都在 CPU)。那张图里仍有人物、蓝毛衣和窗户。同一次上限设置也完成了两个编辑种子 1000042 和 1000123,1024、40 步。已分配峰值都是 3.48 GiB,保留峰值分别是 4.08 GiB 和 4.24 GiB。