0.00.047.060 I common_init_result: fitting params to device memory ... 0.00.047.066 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.00.538.240 I common_params_fit_impl: projected to use 66727 MiB of host memory vs. 127438 MiB of total host memory 0.01.009.512 W llama_context: n_ctx_seq (512) < n_ctx_train (262144) -- the full capacity of the model will not be utilized 0.01.026.428 I 0.01.026.542 I system_info: n_threads = 16 (n_threads_batch = 16) / 32 | ROCm : NO_VMM = 1 | PEER_MAX_BATCH_SIZE = 128 | FA_ALL_QUANTS = 1 | CPU : SSE3 = 1 | SSSE3 = 1 | AVX = 1 | AVX_VNNI = 1 | AVX2 = 1 | F16C = 1 | FMA = 1 | BMI2 = 1 | AVX512 = 1 | AVX512_VBMI = 1 | AVX512_VNNI = 1 | AVX512_BF16 = 1 | LLAMAFILE = 1 | OPENMP = 1 | REPACK = 1 | 0.01.026.548 I compute_imatrix: tokenizing the input .. 0.01.115.784 I compute_imatrix: tokenization took 89.228 ms 0.01.115.820 I compute_imatrix: computing over 129 chunks, n_ctx=512, batch_size=512, n_seq=1 0.05.010.249 I compute_imatrix: 3.89 seconds per pass - ETA 8.37 minutes [1]4.8280,[2]3.5310,[3]3.3565,[4]3.5543,[5]3.5306,[6]3.2674,[7]3.7535,[8]3.7744,[9]4.1909,0.35.054.817 W save_imatrix: saving imatrix using GGUF format with a different suffix than .gguf 0.35.054.819 W save_imatrix: if you want the previous imatrix format, use --output-format dat 0.35.054.834 I 0.35.054.839 W save_imatrix: entry ' blk.36.ffn_up_exps.weight' has partial data (99.61%) 0.35.054.845 W save_imatrix: entry ' blk.34.ffn_down_exps.weight' has partial data (98.83%) 0.35.054.846 W save_imatrix: entry ' blk.34.ffn_up_exps.weight' has partial data (98.83%) 0.35.054.849 W save_imatrix: entry ' blk.33.ffn_gate_exps.weight' has partial data (99.61%) 0.35.054.852 W save_imatrix: entry ' blk.32.ffn_down_exps.weight' has partial data (99.61%) 0.35.054.856 W save_imatrix: entry ' blk.31.ffn_down_exps.weight' has partial data (99.61%) 0.35.054.857 W save_imatrix: entry ' blk.31.ffn_gate_exps.weight' has partial data (99.61%) 0.35.054.860 W save_imatrix: entry ' blk.30.ffn_down_exps.weight' has partial data (99.61%) 0.35.054.864 W save_imatrix: entry ' blk.29.ffn_up_exps.weight' has partial data (98.83%) 0.35.054.865 W save_imatrix: entry ' blk.29.ffn_gate_exps.weight' has partial data (98.83%) 0.35.054.874 W save_imatrix: entry ' blk.27.ffn_gate_exps.weight' has partial data (99.61%) 0.35.054.877 W save_imatrix: entry ' blk.26.ffn_up_exps.weight' has partial data (99.61%) 0.35.054.883 W save_imatrix: entry ' blk.24.ffn_gate_exps.weight' has partial data (98.83%) 0.35.054.893 W save_imatrix: entry ' blk.32.ffn_gate_exps.weight' has partial data (99.61%) 0.35.054.895 W save_imatrix: entry ' blk.33.ffn_down_exps.weight' has partial data (99.61%) 0.35.054.897 W save_imatrix: entry ' blk.30.ffn_gate_exps.weight' has partial data (99.61%) 0.35.054.903 W save_imatrix: entry ' blk.26.ffn_gate_exps.weight' has partial data (99.61%) 0.35.054.907 W save_imatrix: entry ' blk.20.ffn_down_exps.weight' has partial data (98.83%) 0.35.054.910 W save_imatrix: entry ' blk.22.ffn_down_exps.weight' has partial data (99.22%) 0.35.054.914 W save_imatrix: entry ' blk.27.ffn_down_exps.weight' has partial data (99.61%) 0.35.054.916 W save_imatrix: entry ' blk.26.ffn_down_exps.weight' has partial data (99.61%) 0.35.054.919 W save_imatrix: entry ' blk.20.ffn_gate_exps.weight' has partial data (98.83%) 0.35.054.926 W save_imatrix: entry ' blk.22.ffn_up_exps.weight' has partial data (99.22%) 0.35.054.928 W save_imatrix: entry ' blk.7.ffn_down_exps.weight' has partial data (99.22%) 0.35.054.929 W save_imatrix: entry ' blk.36.ffn_gate_exps.weight' has partial data (99.61%) 0.35.054.933 W save_imatrix: entry ' blk.31.ffn_up_exps.weight' has partial data (99.61%) 0.35.054.936 W save_imatrix: entry ' blk.20.ffn_up_exps.weight' has partial data (98.83%) 0.35.054.949 W save_imatrix: entry ' blk.15.ffn_down_exps.weight' has partial data (99.22%) 0.35.054.968 W save_imatrix: entry ' blk.34.ffn_gate_exps.weight' has partial data (98.83%) 0.35.054.969 W save_imatrix: entry ' blk.7.ffn_gate_exps.weight' has partial data (99.22%) 0.35.054.971 W save_imatrix: entry ' blk.33.ffn_up_exps.weight' has partial data (99.61%) 0.35.054.974 W save_imatrix: entry ' blk.24.ffn_down_exps.weight' has partial data (98.83%) 0.35.054.983 W save_imatrix: entry ' blk.32.ffn_up_exps.weight' has partial data (99.61%) 0.35.054.989 W save_imatrix: entry ' blk.18.ffn_down_exps.weight' has partial data (98.83%) 0.35.054.997 W save_imatrix: entry ' blk.29.ffn_down_exps.weight' has partial data (98.83%) 0.35.055.001 W save_imatrix: entry ' blk.7.ffn_up_exps.weight' has partial data (99.22%) 0.35.055.004 W save_imatrix: entry ' blk.18.ffn_up_exps.weight' has partial data (98.83%) 0.35.055.006 W save_imatrix: entry ' blk.27.ffn_up_exps.weight' has partial data (99.61%) 0.35.055.013 W save_imatrix: entry ' blk.16.ffn_gate_exps.weight' has partial data (98.83%) 0.35.055.016 W save_imatrix: entry ' blk.30.ffn_up_exps.weight' has partial data (99.61%) 0.35.055.019 W save_imatrix: entry ' blk.36.ffn_down_exps.weight' has partial data (99.61%) 0.35.055.022 W save_imatrix: entry ' blk.16.ffn_up_exps.weight' has partial data (98.83%) 0.35.055.026 W save_imatrix: entry ' blk.18.ffn_gate_exps.weight' has partial data (98.83%) 0.35.055.036 W save_imatrix: entry ' blk.24.ffn_up_exps.weight' has partial data (98.83%) 0.35.055.040 W save_imatrix: entry ' blk.15.ffn_gate_exps.weight' has partial data (99.22%) 0.35.055.041 W save_imatrix: entry ' blk.15.ffn_up_exps.weight' has partial data (99.22%) 0.35.055.042 W save_imatrix: entry ' blk.22.ffn_gate_exps.weight' has partial data (99.22%) 0.35.055.045 W save_imatrix: entry ' blk.16.ffn_down_exps.weight' has partial data (98.83%) [10]4.3240,[11]4.0211,[12]4.4049,[13]4.9418,[14]5.1664,[15]5.6128,[16]5.8282,[17]6.1242,[18]6.4430,[19]6.1720,1.16.116.747 W save_imatrix: saving imatrix using GGUF format with a different suffix than .gguf 1.16.116.747 W save_imatrix: if you want the previous imatrix format, use --output-format dat [20]6.1999,[21]6.2244,[22]6.2384,[23]6.2298,[24]6.4258,[25]6.5635,[26]6.5954,[27]6.6758,[28]6.7712,[29]7.0466,1.59.082.255 W save_imatrix: saving imatrix using GGUF format with a different suffix than .gguf 1.59.082.256 W save_imatrix: if you want the previous imatrix format, use --output-format dat [30]7.0971,[31]6.8928,[32]6.5976,[33]6.3884,[34]6.2660,[35]6.2001,[36]6.3146,[37]6.4046,[38]6.4913,[39]6.6513,2.41.868.430 W save_imatrix: saving imatrix using GGUF format with a different suffix than .gguf 2.41.868.431 W save_imatrix: if you want the previous imatrix format, use --output-format dat [40]6.8336,[41]6.9385,[42]7.2103,[43]7.3229,[44]7.4938,[45]7.5505,[46]7.5098,[47]7.4647,[48]7.6200,[49]7.6994,3.24.706.480 W save_imatrix: saving imatrix using GGUF format with a different suffix than .gguf 3.24.706.520 W save_imatrix: if you want the previous imatrix format, use --output-format dat [50]7.6500,[51]7.5877,[52]7.6542,[53]7.7868,[54]7.8872,[55]7.9814,[56]8.0100,[57]8.0181,[58]8.0214,[59]8.0351,4.08.161.216 W save_imatrix: saving imatrix using GGUF format with a different suffix than .gguf 4.08.161.218 W save_imatrix: if you want the previous imatrix format, use --output-format dat [60]8.0326,[61]7.9840,[62]7.9372,[63]7.9683,[64]8.0068,[65]7.9439,[66]7.9358,[67]7.9336,[68]7.8425,[69]7.8031,5.53.139.568 W save_imatrix: saving imatrix using GGUF format with a different suffix than .gguf 5.53.139.570 W save_imatrix: if you want the previous imatrix format, use --output-format dat [70]7.8080,[71]7.7716,[72]7.7330,[73]7.7239,[74]7.6582,[75]7.5914,[76]7.5604,[77]7.5344,[78]7.5000,[79]7.4563,6.36.748.709 W save_imatrix: saving imatrix using GGUF format with a different suffix than .gguf 6.36.748.710 W save_imatrix: if you want the previous imatrix format, use --output-format dat [80]7.3732,[81]7.3905,[82]7.3907,[83]7.3636,[84]7.3800,[85]7.4067,[86]7.3364,[87]7.3262,[88]7.3183,[89]7.3359,7.14.145.562 W save_imatrix: saving imatrix using GGUF format with a different suffix than .gguf 7.14.145.563 W save_imatrix: if you want the previous imatrix format, use --output-format dat [90]7.3358,[91]7.3166,[92]7.2408,[93]7.1671,[94]7.0855,[95]7.0144,[96]6.9469,[97]6.8749,[98]6.8120,[99]6.7501,7.49.421.037 W save_imatrix: saving imatrix using GGUF format with a different suffix than .gguf 7.49.421.039 W save_imatrix: if you want the previous imatrix format, use --output-format dat [100]6.7749,[101]6.7937,[102]6.8753,[103]6.9573,[104]7.0285,[105]7.1404,[106]7.2385,[107]7.2672,[108]7.2873,[109]7.2996,8.25.152.163 W save_imatrix: saving imatrix using GGUF format with a different suffix than .gguf 8.25.152.164 W save_imatrix: if you want the previous imatrix format, use --output-format dat [110]7.3026,[111]7.2653,[112]7.1830,[113]7.1010,[114]7.1408,[115]7.1761,[116]7.1992,[117]7.2053,[118]7.2436,[119]7.2755,9.00.696.257 W save_imatrix: saving imatrix using GGUF format with a different suffix than .gguf 9.00.696.259 W save_imatrix: if you want the previous imatrix format, use --output-format dat [120]7.2818,[121]7.2985,[122]7.3085,[123]7.2788,[124]7.3333,[125]7.3907,[126]7.4360,[127]7.5037,[128]7.5475,[129]7.6012, Final estimate: PPL = 7.6012 +/- 0.10821 9.36.441.617 W save_imatrix: saving imatrix using GGUF format with a different suffix than .gguf 9.36.441.617 W save_imatrix: if you want the previous imatrix format, use --output-format dat