Replace layer 4 with same_input fp16-block PV (v4)

Replace layer 3 with same_input fp16-block PV (v4)

Replace layer 77 with v2 initial per-expert fit (v3 expert); PV follows

Replace layer 76 with v2 initial per-expert fit (v3 expert); PV follows

Replace layer 75 with v2 initial per-expert fit (v3 expert); PV follows

Replace layer 74 with v2 initial per-expert fit (v3 expert); PV follows

Replace layer 73 with v2 initial per-expert fit (v3 expert); PV follows

Replace layer 72 with v2 initial per-expert fit (v3 expert); PV follows

Replace layer 71 with v2 initial per-expert fit (v3 expert); PV follows

Replace layer 70 with v2 initial per-expert fit (v3 expert); PV follows

Replace layer 69 with v2 initial per-expert fit (v3 expert); PV follows

Replace layer 68 with v2 initial per-expert fit (v3 expert); PV follows

Replace layer 67 with v2 initial per-expert fit (v3 expert); PV follows

Replace layer 66 with v2 initial per-expert fit (v3 expert); PV follows

Replace layer 65 with v2 initial per-expert fit (v3 expert); PV follows

Replace layer 64 with v2 initial per-expert fit (v3 expert); PV follows

Replace layer 63 with v2 initial per-expert fit (v3 expert); PV follows

Replace layer 62 with v2 initial per-expert fit (v3 expert); PV follows

Replace layer 61 with v2 initial per-expert fit (v3 expert); PV follows

Replace layer 60 with v2 initial per-expert fit (v3 expert); PV follows

Replace layer 59 with v2 initial per-expert fit (v3 expert); PV follows

Replace layer 58 with v2 initial per-expert fit (v3 expert); PV follows

Replace layer 57 with v2 initial per-expert fit (v3 expert); PV follows

Replace layer 56 with v2 initial per-expert fit (v3 expert); PV follows

Replace layer 55 with v2 initial per-expert fit (v3 expert); PV follows

Replace layer 54 with v2 initial per-expert fit (v3 expert); PV follows

Replace layer 53 with v2 initial per-expert fit (v3 expert); PV follows

Replace layer 52 with v2 initial per-expert fit (v3 expert); PV follows

Replace layer 51 with v2 initial per-expert fit (v3 expert); PV follows

Replace layer 50 with v2 initial per-expert fit (v3 expert); PV follows

Replace layer 49 with v2 initial per-expert fit (v3 expert); PV follows

Replace layer 48 with v2 initial per-expert fit (v3 expert); PV follows

Replace layer 47 with v2 initial per-expert fit (v3 expert); PV follows

Replace layer 46 with v2 initial per-expert fit (v3 expert); PV follows

Replace layer 45 with v2 initial per-expert fit (v3 expert); PV follows

Replace layer 44 with v2 initial per-expert fit (v3 expert); PV follows

Replace layer 43 with v2 initial per-expert fit (v3 expert); PV follows

Replace layer 42 with v2 initial per-expert fit (v3 expert); PV follows

Replace layer 41 with v2 initial per-expert fit (v3 expert); PV follows

Replace layer 40 with v2 initial per-expert fit (v3 expert); PV follows

Replace layer 39 with v2 initial per-expert fit (v3 expert); PV follows

Replace layer 38 with v2 initial per-expert fit (v3 expert); PV follows

Replace layer 37 with v2 initial per-expert fit (v3 expert); PV follows

Replace layer 36 with v2 initial per-expert fit (v3 expert); PV follows

Replace layer 35 with v2 initial per-expert fit (v3 expert); PV follows

Replace layer 34 with v2 initial per-expert fit (v3 expert); PV follows

Replace layer 33 with v2 initial per-expert fit (v3 expert); PV follows

Replace layer 32 with v2 initial per-expert fit (v3 expert); PV follows

Replace layer 31 with v2 initial per-expert fit (v3 expert); PV follows

Replace layer 30 with v2 initial per-expert fit (v3 expert); PV follows