---
base_model: mistralai/Mistral-Medium-3.5-128B-text
base_model_relation: quantized
quantized_by: UnstableLlama
tags:
- exl3
---

<style>
  @import url('https://fonts.googleapis.com/css2?family=JetBrains+Mono:wght@400;700&family=Inter:wght@400;700&display=swap');

  .dashboard-container {
    font-family: 'Inter', sans-serif;
    width: min(1500px, calc(100vw - 32px));
    max-width: 100%;
    margin: 0 auto;
    box-sizing: border-box;
    background-color: #1a1b1e;
    background-image: radial-gradient(#2d2f34 1px, transparent 1px);
    background-size: 20px 20px;
    color: #e0e0e0;
    padding: 40px 24px;
    border: 1px solid #4a4d53;
    border-radius: 12px;
    box-shadow: 0 10px 30px rgba(0,0,0,0.5);
  }

  .dashboard-header {
    margin-bottom: 35px;
  }

  .dashboard-header h1 {
    font-family: 'JetBrains Mono', monospace;
    color: #ffffff;
    font-size: 1.6em;
    margin: 0;
    padding-left: 15px;
    border-left: 4px solid #4dabf7;
  }

  .meta-tag {
    font-family: 'JetBrains Mono', monospace;
    font-size: 0.8em;
    color: #4dabf7;
    background: rgba(77, 171, 247, 0.1);
    padding: 4px 12px;
    border: 1px solid rgba(77, 171, 247, 0.3);
    border-radius: 4px;
    margin-top: 12px;
    display: inline-block;
  }

  .content-panel {
    background-color: #25262b;
    border: 1px solid #4a4d53;
    border-radius: 8px;
    margin-bottom: 25px;
    overflow: hidden;
  }

  .panel-title {
    background-color: #4dabf7;
    color: #000000;
    padding: 8px 20px;
    font-family: 'JetBrains Mono', monospace;
    font-weight: 800;
    font-size: 0.85em;
    text-transform: uppercase;
    letter-spacing: 1px;
  }

  .panel-body {
    padding: 20px;
  }

  .repo-data-panel {
    padding: 14px 10px;
  }

  .repo-data-body {
    display: flex;
    flex-direction: column;
    align-items: center;
    gap: 20px;
    width: 100%;
    --edge-gap: 8px;
  }

  .repo-graph {
    display: block;
    width: min(1440px, calc(100% - (var(--edge-gap) * 2)));
    height: auto;
    margin: 0 auto;
  }

  .table-wrapper {
    display: inline-block;
    margin: 0 auto;
    border: 1px solid #666a73;
    border-radius: 4px;
    overflow: hidden;
    max-width: calc(100% - (var(--edge-gap) * 2));
  }

  .data-table {
    border-collapse: collapse;
    font-family: 'JetBrains Mono', monospace;
    font-size: 0.85em;
    width: auto;
    margin: 0;
  }

  .data-table th {
    text-align: left;
    color: #ffffff;
    background-color: #2d2f34;
    padding: 9px 12px;
    border-bottom: 2px solid #666a73;
    border-right: 1px solid #4a4d53;
  }

  .data-table td {
    padding: 7px 12px;
    border-bottom: 1px solid #4a4d53;
    border-right: 1px solid #4a4d53;
  }

  .data-table tr td:last-child,
  .data-table tr th:last-child {
    border-right: none;
  }

  .data-table tr:last-child td {
    border-bottom: none;
  }

  .data-table tr:hover td {
    background-color: rgba(77, 171, 247, 0.05);
  }

  .link-style {
    color: #4dabf7;
    text-decoration: none;
  }

  .link-style:hover {
    text-decoration: underline;
    color: #ffffff;
  }

  .terminal-box {
    background-color: #0c0d0e;
    border: 1px solid #4a4d53;
    border-radius: 6px;
    padding: 18px;
    font-family: 'JetBrains Mono', monospace;
    font-size: 0.85em;
    color: #cbd5e0;
  }
</style>

<div class="dashboard-container">

  <div class="dashboard-header">
    <h1>mistralai / Mistral-Medium-3.5-128B-text</h1>
    <div class="meta-tag">QUANTIZED BY: UnstableLlama</div>
  </div>

  <div class="content-panel">
    <div class="panel-title">Information</div>
    <div class="panel-body">
      Vision tower stripped to save space. Fits in 48gb VRAM with 16k context, kv quantized to 6,6
      <br/>
      The KL is kind of high, so I verified it against <b><a class="link-style" href="https://huggingface.co/BaronRabban/Mistral-Medium-3.5-128B-exl3">another quant</a></b>, and it measured in line.
      <br/>
      <br/>
      2.50bpw exl3 quantization of <b><a class="link-style" href="https://huggingface.co/mistralai/Mistral-Medium-3.5-128B">Mistral-Medium-3.5-128B TEXT ONLY</a></b> via
      <b><a class="link-style" href="https://github.com/turboderp-org/exllamav3">exllamav3</a></b>.
      <br/>
      repo generated automatically with
      <a class="link-style" href="https://github.com/UnstableLlama/ezexl3">ezexl3</a>.
    </div>
  </div>

  <div class="content-panel">
    <div class="panel-title">Repo Data</div>
    <div class="panel-body repo-data-body repo-data-panel">
      <div class="table-wrapper">
        <table class="data-table">
                    <thead>
            <tr>
              <th>REVISION</th>
              <th>GiB</th>
              <th>KL DIV</th>
              <th>PPL</th>
            </tr>
          </thead>
          <tbody>
            <tr>
              <td><a class="link-style" href="https://huggingface.co/BaronRabban/Mistral-Medium-3.5-128B-exl3/tree/2.25bpw">2.25bpw</a></td>
              <td>36.86</td>
              <td>0.5566</td>
              <td>7.1743</td>
            </tr>
            <tr>
              <td><a class="link-style" href="https://huggingface.co/UnstableLlama/Mistral-Medium-3.5-128B-exl3-2.50bpw">2.50bpw</a></td>
              <td>39.61</td>
              <td>0.4274</td>
              <td>6.4994</td>
            </tr>
            <tr>
              <td><a class="link-style" href="https://huggingface.co/mistralai/Mistral-Medium-3.5-128B-text">bf16</a></td>
              <td>119.44</td>
              <td>0.0000</td>
              <td>4.3142</td>
            </tr>
          </tbody>
        </table>
      </div>
    </div>
  </div>

  <div class="content-panel">
    <div class="panel-title">CLI Download</div>
    <div class="panel-body">
      <div class="terminal-box">
        hf download UnstableLlama/Mistral-Medium-3.5-128B-exl3-2.50bpw --local-dir ./Mistral-Medium-3.5-128B-exl3-2.50bpw
      </div>
    </div>
  </div>

</div>