Hugging Face's logo

Spaces:
fastgpu
/
vram-and-gpu-cost-calculator
Running

App Files Community
1
vram-and-gpu-cost-calculator
File size: 4,561 Bytes
9bae954
8bbafb9
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
0cb14a1
8bbafb9
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
9bae954
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
<!doctype html>
<html lang="en">
<head>
  <meta charset="utf-8">
  <meta name="viewport" content="width=device-width, initial-scale=1">
  <title>VRAM & GPU Cost Calculator: what any Hugging Face model needs, priced live</title>
  <meta name="description" content="Pick any Hugging Face model and see how much GPU memory it needs to run or fine-tune, and the cheapest GPU setups that hold it, priced live by FastGPU.">
  <link rel="preconnect" href="https://fonts.googleapis.com">
  <link rel="preconnect" href="https://fonts.gstatic.com" crossorigin>
  <link href="https://fonts.googleapis.com/css2?family=Instrument+Sans:wght@400;500;600&family=JetBrains+Mono:wght@400;500&family=Schibsted+Grotesk:wght@600;700&display=swap" rel="stylesheet">
  <link rel="stylesheet" href="style.css">
</head>
<body>
  <header class="top">
    <a class="brand" href="https://fastgpu.co/?utm_source=huggingface&amp;utm_medium=space&amp;utm_campaign=gpu-cost-calculator" target="_blank" rel="noopener">
      <svg viewBox="0 0 128 128" width="28" height="28" aria-hidden="true"><rect width="128" height="128" rx="30" class="mark-bg"/><path d="M35 32 L93 32 L83 50 L53 50 L53 56 L75 56 L65 74 L53 74 L53 96 L35 96 Z" class="mark"/></svg>
      <span>FastGPU</span>
    </a>
    <span class="live"><span class="dot" aria-hidden="true"></span>Live GPU prices</span>
  </header>

  <main>
    <h1>What GPU does this model need, and what does it cost to rent right now?</h1>
    <p class="lede">Pick any Hugging Face model. You get the GPU memory it needs and the cheapest GPU setups that hold it, priced live across the clouds FastGPU tracks.</p>

    <form id="calc" class="panel" autocomplete="off">
      <label class="field-label" for="model">Model</label>
      <div class="combo">
        <input id="model" name="model" type="text" role="combobox" aria-autocomplete="list" aria-expanded="false" aria-controls="suggestions" spellcheck="false" placeholder="Search models, paste org/name or a model page link, or type a size like 70B…">
        <ul id="suggestions" role="listbox" aria-label="Models" hidden></ul>
      </div>
      <div id="picks" class="picks" aria-label="Popular models"></div>

      <div class="opts">
        <label>Job
          <select id="task" name="task">
            <option value="inference">Run / serve it</option>
            <option value="finetune-lora">Fine-tune with LoRA</option>
            <option value="finetune-full">Full fine-tune</option>
            <option value="generate">Generate images or video</option>
            <option value="transcribe">Transcribe speech</option>
            <option value="embed">Embed text</option>
          </select>
        </label>
        <label>Weights
          <select id="precision" name="precision">
            <option value="auto">As published</option>
            <option value="fp16">16-bit (BF16 / FP16)</option>
            <option value="int8">8-bit (FP8 / INT8)</option>
            <option value="int4">4-bit (INT4 / AWQ / GGUF Q4)</option>
          </select>
        </label>
        <label>Region
          <select id="region" name="region">
            <option value="">Anywhere</option>
            <option value="US">US</option>
            <option value="EU">EU</option>
            <option value="ASIA">Asia</option>
          </select>
        </label>
        <label class="check"><input id="spot" name="spot" type="checkbox"> Include spot (interruptible) capacity</label>
      </div>
    </form>

    <p id="status" class="status" role="status"></p>
    <section id="result" class="result" aria-live="polite"></section>
  </main>

  <footer>
    <p>Sizing and prices come from <a href="https://fastgpu.co/?utm_source=huggingface&amp;utm_medium=space&amp;utm_campaign=gpu-cost-calculator" target="_blank" rel="noopener">FastGPU</a>, which compares live GPU rental prices across marketplaces, neoclouds and hyperscalers. Model facts come from the Hugging Face Hub.</p>
    <p class="links">
      <a href="https://huggingface.co/datasets/fastgpu/cloud-gpu-prices" target="_blank" rel="noopener">Open price dataset (CC BY 4.0)</a>
      <a href="https://fastgpu.co/docs?utm_source=huggingface&amp;utm_medium=space&amp;utm_campaign=gpu-cost-calculator" target="_blank" rel="noopener">Free API</a>
      <a href="https://fastgpu.co/methodology?utm_source=huggingface&amp;utm_medium=space&amp;utm_campaign=gpu-cost-calculator" target="_blank" rel="noopener">Method</a>
    </p>
  </footer>

  <script src="catalog.js"></script>
  <script src="app.js"></script>
</body>
</html>