Inference Providers
·
Metrics for top trending models
 | novita cheapest | $1.40 | $4.40 | 1,048,576 | 1.74 | 44 | Yes | No |
| | $1.40 | $4.40 | 1,048,575 | 0.29 | 64 | Yes | No | |
| | - | - | 1,048,576 | 0.91 | 56 | Yes | Yes | |
| | - | - | - | 1.69 | 40 | Yes | No | |
| | baseten fastest | $1.40 | $4.40 | 1,048,576 | 1.08 | 80 | Yes | Yes |
| | - | - | - | - | - | - | - | |
| | together cheapest | $0.15 | $0.50 | 1,048,575 | 0.23 | 63 | Yes | No |
| | - | - | 1,048,576 | 1.21 | 69 | Yes | Yes | |
| | - | - | - | - | - | - | - | |
| | baseten fastest | $0.15 | $0.50 | 1,048,576 | 0.22 | 115 | Yes | Yes |
 | ovhcloud cheapest | $0.00 | $0.00 | 262,144 | 0.40 | 11 | Yes | Yes |
| | deepinfra fastest | $0.40 | $3.00 | 262,144 | 0.35 | 54 | Yes | Yes |
 | together cheapest | $3.00 | $15.00 | 1,048,576 | 1.65 | 23 | Yes | No |
| | $3.00 | $15.00 | 1,048,576 | 1.69 | 48 | Yes | Yes | |
| | baseten fastest | $3.00 | $15.00 | 1,048,576 | 0.73 | 87 | Yes | Yes |
| | - | - | - | - | - | - | - | |
 | novita fastest | $0.44 | $1.32 | 1,048,576 | 1.19 | 74 | Yes | No |
| | $0.14 | $0.28 | 1,048,576 | 0.43 | 36 | Yes | No | |
| | - | - | 1,048,576 | 0.93 | 58 | Yes | Yes | |
| | $0.13 | $0.26 | 1,048,576 | 0.59 | 69 | Yes | Yes | |
| | deepinfra cheapest | $0.08 | $0.18 | 1,048,576 | 0.66 | 27 | Yes | Yes |
 | $0.14 | $0.40 | 262,144 | 1.09 | 98 | Yes | No | |
| | cerebras fastest | $0.99 | $1.49 | 131,072 | 0.32 | 711 | Yes | Yes |
| | $0.39 | $0.97 | 262,144 | 0.25 | 82 | Yes | Yes | |
| | deepinfra cheapest | $0.13 | $0.38 | 262,144 | 0.57 | 26 | Yes | Yes |
 | together fastest | $0.35 | $1.50 | 131,072 | 0.26 | 104 | Yes | Yes |
| | - | - | 131,072 | 0.29 | 59 | Yes | No | |
| | deepinfra cheapest | $0.30 | $1.20 | 131,072 | 0.41 | 32 | Yes | Yes |
 | novita cheapest fastest | $0.02 | $0.05 | 16,384 | 0.43 | 149 | No | No |
| | $0.06 | $0.06 | 131,072 | 0.60 | 47 | No | Yes | |
| | $0.02 | $0.05 | 131,072 | 0.39 | 21 | Yes | No | |
 | $0.16 | $0.65 | 131,072 | 0.18 | 86 | Yes | No | |
| | - | - | - | 1.38 | 39 | Yes | No | |
| | $0.03 | $0.12 | 131,072 | 0.20 | 234 | Yes | No | |
| | scaleway fastest | $0.29 | $1.71 | - | 0.34 | 173 | Yes | Yes |
| | deepinfra cheapest | $0.10 | $0.95 | 262,144 | 0.65 | 25 | Yes | Yes |
| | novita fastest | $0.14 | $0.28 | 1,048,576 | 1.49 | 83 | Yes | No |
| | deepinfra cheapest | $0.09 | $0.18 | 1,048,576 | 0.51 | 36 | Yes | Yes |
| | together fastest | $0.17 | $0.25 | 262,144 | 2.89 | 76 | Yes | No |
| | $0.12 | $0.18 | 262,144 | 0.42 | 38 | Yes | Yes | |
| | deepinfra cheapest | $0.10 | $0.15 | 262,144 | 0.48 | 29 | Yes | Yes |
 | groq fastest | $0.10 | $0.50 | 131,072 | 0.17 | 728 | Yes | Yes |
| | $0.04 | $0.15 | 131,072 | 0.39 | 113 | No | Yes | |
| | $0.05 | $0.20 | 131,072 | 0.61 | 154 | Yes | Yes | |
| | $0.05 | $0.20 | 131,072 | 0.28 | 124 | Yes | Yes | |
| | $0.05 | $0.18 | 131,072 | 0.34 | 78 | Yes | Yes | |
| | deepinfra cheapest | $0.03 | $0.14 | 131,072 | 0.26 | 84 | Yes | Yes |
| | $1.32 | $3.96 | 1,048,576 | 0.56 | 34 | Yes | No | |
| | together fastest | $1.32 | $3.96 | 1,048,576 | 0.78 | 85 | Yes | No |
| | - | - | 1,048,576 | 1.20 | 53 | Yes | Yes | |
| | $1.32 | $3.96 | 1,048,576 | 0.48 | 67 | Yes | Yes | |
| | deepinfra cheapest | $1.30 | $2.60 | 1,048,576 | 0.31 | 37 | Yes | Yes |
| | - | - | - | 1.90 | 25 | Yes | No | |
| | novita fastest | $0.13 | $0.40 | 262,144 | 0.58 | 42 | Yes | No |
| | $0.29 | $0.57 | - | 0.95 | 34 | Yes | Yes | |
| | deepinfra cheapest | $0.07 | $0.34 | 262,144 | 0.49 | 19 | Yes | Yes |
| | $2.00 | $6.00 | 1,000,000 | 0.95 | 32 | Yes | Yes | |
| | $2.00 | $6.00 | 1,010,000 | 1.00 | 42 | Yes | No | |
| | fireworks-ai fastest | - | - | 262,144 | 0.69 | 97 | Yes | Yes |
| | deepinfra cheapest | $2.00 | $6.00 | 262,144 | 0.39 | 77 | Yes | Yes |
 | together cheapest | $0.50 | $1.20 | 524,288 | 0.19 | 93 | Yes | No |
| | baseten fastest | $0.50 | $1.20 | 1,048,576 | 0.55 | 117 | Yes | Yes |
| | $0.45 | $1.20 | 524,288 | 0.71 | 61 | Yes | Yes | |
 | $0.06 | $0.18 | 262,144 | 0.68 | 257 | Yes | No | |
| | - | - | - | - | - | - | - | |
| | $0.06 | $0.25 | 131,072 | 0.39 | 153 | Yes | No | |
| | $0.15 | $0.75 | 131,072 | 0.56 | 376 | Yes | Yes | |
| | $0.05 | $0.25 | 131,072 | 0.49 | 68 | Yes | Yes | |
| | cerebras fastest | $0.35 | $0.75 | 131,072 | 0.26 | 1,101 | Yes | Yes |
| | $0.10 | $0.40 | 131,072 | 0.58 | 110 | Yes | Yes | |
| | $0.15 | $0.60 | 131,072 | 0.23 | 69 | Yes | Yes | |
| | $0.15 | $0.60 | 131,072 | 0.46 | 173 | Yes | Yes | |
| | $0.17 | $0.68 | - | 0.68 | 69 | Yes | Yes | |
| | $0.10 | $0.50 | 128,072 | 0.34 | 235 | Yes | Yes | |
| | $0.09 | $0.47 | 131,072 | 0.46 | 44 | Yes | Yes | |
| | deepinfra cheapest | $0.04 | $0.17 | 131,072 | 0.27 | 52 | Yes | Yes |
| | $1.40 | $4.40 | 1,048,576 | 1.43 | 51 | Yes | No | |
| | together fastest | $1.40 | $4.40 | 1,048,575 | 0.30 | 90 | Yes | No |
| | $1.40 | $4.40 | 1,048,576 | 1.34 | 45 | Yes | Yes | |
| | - | - | - | 0.92 | 55 | Yes | No | |
| | $2.05 | $6.27 | - | 0.54 | 85 | Yes | Yes | |
| | $1.40 | $4.40 | 1,048,576 | 1.99 | 64 | Yes | Yes | |
| | deepinfra cheapest | $0.75 | $2.40 | 1,048,576 | 0.80 | 32 | Yes | Yes |
 | $0.14 | $0.58 | 262,144 | 0.69 | 36 | Yes | Yes | |
| | $0.07 | $0.18 | 40,960 | 0.65 | 129 | Yes | No | |
| | together cheapest | $1.00 | $4.05 | 524,288 | 0.30 | 128 | Yes | Yes |
| | - | - | 1,048,576 | 0.45 | 97 | Yes | Yes | |
| | baseten fastest | $1.00 | $4.05 | 1,048,576 | 0.16 | 165 | Yes | Yes |
| | $0.95 | $4.05 | 524,288 | 0.66 | 98 | Yes | No | |
| | $0.70 | $2.50 | 64,000 | 1.22 | 15 | Yes | Yes | |
| | $1.60 | $3.20 | 1,048,576 | 0.84 | 34 | Yes | No | |
| | - | - | - | - | - | - | - | |
| | - | - | - | - | - | - | - | |
| | baseten fastest | $1.74 | $3.48 | 1,048,576 | 0.75 | 70 | Yes | No |
| | deepinfra cheapest | $1.30 | $2.60 | 1,048,576 | 0.91 | 28 | Yes | Yes |
 | $0.00 | $0.00 | 262,144 | 0.39 | 80 | Yes | No | |
| | $0.01 | $0.03 | 131,072 | 0.56 | 147 | No | Yes | |
 | $0.30 | $1.20 | 1,000,000 | 2.07 | 60 | Yes | No | |
| | together fastest | $0.30 | $1.20 | 524,288 | 0.41 | 108 | Yes | No |
| | $0.30 | $1.20 | 512,000 | 0.66 | 94 | Yes | Yes | |
| | deepinfra cheapest | $0.28 | $1.10 | 524,288 | 0.48 | 25 | Yes | Yes |
| | - | - | - | - | - | - | - | |
| | novita cheapest | $0.14 | $0.40 | 12,288 | 0.51 | 50 | Yes | No |
| | $1.04 | $1.04 | 131,072 | 0.73 | 72 | Yes | Yes | |
| | scaleway fastest | $1.03 | $1.03 | - | 0.36 | 75 | Yes | Yes |
| | $0.74 | $0.74 | 131,072 | 0.33 | 31 | Yes | Yes | |
| | novita cheapest | $0.07 | $0.40 | 200,000 | 0.95 | 70 | Yes | No |
| | zai-org fastest | - | - | - | 0.59 | 85 | Yes | No |
| | $0.06 | $0.40 | 202,752 | 0.28 | 75 | Yes | No | |
 | - | - | 262,144 | 0.70 | 331 | Yes | Yes | |
| | - | - | - | - | - | - | - | |
| | $0.60 | $2.40 | 262,144 | 0.54 | 119 | Yes | No | |
| | ovhcloud cheapest | $0.47 | $3.19 | 262,144 | 0.37 | 74 | Yes | Yes |
| | deepinfra fastest | $0.32 | $3.20 | 262,144 | 0.35 | 75 | Yes | Yes |
| | nscale cheapest fastest | $0.07 | $0.20 | 40,960 | 0.64 | 94 | Yes | Yes |
| | $0.12 | $0.24 | 40,960 | 0.33 | 24 | Yes | No | |
| | $0.20 | $1.50 | 262,144 | 1.40 | 123 | Yes | No | |
| | $0.01 | $0.03 | 262,144 | 0.60 | 81 | Yes | Yes | |
 | $0.82 | $2.92 | - | 0.86 | 65 | Yes | Yes | |
| | $0.95 | $4.00 | 262,144 | 1.38 | 60 | Yes | Yes | |
| | - | - | - | - | - | - | - | |
| | $0.95 | $4.00 | 262,144 | 0.31 | 82 | Yes | Yes | |
| | baseten fastest | $0.95 | $4.00 | 262,000 | 0.31 | 119 | Yes | Yes |
| | deepinfra cheapest | $0.68 | $3.40 | 262,144 | 0.61 | 54 | Yes | No |
| | $0.06 | $0.20 | 131,072 | 0.63 | 49 | No | Yes | |
 | novita cheapest fastest | $0.17 | $0.34 | 1,048,576 | 0.78 | 39 | Yes | No |
| | $0.40 | $2.00 | 262,144 | 1.11 | 29 | Yes | Yes | |
 | $0.05 | $0.05 | 8,192 | 0.47 | 93 | No | No | |
| | $0.23 | $0.91 | - | 0.32 | 147 | Yes | Yes | |
| | - | - | - | - | - | - | - | |
| | $1.00 | $3.00 | 1,048,576 | 0.25 | 58 | Yes | Yes | |
| | $0.09 | $0.58 | 131,072 | 0.70 | 33 | Yes | Yes | |
| | $0.20 | $0.60 | 32,768 | 0.83 | 14 | Yes | Yes | |
| | scaleway fastest | $0.86 | $2.57 | - | 0.34 | 99 | Yes | Yes |
| | deepinfra cheapest | $0.09 | $0.55 | 262,144 | 0.43 | 12 | Yes | Yes |
| | novita fastest | $0.20 | $0.80 | 40,960 | 0.86 | 27 | No | No |
| | nscale cheapest | $0.20 | $0.60 | 32,000 | 0.84 | 16 | Yes | No |
| | novita fastest | $0.15 | $1.50 | 131,072 | 0.86 | 121 | Yes | No |
| | deepinfra cheapest | $0.09 | $1.10 | 262,144 | 0.79 | 110 | Yes | Yes |
| | novita fastest | $0.25 | $2.00 | 262,144 | 0.95 | 61 | Yes | No |
| | deepinfra cheapest | $0.14 | $1.00 | 262,144 | 0.31 | 39 | Yes | Yes |
| | novita fastest | $0.27 | $0.40 | 163,840 | 1.48 | 27 | Yes | Yes |
| | deepinfra cheapest | $0.26 | $0.38 | 163,840 | 0.70 | 10 | Yes | Yes |
| | novita cheapest | $0.80 | $3.40 | 262,144 | 1.82 | 39 | Yes | No |
| | $0.95 | $4.00 | 262,144 | 0.48 | 46 | Yes | Yes | |
| | baseten fastest | $0.95 | $4.00 | 262,000 | 0.46 | 117 | Yes | Yes |
| | $0.75 | $3.50 | 262,144 | 0.70 | 15 | Yes | Yes | |
| | $0.05 | $0.10 | 131,072 | 0.56 | 18 | Yes | Yes | |
| | - | - | - | - | - | - | - | |
| | $0.12 | $0.50 | 40,960 | 0.22 | 125 | Yes | Yes | |
| | $0.08 | $0.16 | 131,072 | 0.27 | 26 | Yes | Yes | |
 | $0.07 | $0.14 | 16,384 | 0.58 | 75 | No | Yes | |
| | $0.82 | $2.92 | - | 0.93 | 63 | Yes | Yes | |
| | - | - | - | 0.98 | 46 | Yes | No | |
| | - | - | - | - | - | - | - | |
| | $0.18 | $0.59 | 131,072 | 0.31 | 42 | No | No | |
| | nscale cheapest fastest | $0.09 | $0.29 | 890,000 | 0.72 | 72 | Yes | Yes |
| | $0.10 | $0.30 | 327,680 | 0.68 | 23 | Yes | Yes | |
| | - | - | - | - | - | - | - | |
| | - | - | - | - | - | - | - | |
| | nscale cheapest fastest | $0.08 | $0.25 | 40,960 | 0.66 | 48 | Yes | Yes |
| | $0.08 | $0.28 | 40,960 | 0.28 | 26 | Yes | No | |
 | $0.20 | $1.15 | 262,144 | 0.55 | 109 | Yes | No | |
| | $0.40 | $3.20 | 262,144 | 0.92 | 92 | Yes | No | |
| | deepinfra cheapest fastest | $0.29 | $2.40 | 262,144 | 0.47 | 99 | Yes | No |
| | novita cheapest fastest | $0.30 | $2.40 | 262,144 | 0.82 | 62 | Yes | No |
| | $0.26 | $2.60 | 262,144 | 0.44 | 62 | Yes | Yes | |
| | $0.60 | $3.60 | 262,144 | 1.32 | 76 | Yes | No | |
| | - | - | - | - | - | - | - | |
| | ovhcloud fastest | $0.71 | $4.25 | 262,144 | 0.47 | 118 | Yes | Yes |
| | deepinfra cheapest | $0.45 | $3.00 | 262,144 | 0.33 | 58 | Yes | Yes |
| | $0.60 | $3.00 | 262,144 | 1.07 | 40 | Yes | Yes | |
| | deepinfra cheapest fastest | $0.45 | $2.25 | 262,144 | 0.64 | 50 | Yes | Yes |
 | $0.40 | $0.40 | - | 1.09 | 56 | Yes | Yes | |
| | $0.15 | $0.15 | 131,072 | 0.74 | 144 | No | No | |
| | $0.05 | $0.05 | 131,072 | 0.55 | 147 | No | Yes | |
| | novita cheapest | $0.30 | $0.90 | 131,072 | 0.68 | 51 | Yes | No |
| | zai-org fastest | - | - | - | 2.82 | 62 | Yes | No |
| | zai-org fastest | - | - | - | 4.08 | 27 | Yes | No |
| | deepinfra cheapest | $1.05 | $3.50 | 202,752 | 0.84 | 17 | Yes | Yes |
| | $0.60 | $2.20 | 204,800 | 1.51 | 46 | Yes | No | |
| | - | - | - | - | - | - | - | |
| | - | - | - | 1.16 | 47 | Yes | No | |
| | baseten fastest | $0.60 | $2.20 | 200,000 | 0.35 | 167 | Yes | Yes |
| | deepinfra cheapest | $0.40 | $1.75 | 202,752 | 0.84 | 23 | Yes | No |
| | $0.20 | $0.20 | 131,072 | 0.66 | 91 | No | Yes | |
| | novita fastest | $0.30 | $3.00 | 131,072 | 1.20 | 56 | Yes | No |
| | deepinfra cheapest | $0.23 | $2.30 | 262,144 | 0.26 | 19 | Yes | Yes |
 | $0.62 | $0.62 | 65,535 | 1.46 | 11 | No | No | |
| | $0.05 | $0.05 | 8,192 | 0.30 | 78 | No | No | |
| | - | - | - | - | - | - | - | |
| | $0.24 | $0.90 | 163,840 | 0.53 | 62 | Yes | Yes | |
| | $0.05 | $0.15 | 131,072 | 0.37 | 90 | Yes | Yes | |
 | $0.70 | $0.70 | 131,072 | 0.18 | 36 | No | Yes | |
 | $0.42 | $1.25 | 123,000 | 1.36 | 40 | No | No | |
 | - | - | - | 0.25 | 132 | No | No | |
| | - | - | - | 0.16 | 134 | No | No | |
| | $0.04 | $0.14 | 65,536 | 0.48 | 105 | No | No | |
| | - | - | - | - | - | - | - | |
| | $0.32 | $0.89 | 163,840 | 0.28 | 26 | Yes | Yes | |
| | $0.00 | $0.00 | 262,144 | 0.35 | 71 | Yes | No | |
| | novita cheapest | $0.38 | $0.40 | 32,000 | 0.52 | 14 | Yes | No |
| | deepinfra fastest | $0.36 | $0.40 | 32,768 | 0.30 | 25 | Yes | Yes |
| | - | - | - | - | - | - | - | |
| | $0.18 | $0.18 | 163,840 | 0.31 | 7 | No | No | |
| | - | - | - | 0.25 | 133 | Yes | Yes | |
| | novita fastest | $0.70 | $2.50 | 163,840 | 1.40 | 25 | Yes | Yes |
| | deepinfra cheapest | $0.50 | $2.15 | 163,840 | 0.69 | 25 | Yes | No |
| | - | - | - | 0.26 | 41 | No | No | |
| | - | - | - | 0.22 | 31 | Yes | Yes | |
| | novita fastest | $0.27 | $1.00 | 131,072 | 1.71 | 26 | Yes | Yes |
| | deepinfra cheapest | $0.25 | $0.95 | 163,840 | 0.67 | 23 | Yes | Yes |
| | novita fastest | $0.30 | $1.50 | 131,072 | 0.84 | 45 | Yes | Yes |
| | deepinfra cheapest | $0.20 | $0.88 | 262,144 | 0.38 | 21 | Yes | Yes |
| | $0.27 | $1.00 | 131,072 | 1.65 | 23 | Yes | Yes | |
| | deepinfra cheapest fastest | $0.27 | $0.95 | 163,840 | 0.58 | 30 | Yes | Yes |
| | $0.30 | $1.20 | 204,800 | 2.09 | 28 | Yes | No | |
| | deepinfra cheapest fastest | $0.25 | $1.00 | 196,608 | 0.74 | 40 | Yes | No |
| | $0.55 | $2.20 | 204,800 | 1.65 | 24 | Yes | No | |
| | zai-org fastest | - | - | - | 0.86 | 45 | Yes | No |
| | deepinfra cheapest | $0.50 | $2.00 | 202,752 | 0.47 | 35 | Yes | Yes |
| | - | - | - | 1.29 | 44 | Yes | No | |
| | novita cheapest | $0.13 | $0.85 | 131,072 | 0.69 | 36 | Yes | No |
| | zai-org fastest | - | - | - | 0.51 | 47 | Yes | No |
| | - | - | - | 0.21 | 108 | Yes | Yes | |
| | - | - | - | 1.01 | 53 | Yes | No | |
| | - | - | - | 0.58 | 37 | Yes | No | |
| | - | - | - | 0.17 | 69 | Yes | Yes | |
| | - | - | - | 0.81 | 34 | Yes | No | |
| | novita cheapest fastest | $0.60 | $1.80 | 65,536 | 1.42 | 39 | Yes | No |
| | - | - | - | 1.36 | 36 | Yes | No | |
| | - | - | - | 1.91 | 64 | Yes | No | |
| | - | - | - | 1.58 | 48 | Yes | No | |
| | - | - | - | 0.43 | 56 | Yes | Yes | |
| | $1.00 | $3.20 | 202,800 | 0.99 | 49 | Yes | No | |
| | zai-org fastest | - | - | - | 1.01 | 54 | Yes | No |
| | deepinfra cheapest | $0.60 | $2.08 | 202,752 | 0.68 | 34 | Yes | Yes |
| | - | - | - | 0.29 | 42 | No | No | |
| | - | - | - | 0.26 | 132 | No | No | |
| | - | - | - | 0.19 | 134 | No | No | |
| | - | - | - | 3.95 | 25 | Yes | No | |
| | $0.01 | $0.03 | 32,768 | 0.59 | 177 | No | Yes | |
| | $0.38 | $1.55 | 262,144 | 1.05 | 58 | Yes | No | |
| | $0.60 | $2.50 | 262,144 | 0.57 | 38 | Yes | Yes | |
| | $0.98 | $3.95 | 131,072 | 1.16 | 35 | Yes | No | |
| | $0.27 | $0.41 | 163,840 | 1.31 | 26 | Yes | Yes | |
| | $0.57 | $2.30 | 131,072 | 0.60 | 39 | Yes | No | |
| | novita fastest | $0.20 | $0.70 | 131,072 | 0.65 | 112 | Yes | Yes |
| | deepinfra cheapest | $0.15 | $0.60 | 262,144 | 0.62 | 37 | Yes | Yes |
 | $1.20 | $1.20 | 65,536 | 0.58 | 37 | No | Yes | |
| | $0.30 | $1.20 | 204,800 | 1.15 | 68 | Yes | No | |
| | $0.30 | $1.20 | 204,800 | 1.48 | 60 | Yes | No | |
| | $0.30 | $1.20 | 204,800 | 0.95 | 62 | Yes | No | |
| | $0.82 | $2.92 | - | 0.73 | 54 | Yes | Yes | |
| | $0.10 | $0.30 | 262,144 | 0.55 | 105 | Yes | No | |
| | - | - | 131,072 | 0.38 | 663 | Yes | Yes | |
| | $0.80 | $0.80 | 8,192 | 1.89 | 18 | No | No | |
 | $0.25 | $0.50 | - | 1.43 | 47 | Yes | Yes | |
| | $0.82 | $2.92 | - | 0.75 | 65 | Yes | Yes | |
| | $0.20 | $0.40 | - | 1.37 | 52 | No | Yes | |
| | $0.27 | $0.85 | 1,048,576 | 0.29 | 69 | No | Yes | |
| | $0.55 | $1.66 | 32,000 | 1.61 | 33 | No | No | |
| | $0.55 | $2.20 | 1,000,000 | 1.13 | 52 | Yes | No | |
| | $1.01 | $1.01 | 32,768 | 0.34 | 29 | No | Yes | |
| | $0.01 | $0.03 | 262,144 | 0.75 | 155 | Yes | No |