Spaces:
Build error
Build error
Nicola Beghin commited on
Commit ·
f59690a
1
Parent(s): 7ecf94c
docs update
Browse files- docs/proxy.md +2 -0
docs/proxy.md
CHANGED
|
@@ -32,6 +32,7 @@ headroom proxy \
|
|
| 32 |
| `--no-rate-limit` | `false` | Disable rate limiting |
|
| 33 |
| `--log-file` | None | Path to JSONL log file |
|
| 34 |
| `--budget` | None | Daily budget limit in USD |
|
|
|
|
| 35 |
|
| 36 |
### LLMLingua Options (ML Compression)
|
| 37 |
|
|
@@ -204,6 +205,7 @@ headroom_latency_ms_sum
|
|
| 204 |
export HEADROOM_HOST=0.0.0.0
|
| 205 |
export HEADROOM_PORT=8787
|
| 206 |
export HEADROOM_BUDGET=100.0
|
|
|
|
| 207 |
headroom proxy
|
| 208 |
```
|
| 209 |
|
|
|
|
| 32 |
| `--no-rate-limit` | `false` | Disable rate limiting |
|
| 33 |
| `--log-file` | None | Path to JSONL log file |
|
| 34 |
| `--budget` | None | Daily budget limit in USD |
|
| 35 |
+
| `--openai-api-url` | `https://api.openai.com` | Custom OpenAI API URL endpoint |
|
| 36 |
|
| 37 |
### LLMLingua Options (ML Compression)
|
| 38 |
|
|
|
|
| 205 |
export HEADROOM_HOST=0.0.0.0
|
| 206 |
export HEADROOM_PORT=8787
|
| 207 |
export HEADROOM_BUDGET=100.0
|
| 208 |
+
export OPENAI_TARGET_API_URL=https://custom.openai.endpoint.com
|
| 209 |
headroom proxy
|
| 210 |
```
|
| 211 |
|