Update README.md
Browse files
README.md
CHANGED
|
@@ -99,18 +99,14 @@ See [here](https://docs.vllm.ai/en/latest/getting_started/installation/) for a f
|
|
| 99 |
uv pip install -U vllm
|
| 100 |
```
|
| 101 |
|
| 102 |
-
|
| 103 |
-
|
| 104 |
-
|
| 105 |
-
Next, you should install [`vllm-omni`](https://github.com/vllm-project/vllm-omni) from "main".
|
| 106 |
|
| 107 |
```
|
| 108 |
-
uv pip install
|
| 109 |
```
|
| 110 |
|
| 111 |
-
|
| 112 |
-
|
| 113 |
-
> run `apt update;apt install -y git` and try again.
|
| 114 |
|
| 115 |
Installing `vllm >= 0.18.0` should automatically install `mistral_common >= 1.10.0` which you can verify by running:
|
| 116 |
|
|
|
|
| 99 |
uv pip install -U vllm
|
| 100 |
```
|
| 101 |
|
| 102 |
+
Next, you should install [`vllm-omni`](https://github.com/vllm-project/vllm-omni) with `vllm-omni >= 0.18.0`.
|
|
|
|
|
|
|
|
|
|
| 103 |
|
| 104 |
```
|
| 105 |
+
uv pip install vllm-omni --upgrade # make sure to have >= 0.18.0
|
| 106 |
```
|
| 107 |
|
| 108 |
+
Alternatively, you can also make use of a ready-to-go docker image on the [docker hub](https://hub.docker.com/layers/vllm/vllm-omni/v0.18.0/images/sha256-d855c9f3e06b1126e8a082229e5d2fef217e43c98d03569f8b9e50fa5c2d0a61).
|
| 109 |
+
|
|
|
|
| 110 |
|
| 111 |
Installing `vllm >= 0.18.0` should automatically install `mistral_common >= 1.10.0` which you can verify by running:
|
| 112 |
|