Update README.md
Browse files
README.md
CHANGED
|
@@ -57,9 +57,9 @@ ggc b2
|
|
| 57 |
|
| 58 |
### **review/reference**
|
| 59 |
- simply execute the command (`ggc b2`) above in console/terminal
|
| 60 |
-
- opt a vae then opt a model file in the current directory to interact
|
| 61 |
- note: for the latest update, only tokenizer will be pulled to gguf-connector folder (cache) automatically during the first launch
|
| 62 |
-
-
|
| 63 |
- require dependency: bagel2; `pip install bagel2`; for flash-attn and triton, could opt to install it with pre-built wheels, i.e.,[here](https://github.com/calcuis/multimodal-trial-model/releases), unless you can build the wheel yourself successfully
|
| 64 |
- might need some optional dependencies, please refer to the [checklist](https://github.com/calcuis/multimodal-trial-model/blob/main/requirements.txt); as connector won't force your machine to install any of those by default
|
| 65 |
- gguf-connector ([pypi](https://pypi.org/project/gguf-connector))
|
|
|
|
| 57 |
|
| 58 |
### **review/reference**
|
| 59 |
- simply execute the command (`ggc b2`) above in console/terminal
|
| 60 |
+
- opt a `vae` then opt a `model` file in the current directory to interact
|
| 61 |
- note: for the latest update, only tokenizer will be pulled to gguf-connector folder (cache) automatically during the first launch
|
| 62 |
+
- run it entirely offline; i.e., from local URL: http://127.0.0.1:7860 with lazy webui
|
| 63 |
- require dependency: bagel2; `pip install bagel2`; for flash-attn and triton, could opt to install it with pre-built wheels, i.e.,[here](https://github.com/calcuis/multimodal-trial-model/releases), unless you can build the wheel yourself successfully
|
| 64 |
- might need some optional dependencies, please refer to the [checklist](https://github.com/calcuis/multimodal-trial-model/blob/main/requirements.txt); as connector won't force your machine to install any of those by default
|
| 65 |
- gguf-connector ([pypi](https://pypi.org/project/gguf-connector))
|