manuelcaccone commited on
Commit
5ceeca4
·
verified ·
1 Parent(s): a095b18

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +30 -0
README.md ADDED
@@ -0,0 +1,30 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: manuelcaccone/LLama3.1-8b-actua-simplifier
3
+ language:
4
+ - en
5
+ license: apache-2.0
6
+ tags:
7
+ - text-generation-inference
8
+ - transformers
9
+ - unsloth
10
+ - llama
11
+ - trl
12
+ - llama-cpp
13
+ - gguf-my-lora
14
+ ---
15
+
16
+ # manuelcaccone/LLama3.1-8b-actua-simplifier-F16-GGUF
17
+ This LoRA adapter was converted to GGUF format from [`manuelcaccone/LLama3.1-8b-actua-simplifier`](https://huggingface.co/manuelcaccone/LLama3.1-8b-actua-simplifier) via the ggml.ai's [GGUF-my-lora](https://huggingface.co/spaces/ggml-org/gguf-my-lora) space.
18
+ Refer to the [original adapter repository](https://huggingface.co/manuelcaccone/LLama3.1-8b-actua-simplifier) for more details.
19
+
20
+ ## Use with llama.cpp
21
+
22
+ ```bash
23
+ # with cli
24
+ llama-cli -m base_model.gguf --lora LLama3.1-8b-actua-simplifier-f16.gguf (...other args)
25
+
26
+ # with server
27
+ llama-server -m base_model.gguf --lora LLama3.1-8b-actua-simplifier-f16.gguf (...other args)
28
+ ```
29
+
30
+ To know more about LoRA usage with llama.cpp server, refer to the [llama.cpp server documentation](https://github.com/ggerganov/llama.cpp/blob/master/examples/server/README.md).