Hunter.Beta-1B-GGUF / README.md
Novaciano's picture
Upload README.md with huggingface_hub
8996cc5 verified
|
Raw History Blame Contribute Delete
1.03 kB
metadata
base_model: Novaciano/Hunter.Beta-1B
library_name: transformers
tags:
  - mergekit
  - merge
  - llama-cpp
  - gguf-my-repo

Hunter.Beta-1B

Model creator: Novaciano
Original model: Novaciano/Hunter.Beta-1B
GGUF quantization: provided by Novaciano using llama.cpp

Special thanks

🙏 Special thanks to Georgi Gerganov and the whole team working on llama.cpp for making all of this possible.

Use with Ollama

ollama run "hf.co/Novaciano/Hunter.Beta-1B-GGUF:Q4_K_M"

Use with LM Studio

lms load "Novaciano/Hunter.Beta-1B-GGUF"

Use with llama.cpp CLI

llama-cli --hf "Novaciano/Hunter.Beta-1B-GGUF:Q4_K_M" -p "The meaning to life and the universe is"

Use with llama.cpp Server:

llama-server --hf "Novaciano/Hunter.Beta-1B-GGUF:Q4_K_M" -c 4096