Transformers
GGUF
Sinhala
sinhala
low-resource
instruction-tuning
lora
gemma
adaption-autoscientist
imatrix
conversational
Instructions to use mradermacher/helalm-4b-i1-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use mradermacher/helalm-4b-i1-GGUF with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("mradermacher/helalm-4b-i1-GGUF", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use mradermacher/helalm-4b-i1-GGUF with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf mradermacher/helalm-4b-i1-GGUF:Q4_K_M # Run inference directly in the terminal: llama cli -hf mradermacher/helalm-4b-i1-GGUF:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf mradermacher/helalm-4b-i1-GGUF:Q4_K_M # Run inference directly in the terminal: llama cli -hf mradermacher/helalm-4b-i1-GGUF:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf mradermacher/helalm-4b-i1-GGUF:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf mradermacher/helalm-4b-i1-GGUF:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf mradermacher/helalm-4b-i1-GGUF:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf mradermacher/helalm-4b-i1-GGUF:Q4_K_M
Use Docker
docker model run hf.co/mradermacher/helalm-4b-i1-GGUF:Q4_K_M
- LM Studio
- Jan
- Ollama
How to use mradermacher/helalm-4b-i1-GGUF with Ollama:
ollama run hf.co/mradermacher/helalm-4b-i1-GGUF:Q4_K_M
- Unsloth Desktop
- Docker Model Runner
How to use mradermacher/helalm-4b-i1-GGUF with Docker Model Runner:
docker model run hf.co/mradermacher/helalm-4b-i1-GGUF:Q4_K_M
- Lemonade
How to use mradermacher/helalm-4b-i1-GGUF with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull mradermacher/helalm-4b-i1-GGUF:Q4_K_M
Run and chat with the model
lemonade run user.helalm-4b-i1-GGUF-Q4_K_M
List all available models
lemonade list
- Atomic Chat
uploaded from rich1
Browse files- .gitattributes +24 -0
- helalm-4b.i1-IQ1_M.gguf +3 -0
- helalm-4b.i1-IQ1_S.gguf +3 -0
- helalm-4b.i1-IQ2_M.gguf +3 -0
- helalm-4b.i1-IQ2_S.gguf +3 -0
- helalm-4b.i1-IQ2_XS.gguf +3 -0
- helalm-4b.i1-IQ2_XXS.gguf +3 -0
- helalm-4b.i1-IQ3_M.gguf +3 -0
- helalm-4b.i1-IQ3_S.gguf +3 -0
- helalm-4b.i1-IQ3_XS.gguf +3 -0
- helalm-4b.i1-IQ3_XXS.gguf +3 -0
- helalm-4b.i1-IQ4_NL.gguf +3 -0
- helalm-4b.i1-IQ4_XS.gguf +3 -0
- helalm-4b.i1-Q2_K.gguf +3 -0
- helalm-4b.i1-Q2_K_S.gguf +3 -0
- helalm-4b.i1-Q3_K_L.gguf +3 -0
- helalm-4b.i1-Q3_K_M.gguf +3 -0
- helalm-4b.i1-Q3_K_S.gguf +3 -0
- helalm-4b.i1-Q4_0.gguf +3 -0
- helalm-4b.i1-Q4_1.gguf +3 -0
- helalm-4b.i1-Q4_K_M.gguf +3 -0
- helalm-4b.i1-Q4_K_S.gguf +3 -0
- helalm-4b.i1-Q5_K_M.gguf +3 -0
- helalm-4b.i1-Q5_K_S.gguf +3 -0
- helalm-4b.i1-Q6_K.gguf +3 -0
.gitattributes
CHANGED
|
@@ -34,3 +34,27 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
| 36 |
helalm-4b.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
| 36 |
helalm-4b.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
|
| 37 |
+
helalm-4b.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
|
| 38 |
+
helalm-4b.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
|
| 39 |
+
helalm-4b.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
|
| 40 |
+
helalm-4b.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
|
| 41 |
+
helalm-4b.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
| 42 |
+
helalm-4b.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
|
| 43 |
+
helalm-4b.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
|
| 44 |
+
helalm-4b.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
|
| 45 |
+
helalm-4b.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
| 46 |
+
helalm-4b.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
|
| 47 |
+
helalm-4b.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
|
| 48 |
+
helalm-4b.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
| 49 |
+
helalm-4b.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
|
| 50 |
+
helalm-4b.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
| 51 |
+
helalm-4b.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
|
| 52 |
+
helalm-4b.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
| 53 |
+
helalm-4b.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
| 54 |
+
helalm-4b.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
|
| 55 |
+
helalm-4b.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
|
| 56 |
+
helalm-4b.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
| 57 |
+
helalm-4b.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
| 58 |
+
helalm-4b.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
| 59 |
+
helalm-4b.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
| 60 |
+
helalm-4b.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
helalm-4b.i1-IQ1_M.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1837f38aff1056a60b4454c880742bdf80bb06c244784adc410607fccd33e248
|
| 3 |
+
size 1207774592
|
helalm-4b.i1-IQ1_S.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:67faa1e01a93591ec75e6c95849e1cb28a112d8a4f62d065d9dcb06ef1bd2309
|
| 3 |
+
size 1141296512
|
helalm-4b.i1-IQ2_M.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:0c815f64e67714729191599a00d822de5335461b5a3c81cde01345d5c29e3271
|
| 3 |
+
size 1546186112
|
helalm-4b.i1-IQ2_S.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e22234bfce7a809ad441654951c7aa7928fbdad20103e3f966668886751c3716
|
| 3 |
+
size 1457548672
|
helalm-4b.i1-IQ2_XS.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a47d90eb4ea5baa9297b8ccec29b91b381b208193832652a975c6ff31ddc28a7
|
| 3 |
+
size 1412779392
|
helalm-4b.i1-IQ2_XXS.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:532b78e4df7b6888c65ddfe7a3a648fed6cb8d2f2c41d9f13b77c08d37fd9147
|
| 3 |
+
size 1318571392
|
helalm-4b.i1-IQ3_M.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a5b3bda1c664295f389c4a6aec623ae39a36e234e4491ce498e8ff5bb78a740e
|
| 3 |
+
size 1995006592
|
helalm-4b.i1-IQ3_S.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b2682d646b01562f883290f7d6f3e47c0e67434b26062b944242bcf85124f5bf
|
| 3 |
+
size 1945567872
|
helalm-4b.i1-IQ3_XS.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e29ae467745c7fd1b68ab0e2fc3156c50fd2ea4da2907e9e733a1f9670aedf03
|
| 3 |
+
size 1871594112
|
helalm-4b.i1-IQ3_XXS.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:65df72de4b2c60153be84e794046e5576deed767eb2ee361ae80d0cdb2a959ed
|
| 3 |
+
size 1697656192
|
helalm-4b.i1-IQ4_NL.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:90ff72489d7d3d9d4f3f7df53797b0e4ad353199a54b1259af1c60c0e9b18e69
|
| 3 |
+
size 2371715712
|
helalm-4b.i1-IQ4_XS.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3ebc572f32fe0f18fb8e48691e6f49bbb24bd8053eb2acf0b6aea06025d303b3
|
| 3 |
+
size 2271445632
|
helalm-4b.i1-Q2_K.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d738e742ab84df81f8c7312ab8a0f808c8ea7f933e771c7a4c133a713c071e88
|
| 3 |
+
size 1737368192
|
helalm-4b.i1-Q2_K_S.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:93db02cd31e16b6ef21c8047d8aaa0d5365fc497a5c0fccbedfa1d840751bae2
|
| 3 |
+
size 1644266112
|
helalm-4b.i1-Q3_K_L.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f991e16a3a34d2d905f0cdbd91b090ed92fdb158325a3cf089241218f7ffba7b
|
| 3 |
+
size 2244289152
|
helalm-4b.i1-Q3_K_M.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:cdaa6fb0b1f765fb8ffaaab83c681d3eb991b7a41b859054b8e2bbaf1dc2de6e
|
| 3 |
+
size 2106663552
|
helalm-4b.i1-Q3_K_S.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:37befd2f13afc1577cbf8fe261d033a92d5902e589a40ca264f7b9da1eef9bf7
|
| 3 |
+
size 1945567872
|
helalm-4b.i1-Q4_0.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:294246dc9080da23d84c1e9f30536781c2a13d45f5c039e5fb5600e65e079e3e
|
| 3 |
+
size 2378269312
|
helalm-4b.i1-Q4_1.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:0608cbc8fec9fbb2c1f2390863abe1e867397ce941c68497c2b29e8b88ff51b8
|
| 3 |
+
size 2572255872
|
helalm-4b.i1-Q4_K_M.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:173adb60a4b777e5d1dd3c53b528bd131b86f7e31db306cbd77ec7fd8e744550
|
| 3 |
+
size 2498097792
|
helalm-4b.i1-Q4_K_S.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:80e3cbfc6ae158ece3d7f2f4c8fb67aec6118b9ded20906180bc706cce72f14e
|
| 3 |
+
size 2386133632
|
helalm-4b.i1-Q5_K_M.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:72ecf46ba6711c1cf969b59e104f66139cd5fecb3d22d93e148143b645d18a56
|
| 3 |
+
size 2837901952
|
helalm-4b.i1-Q5_K_S.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9fa16c822370cee620ec136525067b0042f44f08ae0e56836b75a14bd2f4f24e
|
| 3 |
+
size 2772796032
|
helalm-4b.i1-Q6_K.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:0fd0c64ab61bb028b66f2946a05037bede7f295f4654ec03c38e9ae2fdca773d
|
| 3 |
+
size 3198943872
|