Hugging Face's logo

SaravananS30
/
localid_gguf_gemma7b

Transformers
GGUF
English
gemma
text-generation-inference
unsloth
Model card Files
xet
 Community
How to use from the
Use from the
Transformers library
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("SaravananS30/localid_gguf_gemma7b", device_map="auto")
Quick Links

Uploaded model

  • Developed by: SaravananS30
  • License: apache-2.0
  • Finetuned from model : unsloth/gemma-7b-bnb-4bit

This gemma model was trained 2x faster with Unsloth and Huggingface's TRL library.

Downloads last month
37
GGUF
Model size
9B params
Architecture
gemma
Hardware compatibility
Log In to add your hardware

4-bit

16-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for SaravananS30/localid_gguf_gemma7b

Base model

unsloth/gemma-7b-bnb-4bit
Quantized
(68)
this model