TheDrummer
/

Gemmasutra-Small-4B-v1-GGUF

Model card Files Files and versions

Join our Discord! https://discord.gg/Nbv9pQ88Xb

Nearly 5000 members strong 💪 Now with more channels! A hub for users and makers alike!

BeaverAI proudly presents...

Gemmasutra Small 4B v1 🧘

Special Thanks

Thank you to each and everyone who donated and subscribed in Ko-Fi to make our venture a little bit easier.
I'm also recently unemployed. I am a Software Developer with 8 years of experience in Web, API, AI, and adapting to new tech and requirements. If you're hiring, feel free to reach out to me however.

Supported Chat Template

Gemma (user, assistant)

Description

An upscaled Gemma 2B tune with modern techniques. Au Revoir, Gemma!

Links

Original: https://huggingface.co/TheDrummer/Gemmasutra-Small-4B-v1
GGUF: https://huggingface.co/TheDrummer/Gemmasutra-Small-4B-v1-GGUF
iMatrix (recommended): https://huggingface.co/bartowski/TheDrummer_Gemmasutra-Small-4B-v1-GGUF

Downloads last month: 6,088

GGUF

Model size

4B params

Architecture

gemma2

Hardware compatibility

Log In to add your hardware

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Space using TheDrummer/Gemmasutra-Small-4B-v1-GGUF 1