Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Hardware
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up

Vishva007
/
Qwen3.8-9B-Distill-W4A16-AutoRound-LLM-Compressor

Image-Text-to-Text
Safetensors
qwen3_5
quantization
auto-round
gptq
llm-compressor
compressed-tensors
4bit
text-generation
reasoning
distillation
conversational
Model card Files Files and versions
xet
Community
Qwen3.8-9B-Distill-W4A16-AutoRound-LLM-Compressor
9.38 GB
Ctrl+K
Ctrl+K
  • 1 contributor
History: 7 commits
Vishva007's picture
Vishva007
Update README.md
d64fda2 verified about 1 month ago
  • .gitattributes
    1.57 kB
    Upload folder using huggingface_hub about 1 month ago
  • README.md
    6.12 kB
    Update README.md about 1 month ago
  • chat_template.jinja
    7.76 kB
    Upload folder using huggingface_hub about 1 month ago
  • config.json
    11.5 kB
    Upload folder using huggingface_hub about 1 month ago
  • generation_config.json
    164 Bytes
    Upload folder using huggingface_hub about 1 month ago
  • model-00001-of-00002.safetensors
    4.98 GB
    xet
    Upload folder using huggingface_hub about 1 month ago
  • model-00002-of-00002.safetensors
    3.89 GB
    xet
    Upload folder using huggingface_hub about 1 month ago
  • model.safetensors.index.json
    124 kB
    Upload folder using huggingface_hub about 1 month ago
  • model_extra_tensors.safetensors
    487 MB
    xet
    Upload folder using huggingface_hub about 1 month ago
  • preprocessor_config.json
    390 Bytes
    Upload folder using huggingface_hub about 1 month ago
  • processor_config.json
    1.22 kB
    Upload folder using huggingface_hub about 1 month ago
  • quantization_config.json
    7.87 kB
    Upload folder using huggingface_hub about 1 month ago
  • tokenizer.json
    20 MB
    xet
    Upload folder using huggingface_hub about 1 month ago
  • tokenizer_config.json
    1.17 kB
    Upload folder using huggingface_hub about 1 month ago