File size: 1,278 Bytes
8e605b3 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 | ---
license: apache-2.0
base_model: HuggingFaceTB/SmolLM2-360M-Instruct
tags:
- smollm2
- webgpu
- browser-inference
- strix-halo
- amd
- unified-memory
- tiny-model
pipeline_tag: text-generation
---
# SmolLM2-360M on WebGPU
**HuggingFace's tiny 360M parameter model running in browser WebGPU.**
369 MB Q8_0 quantization. Loads in under 2 seconds. Generates instantly.
Built and tested on AMD Strix Halo (Radeon 8060S iGPU, 64GB unified memory).
## Quick Start
1. Download Q8_0 GGUF from [bartowski](https://huggingface.co/bartowski/SmolLM2-360M-Instruct-GGUF)
2. Place in `model_splits/` (no splitting needed — single file)
3. `node serve.js` (port 8180)
4. Open `http://localhost:8180` in Chrome
## Use Cases
- Lightweight chat and Q&A
- Classification and summarization
- Edge/IoT inference
- Testing and prototyping
## Hardware
Any WebGPU-capable device. Tested on AMD Strix Halo but works on much smaller hardware too. The model is only 369 MB — it fits anywhere.
## Why This Package
Part of a series making popular models available on WebGPU for AMD unified memory AI PCs. WebGPU bypasses broken ROCm and routes through the gaming driver stack.
## Credits
Built by Joshua (LJTSG) and Claude.
Co-Authored-By: Claude <noreply@anthropic.com>
|