Instructions to use AI-Sweden-Models/gpt-sw3-356m-instruct-gguf with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use AI-Sweden-Models/gpt-sw3-356m-instruct-gguf with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf AI-Sweden-Models/gpt-sw3-356m-instruct-gguf:F16 # Run inference directly in the terminal: llama cli -hf AI-Sweden-Models/gpt-sw3-356m-instruct-gguf:F16
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf AI-Sweden-Models/gpt-sw3-356m-instruct-gguf:F16 # Run inference directly in the terminal: llama cli -hf AI-Sweden-Models/gpt-sw3-356m-instruct-gguf:F16
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf AI-Sweden-Models/gpt-sw3-356m-instruct-gguf:F16 # Run inference directly in the terminal: ./llama-cli -hf AI-Sweden-Models/gpt-sw3-356m-instruct-gguf:F16
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf AI-Sweden-Models/gpt-sw3-356m-instruct-gguf:F16 # Run inference directly in the terminal: ./build/bin/llama-cli -hf AI-Sweden-Models/gpt-sw3-356m-instruct-gguf:F16
Use Docker
docker model run hf.co/AI-Sweden-Models/gpt-sw3-356m-instruct-gguf:F16
- LM Studio
- Jan
- Ollama
How to use AI-Sweden-Models/gpt-sw3-356m-instruct-gguf with Ollama:
ollama run hf.co/AI-Sweden-Models/gpt-sw3-356m-instruct-gguf:F16
- Unsloth Desktop
- Docker Model Runner
How to use AI-Sweden-Models/gpt-sw3-356m-instruct-gguf with Docker Model Runner:
docker model run hf.co/AI-Sweden-Models/gpt-sw3-356m-instruct-gguf:F16
- Lemonade
How to use AI-Sweden-Models/gpt-sw3-356m-instruct-gguf with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull AI-Sweden-Models/gpt-sw3-356m-instruct-gguf:F16
Run and chat with the model
lemonade run user.gpt-sw3-356m-instruct-gguf-F16
List all available models
lemonade list
- Atomic Chat
You need to agree to share your contact information to access this model
We process new request once a week.
No requests will be processed during week 28-33.
To access the model you need to belong to an European university or research organization
AND have a valid email adress correlating to the university or research organization you belong to.
You agree to use the model for research purposes only.
To read more visit
https://www.ai.se/en/project/gpt-sw3.
Log in or Sign Up to review the conditions and access this model content.
Gated model You can list files but not access them
Preview of files found in this repository