Text-to-Speech
Safetensors
GGUF
English
llama
speech
tts
voice-assistant
single-speaker
emotion
finetune
sft
tokenizer-special-tokens
english
conversational
Instructions to use alpha-ai/SpeakSpace-Assistant-v1-3B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use alpha-ai/SpeakSpace-Assistant-v1-3B with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf alpha-ai/SpeakSpace-Assistant-v1-3B:Q4_K_M # Run inference directly in the terminal: llama cli -hf alpha-ai/SpeakSpace-Assistant-v1-3B:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf alpha-ai/SpeakSpace-Assistant-v1-3B:Q4_K_M # Run inference directly in the terminal: llama cli -hf alpha-ai/SpeakSpace-Assistant-v1-3B:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf alpha-ai/SpeakSpace-Assistant-v1-3B:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf alpha-ai/SpeakSpace-Assistant-v1-3B:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf alpha-ai/SpeakSpace-Assistant-v1-3B:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf alpha-ai/SpeakSpace-Assistant-v1-3B:Q4_K_M
Use Docker
docker model run hf.co/alpha-ai/SpeakSpace-Assistant-v1-3B:Q4_K_M
- LM Studio
- Jan
- Ollama
How to use alpha-ai/SpeakSpace-Assistant-v1-3B with Ollama:
ollama run hf.co/alpha-ai/SpeakSpace-Assistant-v1-3B:Q4_K_M
- Unsloth Desktop
- Pi
How to use alpha-ai/SpeakSpace-Assistant-v1-3B with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf alpha-ai/SpeakSpace-Assistant-v1-3B:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "alpha-ai/SpeakSpace-Assistant-v1-3B:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use alpha-ai/SpeakSpace-Assistant-v1-3B with Docker Model Runner:
docker model run hf.co/alpha-ai/SpeakSpace-Assistant-v1-3B:Q4_K_M
- Lemonade
How to use alpha-ai/SpeakSpace-Assistant-v1-3B with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull alpha-ai/SpeakSpace-Assistant-v1-3B:Q4_K_M
Run and chat with the model
lemonade run user.SpeakSpace-Assistant-v1-3B-Q4_K_M
List all available models
lemonade list
- Hermes Agent
How to use alpha-ai/SpeakSpace-Assistant-v1-3B with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf alpha-ai/SpeakSpace-Assistant-v1-3B:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default alpha-ai/SpeakSpace-Assistant-v1-3B:Q4_K_M
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use alpha-ai/SpeakSpace-Assistant-v1-3B with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf alpha-ai/SpeakSpace-Assistant-v1-3B:Q4_K_M
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "alpha-ai/SpeakSpace-Assistant-v1-3B:Q4_K_M" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Update README.md
Browse files
README.md
CHANGED
|
@@ -1,22 +1,150 @@
|
|
| 1 |
---
|
| 2 |
-
base_model:
|
| 3 |
tags:
|
| 4 |
-
-
|
| 5 |
-
-
|
| 6 |
-
-
|
| 7 |
-
-
|
| 8 |
-
-
|
|
|
|
|
|
|
|
|
|
|
|
|
| 9 |
license: apache-2.0
|
| 10 |
language:
|
| 11 |
- en
|
|
|
|
|
|
|
|
|
|
| 12 |
---
|
| 13 |
|
| 14 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
| 15 |
|
| 16 |
-
|
| 17 |
-
- **License:** apache-2.0
|
| 18 |
-
- **Finetuned from model :** unsloth/orpheus-3b-0.1-ft
|
| 19 |
|
| 20 |
-
|
| 21 |
|
| 22 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
+
base_model: canopylabs/orpheus-3b-0.1-ft
|
| 3 |
tags:
|
| 4 |
+
- speech
|
| 5 |
+
- tts
|
| 6 |
+
- voice-assistant
|
| 7 |
+
- single-speaker
|
| 8 |
+
- emotion
|
| 9 |
+
- finetune
|
| 10 |
+
- sft
|
| 11 |
+
- tokenizer-special-tokens
|
| 12 |
+
- english
|
| 13 |
license: apache-2.0
|
| 14 |
language:
|
| 15 |
- en
|
| 16 |
+
pipeline_tag: text-to-speech
|
| 17 |
+
datasets:
|
| 18 |
+
- MrDragonFox/Elise
|
| 19 |
---
|
| 20 |
|
| 21 |
+
<div align="center">
|
| 22 |
+
<img src="https://huggingface.co/alphaaico/SpeakSpace-Assistant-v1-3B/resolve/main/SpeakSpace_thumbnail.png"
|
| 23 |
+
alt="SpeakSpace Assistant"
|
| 24 |
+
style="width: 600px; height: auto; object-position: center top;">
|
| 25 |
+
</div>
|
| 26 |
|
| 27 |
+
# SpeakSpace-Assistant-v1-3B
|
|
|
|
|
|
|
| 28 |
|
| 29 |
+
**Alpha AI (www.alphaai.biz)** fine-tuned `canopylabs/orpheus-3b-0.1-ft` to create **SpeakSpace-Assistant-v1-3B** — an English-only, single-speaker voice assistant model. The fine-tune uses custom voice recordings plus the Elise dataset (~3 hours, single-speaker English speech). Transcripts were augmented with emotion/expression tags like `<sigh>` and `<laughs>`, added as special tokens in the Orpheus tokenizer.
|
| 30 |
|
| 31 |
+
> ⚠️ **Important:** This model is intended for research, prototyping, and internal product demos. Do not use it to impersonate a real person without explicit consent. Review base-model and dataset licenses before commercial use.
|
| 32 |
+
|
| 33 |
+
---
|
| 34 |
+
|
| 35 |
+
## TL;DR
|
| 36 |
+
|
| 37 |
+
* **Base:** `canopylabs/orpheus-3b-0.1-ft` (~3B params).
|
| 38 |
+
* **Data:** Custom Alpha AI dataset + `MrDragonFox/Elise` (English, ~3 hours).
|
| 39 |
+
* **Objective:** Produce natural, expressive speech with inline emotion cues (`<laughs>`, `<sigh>`).
|
| 40 |
+
* **Language:** English only.
|
| 41 |
+
* **Repo:** Suggested as `alpha-ai/SpeakSpace-Assistant-v1-3B`.
|
| 42 |
+
|
| 43 |
+
---
|
| 44 |
+
|
| 45 |
+
## Intended Use & Limitations
|
| 46 |
+
|
| 47 |
+
**Intended use:**
|
| 48 |
+
- Internal voice assistants and demos.
|
| 49 |
+
- Research on expressive TTS and emotion-tag-conditioned speech.
|
| 50 |
+
- Applications where transcripts include small expressive markers.
|
| 51 |
+
|
| 52 |
+
**Limitations:**
|
| 53 |
+
- Not multi-speaker or multilingual.
|
| 54 |
+
- Quality limited by dataset size (~3 hrs + custom data).
|
| 55 |
+
- Requires Orpheus vocoder/decoder to convert tokens to waveform.
|
| 56 |
+
- Do not deploy for impersonation without explicit consent.
|
| 57 |
+
|
| 58 |
+
---
|
| 59 |
+
|
| 60 |
+
## Model Details
|
| 61 |
+
|
| 62 |
+
- **Family:** Orpheus 3B (decoder-based speech model).
|
| 63 |
+
- **Tokenizer:** Extended with special tokens (`<laughs>`, `<sigh>`).
|
| 64 |
+
- **Fine-tuning:** Supervised finetuning on audio–transcript pairs.
|
| 65 |
+
- **Output:** Discrete audio tokens; decode with Orpheus vocoder.
|
| 66 |
+
|
| 67 |
+
---
|
| 68 |
+
|
| 69 |
+
## Data
|
| 70 |
+
|
| 71 |
+
**Sources:**
|
| 72 |
+
- Alpha AI custom speech dataset.
|
| 73 |
+
- [MrDragonFox/Elise](https://huggingface.co/datasets/MrDragonFox/Elise) (~3 hrs English single-speaker).
|
| 74 |
+
|
| 75 |
+
**Preprocessing:**
|
| 76 |
+
- Aligned utterances with transcripts.
|
| 77 |
+
- Expression tags inserted inline.
|
| 78 |
+
- Special tokens added to tokenizer.
|
| 79 |
+
|
| 80 |
+
---
|
| 81 |
+
|
| 82 |
+
## Prompt & Input Format
|
| 83 |
+
|
| 84 |
+
Model accepts text input with optional inline expressions:
|
| 85 |
+
|
| 86 |
+
```text
|
| 87 |
+
Hello! <laughs> I can help with your schedule today.
|
| 88 |
+
```
|
| 89 |
+
|
| 90 |
+
Workflow: tokenize → generate audio tokens → decode via vocoder.
|
| 91 |
+
|
| 92 |
+
---
|
| 93 |
+
|
| 94 |
+
## Training Summary
|
| 95 |
+
|
| 96 |
+
- **Objective:** Predict audio tokens from transcripts (with expression markers).
|
| 97 |
+
- **Loss:** Causal LM loss.
|
| 98 |
+
- **Optimizer:** AdamW or AdamW-8bit (please add exact values).
|
| 99 |
+
- **Hyperparameters:** Learning rate, batch size, gradient accumulation, seed — *to be filled with actual values*.
|
| 100 |
+
|
| 101 |
+
---
|
| 102 |
+
|
| 103 |
+
## Evaluation
|
| 104 |
+
|
| 105 |
+
Recommended:
|
| 106 |
+
- **MOS (Mean Opinion Score):** naturalness & expressiveness.
|
| 107 |
+
- **Speaker similarity:** ABX or MOS vs. ground truth.
|
| 108 |
+
- **Intelligibility:** WER via ASR.
|
| 109 |
+
- **Emotion accuracy:** Human rating of `<laughs>`, `<sigh>` cues.
|
| 110 |
+
|
| 111 |
+
Add quantitative results when available.
|
| 112 |
+
|
| 113 |
+
---
|
| 114 |
+
|
| 115 |
+
## Safety & Responsible Use
|
| 116 |
+
|
| 117 |
+
- Use only with documented consent for training voices.
|
| 118 |
+
- Guard against impersonation risks.
|
| 119 |
+
- Consider watermarking or metadata tagging for provenance.
|
| 120 |
+
- Do not generalize beyond training speaker’s identity.
|
| 121 |
+
|
| 122 |
+
---
|
| 123 |
+
|
| 124 |
+
## License & Attribution
|
| 125 |
+
|
| 126 |
+
- **Base model:** `canopylabs/orpheus-3b-0.1-ft` (review base license).
|
| 127 |
+
- **Dataset:** `MrDragonFox/Elise` (check dataset license).
|
| 128 |
+
- **Fine-tune:** Ensure compatibility of licenses.
|
| 129 |
+
|
| 130 |
+
Suggested citation:
|
| 131 |
+
```
|
| 132 |
+
SpeakSpace-Assistant-v1-3B — fine-tune of canopylabs/orpheus-3b-0.1-ft on Alpha AI custom dataset + MrDragonFox/Elise.
|
| 133 |
+
```
|
| 134 |
+
|
| 135 |
+
---
|
| 136 |
+
|
| 137 |
+
## Acknowledgements
|
| 138 |
+
|
| 139 |
+
- canopylabs — Orpheus base model.
|
| 140 |
+
- MrDragonFox — Elise dataset.
|
| 141 |
+
- Alpha AI research & engineering team.
|
| 142 |
+
|
| 143 |
+
---
|
| 144 |
+
|
| 145 |
+
## Contact
|
| 146 |
+
|
| 147 |
+
Questions, issues, or collaborations:
|
| 148 |
+
- Open a discussion on the Hugging Face repo.
|
| 149 |
+
- Enterprise contact (Alpha AI): www.alphaai.biz | corporate@alphaai.biz
|
| 150 |
+
- Enterprise contact (SpeakSpace): www.speakspace.co | connect@speakspace.co
|