Instructions to use JSALT2026-Conv-AI-Simulator/personaplex-fisher-bc-head with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use JSALT2026-Conv-AI-Simulator/personaplex-fisher-bc-head with PEFT:
Task type is invalid.
- Moshi
How to use JSALT2026-Conv-AI-Simulator/personaplex-fisher-bc-head with Moshi:
# pip install moshi # Run the interactive web server python -m moshi.server --hf-repo "JSALT2026-Conv-AI-Simulator/personaplex-fisher-bc-head" # Then open https://localhost:8998 in your browser
# pip install moshi import torch from moshi.models import loaders # Load checkpoint info from HuggingFace checkpoint = loaders.CheckpointInfo.from_hf_repo("JSALT2026-Conv-AI-Simulator/personaplex-fisher-bc-head") # Load the Mimi audio codec mimi = checkpoint.get_mimi(device="cuda") mimi.set_num_codebooks(8) # Encode audio (24kHz, mono) wav = torch.randn(1, 1, 24000 * 10) # [batch, channels, samples] with torch.no_grad(): codes = mimi.encode(wav.cuda()) decoded = mimi.decode(codes) - Notebooks
- Google Colab
- Kaggle
File size: 1,998 Bytes
d9ead80 2e6ab4d d9ead80 2e6ab4d d9ead80 2e6ab4d d9ead80 2e6ab4d d9ead80 2e6ab4d d9ead80 2e6ab4d d9ead80 2e6ab4d d9ead80 2e6ab4d | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 | ---
base_model: nvidia/personaplex-7b-v1
library_name: peft
license: other
license_name: nvidia-open-model-license
license_link: https://huggingface.co/nvidia/personaplex-7b-v1
datasets:
- JSALT2026-Conv-AI-Simulator/fisher-v1
tags:
- lora
- personaplex
- moshi
- full-duplex
- speech-to-speech
- backchannel
---
# PersonaPlex Backchannel Head
This HF repository contains a LoRA adapter for [PersonaPlex-7B](https://huggingface.co/nvidia/personaplex-7b-v1) that adds a lightweight, controllable backchannel head, introduced in [Controlling Backchannels in Streamable Full-Duplex Models](https://arxiv.org/abs/2609.29418).
About our work: Backchannels, brief acknowledgements like "uh-huh" produced while the other party may still be talking, are central to natural conversation, but full-duplex spoken dialogue models rarely model them explicitly. We introduce a lightweight backchannel head that predicts, from a full-duplex model's own hidden states, when a backchannel should begin. Once this probability crosses a tunable threshold, a backchannel is force-decoded. Attached to both a 7B (PersonaPlex) and a 1B (F-Actor) model, it generalizes across scale. Probing confirms the hidden states anticipate real human timing, and generation evaluation shows more frequent, better-timed backchannels. Human raters judge the resulting backchannels on par with real ones.
Please refer to the [codebase](https://github.com/MaikeZuefle/bcmore) for the usage of the model.
For more information, please have a look at the paper.
## Citation
If you use this model, please cite:
```bibtex
@misc{züfle2026controllingbackchannelsstreamablefullduplex,
title={Controlling Backchannels in Streamable Full-duplex Models},
author={Maike Züfle and Peter Polák and Sefik Emre Eskimez and Jan Niehues and Peter Bell and Ondřej Klejch},
year={2026},
eprint={2609.29418},
archivePrefix={arXiv},
primaryClass={cs.CL},
url={https://arxiv.org/abs/2609.29418},
}
```
|