Any-to-Any
Transformers
ONNX
Safetensors
English
Chinese
multimodal
audio
video
speech
streaming
full-duplex
long-video
custom-code
Instructions to use inclusionAI/Realtime-Venus with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use inclusionAI/Realtime-Venus with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("inclusionAI/Realtime-Venus", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Download Realtime-Venus-Omni/preprocessor_config.json from inclusionAI/Realtime-Venus: direct link, hf CLI and curl.
- Browser
- Download file 929 Bytes
-
https://huggingface.co/inclusionAI/Realtime-Venus/resolve/main/Realtime-Venus-Omni/preprocessor_config.json
- Command line
-
hf download hf://inclusionAI/Realtime-Venus/Realtime-Venus-Omni/preprocessor_config.json
-
curl -L -o preprocessor_config.json https://huggingface.co/inclusionAI/Realtime-Venus/resolve/main/Realtime-Venus-Omni/preprocessor_config.json
929 Bytes
| { | |
| "image_processor_type": "RealtimeVenusOmniImageProcessor", | |
| "feature_extractor_type": "RealtimeVenusOmniAudioProcessor", | |
| "auto_map": { | |
| "AutoProcessor": "processing_realtime_venus_omni.RealtimeVenusOmniProcessor", | |
| "AutoImageProcessor": "processing_realtime_venus_omni.RealtimeVenusOmniImageProcessor", | |
| "AutoFeatureExtractor": "processing_realtime_venus_omni.RealtimeVenusOmniAudioProcessor" | |
| }, | |
| "processor_class": "RealtimeVenusOmniProcessor", | |
| "max_slice_nums": 9, | |
| "scale_resolution": 448, | |
| "patch_size": 14, | |
| "use_image_id": true, | |
| "image_feature_size": 64, | |
| "im_start": "<image>", | |
| "im_end": "</image>", | |
| "slice_start": "<slice>", | |
| "slice_end": "</slice>", | |
| "unk": "<unk>", | |
| "im_id_start": "<image_id>", | |
| "im_id_end": "</image_id>", | |
| "slice_mode": true, | |
| "audio_pool_step": 5, | |
| "norm_mean": [ | |
| 0.5, | |
| 0.5, | |
| 0.5 | |
| ], | |
| "norm_std": [ | |
| 0.5, | |
| 0.5, | |
| 0.5 | |
| ], | |
| "version": 4.5 | |
| } |