Image-Text-to-Text
Transformers
Safetensors
qwen3_5
onejev
system-one
decision-model
calibration
multimodal
gui-agent
video
fp8
conversational
compressed-tensors
Instructions to use OmniJev/OneJev-27B-FP8 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use OmniJev/OneJev-27B-FP8 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("image-text-to-text", model="OmniJev/OneJev-27B-FP8") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] pipe(text=messages)# Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("OmniJev/OneJev-27B-FP8") model = AutoModelForMultimodalLM.from_pretrained("OmniJev/OneJev-27B-FP8", device_map="auto") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] inputs = processor.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use OmniJev/OneJev-27B-FP8 with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "OmniJev/OneJev-27B-FP8" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "OmniJev/OneJev-27B-FP8", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker
docker model run hf.co/OmniJev/OneJev-27B-FP8
- SGLang
How to use OmniJev/OneJev-27B-FP8 with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "OmniJev/OneJev-27B-FP8" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "OmniJev/OneJev-27B-FP8", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "OmniJev/OneJev-27B-FP8" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "OmniJev/OneJev-27B-FP8", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }' - Docker Model Runner
How to use OmniJev/OneJev-27B-FP8 with Docker Model Runner:
docker model run hf.co/OmniJev/OneJev-27B-FP8
|
Download README.md from OmniJev/OneJev-27B-FP8: direct link, hf CLI and curl.
- Browser
- Download file 3.74 kB
-
https://huggingface.co/OmniJev/OneJev-27B-FP8/resolve/main/README.md
- Command line
-
hf download hf://OmniJev/OneJev-27B-FP8/README.md
-
curl -L -o README.md https://huggingface.co/OmniJev/OneJev-27B-FP8/resolve/main/README.md
3.74 kB
| license: apache-2.0 | |
| base_model: OmniJev/OneJev-27B | |
| library_name: transformers | |
| datasets: | |
| - OmniJev/OneJev-Data | |
| pipeline_tag: image-text-to-text | |
| tags: [onejev, system-one, decision-model, calibration, multimodal, gui-agent, video, fp8] | |
| <p align="center"> | |
| <picture> | |
| <source media="(prefers-color-scheme: dark)" srcset="assets/banner-dark.svg"> | |
| <img alt="OneJev-27B-FP8, a Multimodal System One Decision Model" src="assets/banner.svg" width="100%"> | |
| </picture> | |
| </p> | |
| <p align="center"> | |
| <a href="https://huggingface.co/collections/OmniJev/onejev"><img alt="Hugging Face" src="https://img.shields.io/badge/Hugging_Face-OneJev-FFD21E?style=flat-square&logo=huggingface&logoColor=black"></a> | |
| <a href="https://huggingface.co/spaces/BradNLP/OneJev"><img alt="Demo" src="https://img.shields.io/badge/Demo-Try_it-D45BB6?style=flat-square&logo=gradio&logoColor=white"></a> | |
| <a href="https://github.com/OmniJev/OneJev"><img alt="GitHub" src="https://img.shields.io/badge/GitHub-OmniJev%2FOneJev-181717?style=flat-square&logo=github&logoColor=white"></a> | |
| <a href="https://omnijev.github.io/OneJev/"><img alt="Website" src="https://img.shields.io/badge/Website-OneJev-0A84FF?style=flat-square&logo=googlechrome&logoColor=white"></a> | |
| <a href="https://huggingface.co/datasets/OmniJev/OneJev-Data"><img alt="Data" src="https://img.shields.io/badge/Data-OneJev--Data-FF9D00?style=flat-square&logo=huggingface&logoColor=white"></a> | |
| <a href="https://github.com/OmniJev/OneJev/blob/main/LICENSE"><img alt="License" src="https://img.shields.io/badge/License-Apache_2.0-D22128?style=flat-square&logo=apache&logoColor=white"></a> | |
| </p> | |
| [OneJev-27B](https://huggingface.co/OmniJev/OneJev-27B) with its decoder weights in 8-bit floating point, one scale per weight row and per token: 30.4 GB instead of 54.7 GB, so it fits on one 48 GB GPU. On 229 test rows it gives the 16-bit model's answer on 226 (98.7%), accuracy 65.5 for 16-bit and 66.4 for 8-bit. It needs a GPU with FP8 (L40S, H100, H200 and newer). | |
| On one H200 with a 1280x720 screenshot it answers 1 question in 168 ms and 10 questions in one request in 298 ms, against 189 ms and 324 ms for 16-bit. | |
| ## Quick start | |
| ```bash | |
| pip install "qev[torch] @ git+https://github.com/OmniJev/OneJev.git" | |
| qev serve --model OmniJev/OneJev-27B-FP8 | |
| ``` | |
| ```python | |
| from qev import Client, Choice, Noul | |
| from qev.media import data_uri | |
| r = Client("http://localhost:8000").system_one( | |
| state={"task": "Pay the open invoice from ACME", "screen": "<image:1>"}, | |
| media=[{"type": "image", "data": data_uri("screenshot.png")}], | |
| questions={"done": Noul("The invoice has been paid"), | |
| "next": Choice("What should the agent do next?", {"click": "click an element", "stop": "stop"})}, | |
| ) | |
| ``` | |
| The server speaks TypeSafe's System One API plus a `media` field for images and video. More examples, the latency | |
| benchmark and the code are on [GitHub](https://github.com/OmniJev/OneJev). | |
| ## All sizes | |
| | Model | Base | Weights | | |
| |---|---|---:| | |
| | [OneJev-0.8B](https://huggingface.co/OmniJev/OneJev-0.8B) | Qwen3.5-0.8B | 2.2 GB | | |
| | [OneJev-4B](https://huggingface.co/OmniJev/OneJev-4B) | Qwen3.5-4B | 10.4 GB | | |
| | [OneJev-9B](https://huggingface.co/OmniJev/OneJev-9B) | Qwen3.5-9B | 18.8 GB | | |
| | [OneJev-27B](https://huggingface.co/OmniJev/OneJev-27B) | Qwen3.8-27B | 54.7 GB | | |
| | **OneJev-27B-FP8** | OneJev-27B in 8-bit | 30.4 GB | | |
| All sizes are in the [OneJev collection](https://huggingface.co/collections/OmniJev/onejev). | |
| ## Citation | |
| ```bibtex | |
| @misc{onejev2026, | |
| title = {{OneJev}: A Multimodal System One Decision Model}, | |
| author = {{OmniJev Team}}, | |
| year = {2026}, | |
| howpublished = {\url{https://github.com/OmniJev/OneJev}} | |
| } | |
| ``` | |
| ## License | |
| Apache 2.0 | |