How to use from
llama.cpp
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf yugsisodiya/jarvis
# Run inference directly in the terminal:
llama cli -hf yugsisodiya/jarvis
Install from WinGet (Windows)
winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf yugsisodiya/jarvis
# Run inference directly in the terminal:
llama cli -hf yugsisodiya/jarvis
Use pre-built binary
# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf yugsisodiya/jarvis
# Run inference directly in the terminal:
./llama-cli -hf yugsisodiya/jarvis
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf yugsisodiya/jarvis
# Run inference directly in the terminal:
./build/bin/llama-cli -hf yugsisodiya/jarvis
Use Docker
docker model run hf.co/yugsisodiya/jarvis
Quick Links

Jarvis (v2)

Jarvis is an advanced neural intelligence model trained and compiled with the J.A.R.V.I.S. Neural Forge studio by Yug Sisodiya.

🚀 Quickstart with Ollama

Run this model with a single command via Ollama:

ollama run hf.co/yugsisodiya/jarvis

Model Overview

  • Model Name: Jarvis
  • Release Version: v2
  • Base Foundation: Jarvis (J.A.R.V.I.S. Neural Architecture)
  • Neural Architecture: jarvis-grand-architecture
  • Context Window: 131072 tokens
  • GGUF Weights: Available (jarvis.gguf)

Architecture Highlights

  • Fully integrated with the J.A.R.V.I.S. unified cognitive assistant architecture.
  • Optimized for low-latency interactive inference, multi-domain reasoning, and executive problem solving.
  • Checkpointed neural weights verified in local studio runtime.

Platform Integration

This model is accessible within the J.A.R.V.I.S. Command Console on port 4700 and compatible with local neural inference pipelines.

Downloads last month
322
GGUF
Model size
7B params
Architecture
llama
Hardware compatibility
Log In to add your hardware

We're not able to determine the quantization variants.

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support