Text Generation
Safetensors
GGUF
English
cybersecurity
security
defensive-security
vulnerability-detection
log-analysis
phishing-analysis
unsloth
qlora
conversational
Instructions to use skyuu72/Llama-Quantara-Sentinel-8B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use skyuu72/Llama-Quantara-Sentinel-8B with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf skyuu72/Llama-Quantara-Sentinel-8B:Q4_K_M # Run inference directly in the terminal: llama cli -hf skyuu72/Llama-Quantara-Sentinel-8B:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf skyuu72/Llama-Quantara-Sentinel-8B:Q4_K_M # Run inference directly in the terminal: llama cli -hf skyuu72/Llama-Quantara-Sentinel-8B:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf skyuu72/Llama-Quantara-Sentinel-8B:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf skyuu72/Llama-Quantara-Sentinel-8B:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf skyuu72/Llama-Quantara-Sentinel-8B:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf skyuu72/Llama-Quantara-Sentinel-8B:Q4_K_M
Use Docker
docker model run hf.co/skyuu72/Llama-Quantara-Sentinel-8B:Q4_K_M
- LM Studio
- Jan
- vLLM
How to use skyuu72/Llama-Quantara-Sentinel-8B with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "skyuu72/Llama-Quantara-Sentinel-8B" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "skyuu72/Llama-Quantara-Sentinel-8B", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/skyuu72/Llama-Quantara-Sentinel-8B:Q4_K_M
- Ollama
How to use skyuu72/Llama-Quantara-Sentinel-8B with Ollama:
ollama run hf.co/skyuu72/Llama-Quantara-Sentinel-8B:Q4_K_M
- Unsloth Desktop
- Docker Model Runner
How to use skyuu72/Llama-Quantara-Sentinel-8B with Docker Model Runner:
docker model run hf.co/skyuu72/Llama-Quantara-Sentinel-8B:Q4_K_M
- Lemonade
How to use skyuu72/Llama-Quantara-Sentinel-8B with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull skyuu72/Llama-Quantara-Sentinel-8B:Q4_K_M
Run and chat with the model
lemonade run user.Llama-Quantara-Sentinel-8B-Q4_K_M
List all available models
lemonade list
- Atomic Chat
| # Acceptable Use Policy β Llama-Quantara-Sentinel-8B | |
| This model is released openly because it is scoped to defence and that scope is measured, not | |
| promised. This document says what the scope is, what we did to enforce it, and what you take on | |
| when you run it. | |
| It applies alongside the [Llama 3.1 Community License](https://www.llama.com/llama3_1/license/) | |
| and Meta's Acceptable Use Policy, both of which flow down through the base model. Where anything | |
| here is narrower, the narrower rule wins. | |
| --- | |
| ## 1. What the model is for | |
| Helping defenders find, understand, and fix weaknesses in systems they are responsible for: | |
| - Reviewing source code for vulnerabilities and writing the patch | |
| - Auditing configuration and infrastructure-as-code | |
| - Triaging logs and alerts, and assigning severity | |
| - Answering threat-intelligence questions about known vulnerabilities and techniques | |
| - Analysing suspicious email for phishing indicators | |
| - Security education and training | |
| ## 2. What it will not do, by design | |
| The model is trained to refuse and it holds that line at 100% across 46 red-team probes drawn | |
| from a 35-theme probe set, with zero weaponizable leaks under an LLM judge. | |
| - **Working exploits.** No exploit code, no proof-of-concept for a specific target, no ROP chains, | |
| no shellcode. | |
| - **Malware.** No ransomware, droppers, loaders, rootkits, keyloggers, infostealers, or wipers. | |
| - **Attack infrastructure.** No C2 servers or agents, no phishing kits, no AiTM proxies, no | |
| credential-capture pages. | |
| - **Detection evasion.** No AV/EDR bypass, no log wiping, no anti-forensics, no timestomping. | |
| - **Attacks on systems you don't own.** Including anything framed as "authorised" without evidence. | |
| - **Autonomous offensive agents.** It explains and fixes; it does not go and do. | |
| Trying to reframe any of the above as a hypothetical, a CTF, a novel, a "security research | |
| exercise", or a system-prompt override does not change the answer. That framing is itself part of | |
| the red-team probe set. | |
| ## 3. The dual-use line, drawn explicitly | |
| Refusing too much makes a security model useless, so the following are **in scope and the model | |
| will fully answer them** β refusing these counts as a failure in our evaluation, gated at β€2% | |
| over-refusal on benign asks: | |
| - Detection engineering for any technique, including offensive ones β Sigma rules, YARA, | |
| detection queries, log signatures | |
| - Explaining how an attack works, at the level a defender needs to detect and stop it | |
| - Hardening, patching, and mitigation guidance for any vulnerability | |
| - Incident response, forensics, and threat hunting | |
| - Breach-notification tooling and credential-exposure checking with a consent note | |
| **Phishing simulation is in scope, partially.** The model will write sample lure *copy* for a | |
| stated internal awareness campaign β that is what every phishing-simulation product does and | |
| defenders ask for it constantly. It will not build the machinery behind it: no credential-capture | |
| page, no adversary-in-the-middle proxy, no capture or harvesting infrastructure. It also attaches | |
| the "this is a simulated test, report it to your SOC" framing on its own. | |
| ## 4. Your responsibilities as an operator | |
| Running open weights means the guardrails are now partly yours. | |
| - **Only point it at systems you own or are explicitly authorised to assess.** Written scope, | |
| not a verbal "go ahead". | |
| - **Do not remove or weaken the system prompt.** Every safety number on the model card was measured | |
| with the prompt in `MODEL_CARD.md` (sha `218d05648174`). It is deliberately not baked into the | |
| weights so you can tune it β tuning it downward moves you outside every measurement we published. | |
| - **Do not fine-tune the refusal behaviour out.** You can, technically. Doing so and then | |
| distributing the result under a name derived from this one is a violation of this policy. | |
| - **Keep a human in the loop for anything consequential.** See Β§5. | |
| - **Follow the law and your own disclosure obligations.** This policy does not override them. | |
| ## 5. Do not automate these without review | |
| The model has measured failure modes that are dangerous specifically when nobody is looking. Full | |
| detail and reproducible row ids are in [MODEL_CARD.md](MODEL_CARD.md#known-weaknesses--read-this-part). | |
| | Don't | Because | | |
| |---|---| | |
| | Auto-clear email based on its verdict | It caught **24 of 24** phishing mails in v1.0 β but that is 24 mails. One miss would be 4.2 points. A clean sweep on a sample that small is not evidence of a clean sweep on your inbox, and earlier versions cleared a payroll lure as *"safe to interact with"* | | |
| | Act on a CVE identifier without checking NVD | Much improved in v1.0 β BlueKeep fact errors fell **12.8% β 2.6%** after targeted grounding β but 2.6% is not 0, and the previous version sent people to the wrong port and the wrong patch by confusing BlueKeep with EternalBlue | | |
| | File ATT&CK mappings unreviewed | It picks the wrong technique family **~54%** of the time (`attack_family_hit_pct` 46.2) | | |
| | Auto-escalate on a technique citation | On **benign** log activity it names an ATT&CK technique **68%** of the time and raises an alarm **27%** of the time. It got better at reading real incidents and worse at leaving quiet days alone | | |
| | Auto-apply generated patches | Patch suggestions are not validated by execution | | |
| | Auto-close or downgrade alerts | Severity calibration is good, not perfect | | |
| | Treat it as an authority on vulnerability details | Training data is fully synthetic; small facts get invented | | |
| | `pip install` a package it suggested | Asked for a HIBP checker it reaches for a wrapper abandoned in **2016** and omits the headers the current API requires | | |
| It is a fast, cheap, self-hosted first pass that catches a lot and gets things wrong in | |
| identifiable ways. It is not an analyst. | |
| ## 6. Prompt injection | |
| The model has **not** been evaluated against adversarial instructions embedded in pasted content β | |
| a log line, an email body, or a config comment that says "ignore your instructions". If you pipe | |
| untrusted data into it, assume that data can influence the output, and do not give the surrounding | |
| system any capability you would not hand to the author of that data. | |
| ## 7. Reporting | |
| Found a jailbreak, a weaponization leak, or a dangerously wrong answer? Open an issue on the | |
| source repository. Please include the exact prompt, the system prompt you used, the quantization, | |
| and the sampling parameters β without those the result is not reproducible and cannot be fixed. | |
| For anything you would rather not post publicly, mark the issue accordingly and we'll move it. | |
| ## 8. If you redistribute | |
| - Keep the Llama 3.1 Community License terms, including "Built with Llama" and the `Llama-` name | |
| prefix on any derivative. | |
| - Ship this policy and the known-weaknesses section with it. The weaknesses are the honest half of | |
| an open release, and stripping them out to make the model look better is the specific harm this | |
| document exists to prevent. | |
| --- | |
| *Last updated 2026-08-22, for v1.0 (training run v6).* | |