File size: 798 Bytes
869c26f | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 | ---
base_model: fdtn-ai/Foundation-Sec-8B-Instruct
tags:
- quantized
- nvfp4
- tensorrt
- foundation-sec-8b-instruct
- cybersecurity
---
# Foundation-Sec-8B-Instruct-NVFP4-quantized
This repository contains an NVFP4 quantized version of the
[fdtn-ai/Foundation-Sec-8B-Instruct](https://huggingface.co/fdtn-ai/Foundation-Sec-8B-Instruct) model, optimized for NVIDIA Spark using TensorRT Model Optimizer.
## Quantization Details
- Quantization Method: NVFP4
- Base Model: [fdtn-ai/Foundation-Sec-8B-Instruct](https://huggingface.co/fdtn-ai/Foundation-Sec-8B-Instruct)
- Tool: NVIDIA TensorRT Model Optimizer
- Environment: NVIDIA Spark
## Loading
Refer to TensorRT-LLM or your deployment stack for loading NVFP4 artifacts.
## License
(Inherit from base model if applicable, or specify your own)
|