Add README with quantization metadata

869c26f verified 11 months ago

798 Bytes

base_model: fdtn-ai/Foundation-Sec-8B-Instruct
tags:
  - quantized
  - nvfp4
  - tensorrt
  - foundation-sec-8b-instruct
  - cybersecurity

Foundation-Sec-8B-Instruct-NVFP4-quantized

This repository contains an NVFP4 quantized version of the fdtn-ai/Foundation-Sec-8B-Instruct model, optimized for NVIDIA Spark using TensorRT Model Optimizer.

Quantization Details

Quantization Method: NVFP4
Base Model: fdtn-ai/Foundation-Sec-8B-Instruct
Tool: NVIDIA TensorRT Model Optimizer
Environment: NVIDIA Spark

Loading

Refer to TensorRT-LLM or your deployment stack for loading NVFP4 artifacts.

License

(Inherit from base model if applicable, or specify your own)