Model Card for ethicalabs/Echo-SmolTools-114M-NSFW-CLF-PEFT

GitHub License Python Model Collection Hybrid Collection Working Paper

This repository contains experimental models designed strictly for academic evaluation and research purposes.

Critical Constraints:

  • No Production Deployment: Experimental models must not be deployed in commercial, enterprise, or mission-critical environments under any circumstances.
  • No Liability: Experimental models are provided "as-is" without warranties of any kind. The developers assume zero liability for downstream consequences, system integration failures, or regulatory non-compliance resulting from unauthorized deployment.

The Echo-SmolTools-114M-Intent-PEFT is a a LoRA-based adapter trained over the Echo-DSRN-114M-v0.1.2 base RNN architecture, optimized for binary text routing across the eliasalbouzidi/NSFW-Safe-Dataset.

Model Usage

from peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer

# Load the base model and tokenizer
base_model_name = "ethicalabs/Echo-DSRN-114M-v0.1.2"
base_model = AutoModelForCausalLM.from_pretrained(base_model_name, trust_remote_code=True)
tokenizer = AutoTokenizer.from_pretrained(base_model_name, trust_remote_code=True)

# Load the NSFW adapter
peft_model_name = "ethicalabs/Echo-SmolTools-114M-NSFW-CLF-PEFT"
model = PeftModel.from_pretrained(base_model, peft_model_name, trust_remote_code=True)

# Inference
utt = "only one scene of nudity where two women are briefly topless"
messages = [
    {"role": "system", "content": "You are a helpful NSFW classification assistant."},
    {"role": "user", "content": f"Classify the following text (0 for Safe, 1 for NSFW): {utt}"}
]
prompt = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
inputs = tokenizer(prompt, return_tensors="pt")

# Deterministic Routing
outputs = model.generate(**inputs, max_new_tokens=15, do_sample=False)
response = tokenizer.decode(outputs[0][inputs["input_ids"].shape[1]:], skip_special_tokens=True).strip()

print(f"Classification (1=NSFW, 0=Safe): {response}")

Output:

>>> print(f"Classification (1=NSFW, 0=Safe): {response}")
Classification (1=NSFW, 0=Safe): 1

Base Model: ethicalabs/Echo-DSRN-114M-v0.1.2

πŸ—οΈ Architecture Details

Property Value
Model Type echo_dsrn
Layers 8
Hidden Dim 512
Attention Heads 4
MLP Ratio 8.0
Vocab Size 32011
Hybrid Attention True
RMSNorm True

πŸ“Š Parameter Breakdown

Component Parameters % of Total
Total 114.69M (114,687,488) 100%
Embeddings 16.39M 14.29%
DSRN Blocks (Aggregate) 81.91M 71.42%
LM Head 16.39M 14.29%

🧩 Internal Block Structure (Per Layer)

Sub-Component Parameters Description
MLP (Feed-Forward) 4.20M Upscaled hidden layers
DSRN Slow State 3.15M Constant-time memory gates
GRU Fast State 1.58M Recurrent fast path
Surprise Gating 264,192 Dynamic focus mechanism
Normalization 1,024 LayerNorm / RMSNorm

Evaluation

python echo_nsfw/testing.py /home/ethicalabs/.ethicalabs/flwr/results/2026-04-24_10-16-18/peft_30/
πŸš€ Loading base model: ethicalabs/Echo-DSRN-114M-v0.1.2
`torch_dtype` is deprecated! Use `dtype` instead!
Loading weights: 100%|β–ˆ| 139/139 [00:00<00:00, 3345.89it/s, Materializing param=
πŸ”— Loading LoRA adapter: /home/ethicalabs/.ethicalabs/flwr/results/2026-04-24_10-16-18/peft_30/
πŸ“₯ Loading validation set...
--- 🧠 Deterministic NSFW Validation ---

🌍 Evaluation for 40241 samples...
Testing NSFW: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 40241/40241 [25:07<00:00, 26.70it/s]
========================================
πŸ“Š DETERMINISTIC NSFW VALIDATION REPORT
========================================
Overall Accuracy     |    96.72% | (38921/40241)
========================================

Training procedure

This LoRA adapter has been fine-tuned (SFT) on a single AMD Radeonβ„’ AI PRO R9700 (32 GB RAM) by using the Flower Framework and TRL, in a simulated federated learning scenario.

Training Metrics

training_metrics

Framework versions

  • TRL: 1.1.0
  • Transformers: 5.2.0
  • Pytorch: 2.10.0+rocm7.1
  • Datasets: 4.8.4
  • Tokenizers: 0.22.2
  • Flwr: 1.28.0
  • Flwr-datasets: 0.6.0
Downloads last month
94
Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support

Model tree for ethicalabs/Echo-SmolTools-114M-NSFW-CLF-PEFT

Dataset used to train ethicalabs/Echo-SmolTools-114M-NSFW-CLF-PEFT

Space using ethicalabs/Echo-SmolTools-114M-NSFW-CLF-PEFT 1

Collection including ethicalabs/Echo-SmolTools-114M-NSFW-CLF-PEFT