MagistrTheOne's picture
NULLXES-LÆTEX-100M-Stage0a-v0 identity bootstrap
786df5b verified
|
Raw
History Blame Contribute Delete
1.88 kB
metadata
language:
  - en
  - ru
license: other
library_name: transformers
tags:
  - nullxes
  - latex
  - causal-lm
  - stage0a
  - research
pipeline_tag: text-generation

NULLXES-LÆTEX-100M-Stage0a-v0

First trained brain of the NULLXES-LÆTEX family (~102M params, dense NHAT).

Developed by NULLXES · nullxesdai.online · org on Hub via MagistrTheOne

What this is

  • Own architecture (LatexForCausalLM, model_type=latex)
  • Own tokenizer (NULLXES-LÆTEX v0.1, vocab export 131072, ~4k real Unigram pieces + unused pad)
  • Bootstrap pretrain on NULLXES identity + repo code corpus (~50M tokens)
  • Intended to answer as LÆTEX / NULLXES-LÆTEX, not as ChatGPT/Claude/Llama

What this is NOT

  • Not a general-purpose LLM
  • Not Chinchilla-scale pretrain (tiny corpus → heavy memorization / overfit)
  • Not the 7B genesis (separate architectural checkpoint)
  • Not distilled from Qwen/Llama/Mistral/DeepSeek

Load

import torch
from transformers import AutoModelForCausalLM, AutoConfig

# registers custom classes
repo = "MagistrTheOne/NULLXES-L-TEX-100M-Stage0a-v0"
config = AutoConfig.from_pretrained(repo, trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained(
    repo, trust_remote_code=True, torch_dtype=torch.bfloat16
)

Tokenizer artifacts ship in-repo (tokenizer.model, special_tokens.json). Prefer loading via the research package LatexTokenizer from the NULLXES-LÆTEX GitHub when doing local QA.

Identity

Correct self-name: NULLXES-LÆTEX (short: LÆTEX), built by NULLXES for Digital Employees.

Training note

Stage0a bootstrap: ~50M tokens, final train loss ~0.01 on a small identity/code mix. Treat as research brick #1, not production intelligence.