Navya-1c-sft-dpo-grpo-reasoning

A reasoning-distilled variant of the India-first Navya-1c chat model (1.31B params).

This is the 1.31B Navya-1c lineage โ€” from-scratch base (~103B tokens + WSD cooldown on 8ร—H100) โ†’ SFT โ†’ DPO โ†’ GRPO โ†’ reasoning distillation โ€” taught to answer with an explicit <think>โ€ฆ</think> chain-of-thought before its final answer. The reasoning teacher was a locally-run deepseek-r1:14b (R1-Distill) over India personal-finance prompts.

Output format:

<think>
step-by-step reasoning about the question
</think>

final answer

โš ๏ธ Status: research proof-of-concept

This checkpoint demonstrates the <think> reasoning habit but was distilled on a small purpose-built corpus and overfits it (train loss โ†’ ~0, validation loss rising). It reliably produces the reasoning format, but is not a production-grade reasoning model โ€” treat it as a research PoC. The flagship production chat model remains navyam-ai/navya-1c-sft.

Research model โ€” not investment advice. Small model; verify anything consequential.

Intended use

India personal-finance Q&A (savings, SIPs, loans, credit, insurance, tax) in English and Hindi/Hinglish, with visible step-by-step reasoning.

Details

  • Params: 1.31B ยท Author: Navyam AI (Bachatt)
  • Architecture: Llama-recipe โ€” dim 2048, 26 layers, GQA 16/4 heads, SwiGLU, RMSNorm, RoPE, tied embeddings, 64k vocab, 4096 context
  • Tokenizer: custom tokenizer-v0.3-64k
  • Chat template: navya-chat-v1 (role tokens <|reserved_0..4|>)
  • Lineage: navya-1c (base) โ†’ sft โ†’ dpo โ†’ grpo โ†’ reasoning distillation (deepseek-r1:14b teacher)
  • Source: https://github.com/bachatt-app/navyam-gpt
  • License: Apache-2.0
Downloads last month
123
Safetensors
Model size
1B params
Tensor type
F32
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for navyam-ai/navya-1c-sft-dpo-grpo-reasoning

Finetuned
(1)
this model

Collection including navyam-ai/navya-1c-sft-dpo-grpo-reasoning