Hugging Face's logo

Babajaan
/
nanochat-ar

Text Generation
PyTorch
Arabic
arabic
nanochat
causal-lm
hpc
research
from-scratch
Model card Files
xet
 Community
Babajaan commited on
Commit
ca772d0
ยท
verified ยท
1 Parent(s): b6839ad

Add chat smoke test results

Browse files
Files changed (1) hide show
  1. reports/CHAT_TEST_RESULTS.md +109 -0
reports/CHAT_TEST_RESULTS.md ADDED
@@ -0,0 +1,109 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # nanochat-ar Chat Smoke Test
2
+
3
+ Date: 2026-07-02
4
+ Repo: https://huggingface.co/Babajaan/nanochat-ar
5
+ Checkpoint: chatsft_checkpoints/ar-d12-eager/model_000002.pt
6
+ Device: CPU smoke test with NANOCHAT_DTYPE=float32
7
+
8
+ This is a functionality test, not a quality benchmark.
9
+
10
+ ## Prompt
11
+ ู…ุฑุญุจุงุŒ ู…ู† ุฃู†ุชุŸ
12
+
13
+ ## Output
14
+ 2026-07-02 05:45:57,865 - nanochat.common - INFO - Distributed world size: 1
15
+ 2026-07-02 05:45:57,866 - nanochat.checkpoint_manager - INFO - Loading model from /home/bbabajan/nanochat-ar/hf_release_nanochat_ar/chatsft_checkpoints/ar-d12-eager with step 2
16
+ /home/bbabajan/nanochat-ar/nanochat/nanochat/checkpoint_manager.py:64: FutureWarning: You are using `torch.load` with `weights_only=False` (the current default value), which uses the default pickle module implicitly. It is possible to construct malicious pickle data which will execute arbitrary code during unpickling (See https://github.com/pytorch/pytorch/blob/main/SECURITY.md#untrusted-models for more details). In a future release, the default value for `weights_only` will be flipped to `True`. This limits the functions that could be executed during unpickling. Arbitrary objects will no longer be allowed to be loaded via this mode unless they are explicitly allowlisted by the user via `torch.serialization.add_safe_globals`. We recommend you start setting `weights_only=True` for any use case where you don't have full control of the loaded file. Please open an issue on GitHub for any issues related to this experimental feature.
17
+ model_data = torch.load(model_path, map_location=device)
18
+ 2026-07-02 05:45:58,623 - nanochat.checkpoint_manager - INFO - Building model with config: {'sequence_len': 1024, 'vocab_size': 32768, 'n_layer': 12, 'n_head': 6, 'n_kv_head': 6, 'n_embd': 768, 'window_pattern': 'L'}
19
+
20
+ NanoChat Interactive Mode
21
+ --------------------------------------------------
22
+ Type 'quit' or 'exit' to end the conversation
23
+ Type 'clear' to start a new conversation
24
+ --------------------------------------------------
25
+
26
+ Assistant: ุŒ ู‡ูˆ ู„ุงุนุจ ูƒุฑุฉ ู‚ุฏู… ุฑุฌุงู„ูŠุฉ ู…ุบุชุฑุจูˆู† ููŠ ุฌู†ูˆุจ ุบุฑุจ ููŠ ุฅุณุจุงู†ูŠุง ู„ุงุนุจูˆ ูƒุฑุฉ ู‚ุฏู… ุฑูŠุงุถูŠูˆู† ุฅุณูƒุชู„ู†ุฏูŠูˆู† ู…ุบุชุฑุจูˆู† ููŠ ุฅุณุจุงู†ูŠุง ู„ุงุนุจูˆ ูƒุฑุฉ ู‚ุฏู… ุฑุฌุงู„ูŠุฉ ุฃุดุฎุงุต ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ (20 ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ( ูˆู†ุงุฏูŠ ( ูˆู†ุงุฏูŠ ููŠุฑ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ููŠุฑ ู„ุงุนุจูˆ ูˆุณุท ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ู„ุงุนุจูˆ ูƒุฑุฉ ู‚ุฏู… ุฑุฌุงู„ูŠุฉ ุฑูŠุงุถูŠูˆู† ู…ุบุชุฑุจูˆู† ูŠูˆู†ุงูŠุชุฏ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูŠูˆู†ุงูŠุชุฏ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ุขูŠุฑ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ุงู„ู‡ู„ุงู„ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ุจูŠุฑ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ู‡ูŠ ู„ุงุนุจูˆ ุงู„ุฏูˆุฑูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูƒุฑุฉ ู‚ุฏู… ุฑุฌุงู„ูŠุฉ ุฅุณุจุงู† ู…ุบุชุฑุจูˆู† ููŠ ู„ุงุนุจูˆ ูƒุฑุฉ ู‚ุฏู… ุฑุฌุงู„ูŠุฉ ู…ุบุชุฑุจูˆู† ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ุจูˆุช ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ู‡ูˆ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ู„ูƒุฑุฉ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ
27
+
28
+ ---
29
+
30
+ ## Prompt
31
+ ุงูƒุชุจ ุฌู…ู„ุฉ ู‚ุตูŠุฑุฉ ุนู† ุฌุงู…ุนุฉ ุงู„ู…ู„ูƒ ุนุจุฏุงู„ุนุฒูŠุฒ.
32
+
33
+ ## Output
34
+ 2026-07-02 05:46:20,705 - nanochat.common - INFO - Distributed world size: 1
35
+ 2026-07-02 05:46:20,706 - nanochat.checkpoint_manager - INFO - Loading model from /home/bbabajan/nanochat-ar/hf_release_nanochat_ar/chatsft_checkpoints/ar-d12-eager with step 2
36
+ /home/bbabajan/nanochat-ar/nanochat/nanochat/checkpoint_manager.py:64: FutureWarning: You are using `torch.load` with `weights_only=False` (the current default value), which uses the default pickle module implicitly. It is possible to construct malicious pickle data which will execute arbitrary code during unpickling (See https://github.com/pytorch/pytorch/blob/main/SECURITY.md#untrusted-models for more details). In a future release, the default value for `weights_only` will be flipped to `True`. This limits the functions that could be executed during unpickling. Arbitrary objects will no longer be allowed to be loaded via this mode unless they are explicitly allowlisted by the user via `torch.serialization.add_safe_globals`. We recommend you start setting `weights_only=True` for any use case where you don't have full control of the loaded file. Please open an issue on GitHub for any issues related to this experimental feature.
37
+ model_data = torch.load(model_path, map_location=device)
38
+ 2026-07-02 05:46:21,439 - nanochat.checkpoint_manager - INFO - Building model with config: {'sequence_len': 1024, 'vocab_size': 32768, 'n_layer': 12, 'n_head': 6, 'n_kv_head': 6, 'n_embd': 768, 'window_pattern': 'L'}
39
+
40
+ NanoChat Interactive Mode
41
+ --------------------------------------------------
42
+ Type 'quit' or 'exit' to end the conversation
43
+ Type 'clear' to start a new conversation
44
+ --------------------------------------------------
45
+
46
+ Assistant: (ุงู„ (ูˆุจ ุฃูˆ 20 ู‡ูˆ ู„ุงุนุจ ูƒุฑุฉ ู‚ุฏู… ุฑุฌุงู„ูŠุฉ ู‡ูˆ ู„ุงุนุจ ูƒุฑุฉ ู‚ุฏู… ุฑุฌุงู„ูŠุฉ ุฅุณุจุงู† ู…ุบุชุฑุจูˆู† ููŠ ููŠ ุฏูˆุฑุฉ ุงู„ุฃู„ุนุงุจ ุงู„ุขุณูŠูˆูŠุฉ 20 ูˆู†ุงุฏูŠ ููŠุฑ (20 ู„ุงุนุจูˆ ูƒุฑุฉ ู‚ุฏู… ุฑุฌุงู„ูŠุฉ ู…ุบุชุฑุจูˆู† ู…ุบุชุฑุจูˆู† ููŠ ุฌู†ูˆุจ ุดุฑู‚ ุงู„ูˆู„ุงูŠุงุช ุงู„ู…ุชุญุฏุฉ ุฑูŠุงุถูŠูˆู† ุฃุฑุฌู†ุชูŠู†ูŠูˆู† ูˆู†ุงุฏูŠ (20 ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ุจูˆุฑูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ุฏูŠ ูˆู†ุงุฏูŠ ู‡ูŠ ู‡ูˆ ุณูŠุงุณูŠ ุฃูŠุฑู„ู†ุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ุจูŠุฑ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ุฃูˆุฏ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ุฃูˆุฏ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ุจูŠุฑ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ู‡ูˆ ู„ุงุนุจ ูƒุฑุฉ ู‚ุฏู… ุฑุฌุงู„ูŠุฉ ู…ุบุชุฑุจูˆู† ููŠ ุงู„ุฃู„ุนุงุจ ุงู„ุขุณูŠูˆูŠุฉ 20 ุฑูŠุงุถูŠูˆู† ุฅุณูƒุชู„ู†ุฏูŠูˆู† ู…ุบุชุฑุจูˆู† ููŠ ุงู„ุฃู„ุนุงุจ ุงู„ุขุณูŠูˆูŠุฉ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ููŠุงุฑูŠุงู„ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ู‡ูˆ ู„ุงุนุจ ูƒุฑุฉ ู‚ุฏู… ุฑุฌุงู„ูŠุฉ ู…ุบุชุฑุจูˆู† ุฑูŠุงุถูŠูˆู† ู…ุบุชุฑุจูˆู† ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ุงู„ุฏูˆุฑูŠ ุงู„ุฃู„ู…ุงู†ูŠ ู„ุงุนุจูˆ ูƒุฑุฉ ู‚ุฏู… ุฑุฌุงู„ูŠุฉ ู…ุบุชุฑุจูˆู† ููŠ ุฌู…ู‡ูˆุฑูŠุฉ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ููŠุฑ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ู„ุงุนุจูˆ ูƒุฑุฉ ู‚ุฏู… ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ู‡ูˆ ู„ุงุนุจ ูƒุฑุฉ ู‚ุฏู… ู…ุบุชุฑุจูˆู† ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ
47
+
48
+ ---
49
+
50
+ ## Prompt
51
+ ู…ุง ู…ุนู†ู‰ ุงู„ุฐูƒุงุก ุงู„ุงุตุทู†ุงุนูŠุŸ
52
+
53
+ ## Output
54
+ 2026-07-02 05:46:42,587 - nanochat.common - INFO - Distributed world size: 1
55
+ 2026-07-02 05:46:42,588 - nanochat.checkpoint_manager - INFO - Loading model from /home/bbabajan/nanochat-ar/hf_release_nanochat_ar/chatsft_checkpoints/ar-d12-eager with step 2
56
+ /home/bbabajan/nanochat-ar/nanochat/nanochat/checkpoint_manager.py:64: FutureWarning: You are using `torch.load` with `weights_only=False` (the current default value), which uses the default pickle module implicitly. It is possible to construct malicious pickle data which will execute arbitrary code during unpickling (See https://github.com/pytorch/pytorch/blob/main/SECURITY.md#untrusted-models for more details). In a future release, the default value for `weights_only` will be flipped to `True`. This limits the functions that could be executed during unpickling. Arbitrary objects will no longer be allowed to be loaded via this mode unless they are explicitly allowlisted by the user via `torch.serialization.add_safe_globals`. We recommend you start setting `weights_only=True` for any use case where you don't have full control of the loaded file. Please open an issue on GitHub for any issues related to this experimental feature.
57
+ model_data = torch.load(model_path, map_location=device)
58
+ 2026-07-02 05:46:43,388 - nanochat.checkpoint_manager - INFO - Building model with config: {'sequence_len': 1024, 'vocab_size': 32768, 'n_layer': 12, 'n_head': 6, 'n_kv_head': 6, 'n_embd': 768, 'window_pattern': 'L'}
59
+
60
+ NanoChat Interactive Mode
61
+ --------------------------------------------------
62
+ Type 'quit' or 'exit' to end the conversation
63
+ Type 'clear' to start a new conversation
64
+ --------------------------------------------------
65
+
66
+ Assistant: (ู„ูŠ (ุฎูˆุช ู‡ูˆ ุณูŠุงุณูŠ (20) 2013) 10 30 ูŠู†ุงูŠุฑ 17) (20) ู„ุงุนุจ ูƒุฑุฉ ู‚ุฏู… ุฑุฌุงู„ูŠุฉ ุฑูŠุงุถูŠูˆู† ุตุฑุจ ู…ุบุชุฑุจูˆู† ููŠ ุฌู†ูˆุจ ุบุฑุจ ุฃู…ุฑูŠูƒูŠุŒ ุงู„ูˆุงู‚ุน ููŠ ุงู„ูˆู„ุงูŠุงุช) ู‡ูˆ 20 (30) ู‡ูˆ ุณูŠุงุณูŠ ูู„ุณุทูŠู†ูŠ ุฃุดุฎุงุต ุนู„ู‰ (20 ูˆู†ุงุฏูŠ 10 ููŠ ุงู„ูˆู„ุงูŠุงุช ุงู„ู…ุชุญุฏุฉ ุฑูŠุงุถูŠูˆู† ุฑุฌุงู„ูŠุฉ ุฑูŠุงุถูŠูˆู† ุฃู…ุฑูŠูƒูŠูˆู† ููŠ ุงู„ูˆู„ุงูŠุงุช ุงู„ู…ุชุญุฏุฉ ูˆู†ุงุฏูŠ (20 ุนุงุฒููˆ 20 ุฑูŠุงุถูŠูˆู† ุฃู…ุฑูŠูƒูŠูˆู† ููŠ ุงู„ูˆู„ุงูŠุงุช ุงู„ู…ุชุญุฏุฉ ููŠ ุงู„ู‚ุฑู† 20 ุฑูŠุงุถูŠูˆู† ุฑุฌุงู„ูŠุฉ ู…ุบุชุฑุจูˆู† ููŠ ุชุดูŠู„ูŠ ุฑูŠุงุถูŠูˆู† ุฅุณูƒุชู„ู†ุฏูŠูˆู† ุฃุดุฎุงุต ุนู„ู‰ 18 ุฑูŠุงุถูŠูˆู† ู…ุบุชุฑุจูˆู† ููŠ ุงู„ุฃู„ุนุงุจ ุงู„ุขุณูŠูˆูŠุฉ 20 ุนุงุฒููˆ ููŠ ุงู„ุฃู„ุนุงุจ ุงู„ุขุณูŠูˆูŠุฉ 20 ุญุงุฆุฒูˆู† ุนู„ู‰ ู…ูŠุฏุงู„ูŠุงุช ููŠ ุงู„ูˆู„ุงูŠุงุช ุงู„ู…ุชุญุฏุฉ ุฑูŠุงุถูŠูˆู† ุฑุฌุงู„ูŠุฉ ุฅุณุจุงู† ู…ุบุชุฑุจูˆู† ููŠ ุงู„ุฃู„ุนุงุจ ุงู„ุขุณูŠูˆูŠุฉ 18 ุฑูŠุงุถูŠูˆู† ุฅุณูƒุชู„ู†ุฏูŠูˆู† ู„ุงุนุจูˆ ูƒุฑุฉ ู‚ุฏู… ุฑุฌุงู„ูŠุฉ ู…ุบุชุฑุจูˆู† ููŠ ุงู„ูˆู„ุงูŠุงุช ุงู„ู…ุชุญุฏุฉ ุฑูŠุงุถูŠูˆู† ููŠ ุฑูŠุงุถูŠูˆู† ู…ุบุชุฑุจูˆู† ููŠ ุงู„ุฃู„ุนุงุจ ุงู„ุขุณูŠูˆูŠุฉ 20 ู…ุบุชุฑุจูˆู† ููŠ ุฑูˆู…ุงู†ูŠุง ู„ุงุนุจูˆ ูƒุฑุฉ ู‚ุฏู… ุฑุฌุงู„ูŠุฉ ุฑูŠุงุถูŠูˆู† ู…ุบุชุฑุจูˆู† ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ( 20 ุญุงุฆุฒูˆู† ุนู„ู‰ 20 ุนุงุฒููˆ ููŠ ุฑูŠุงุถูŠูˆู† ุฅุณุจุงู† ู„ุงุนุจูˆ ุงู„ุฏูˆุฑูŠ ุงู„ุฅุณูƒุชู„ู†ุฏูŠ ู„ูƒุฑุฉ ู‚ุฏู… ุฑุฌุงู„ูŠุฉ ู…ุบุชุฑุจูˆู† ููŠ ุงู„ุฃู„ุนุงุจ 21 ู…ุฏุงูุนูˆ ูƒุฑุฉ ู‚ุฏู… ุฑุฌุงู„ูŠุฉ ู…ุบุชุฑุจูˆู† ููŠ ุงู„ุฃู„ุนุงุจ ุงู„ุขุณูŠูˆูŠุฉ 18 ุฑูŠุงุถูŠูˆู† ุฅุณุจุงู† ู…ุบุชุฑุจูˆู† ููŠ ู…ุฑูƒุฒ ุฑูŠุงุถูŠูˆู† ุตุฑุจ ูˆู†ุงุฏูŠ ุจูˆุช ูˆู†ุงุฏูŠ ( ูˆู†ุงุฏูŠ (ุณ ู„ุงุนุจูˆ ูƒุฑุฉ ู‚ุฏู… ุฑุฌุงู„ูŠุฉ ู…ุบุชุฑุจูˆู† ููŠ ุฌู…ู‡ูˆุฑูŠุฉ ููŠ ุงู„ุฃู„ุนุงุจ ุงู„ุขุณูŠูˆูŠุฉ ูˆ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูƒุฑุฉ ู‚ุฏู… ุฑุฌุงู„ูŠุฉ ุฃู…ุฑูŠูƒูŠูˆู† ู„ุงุนุจูˆ ูƒุฑุฉ ู‚ุฏู… ุฑุฌุงู„ูŠุฉ ู…ุบุชุฑุจูˆู† ููŠ ุงู„ูˆู„ุงูŠุงุช ุงู„ู…ุชุญุฏุฉ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ูˆู†ุงุฏูŠ ู‡ูˆ ู„ุงุนุจ ูƒุฑุฉ ู‚ุฏู… ู…ุบุชุฑุจูˆู† ู„ุงุนุจูˆ ูƒุฑุฉ ู‚ุฏู… ุฑุฌุงู„ูŠุฉ ู…ุบุชุฑุจูˆู† ููŠ ุจู„ุฌูŠูƒุง ุฑูŠุงุถูŠูˆู† ุฅุณูƒุชู„ู†ุฏูŠูˆู† ุฑูŠุงุถูŠูˆู† ุฑุฌุงู„ูŠุฉ ุฅุณุจุงู† ู…ุบุชุฑุจูˆู† ุชุญุช 20 ุนุงุฒููˆ ู„ุงุนุจูˆ
67
+
68
+ ---
69
+
70
+ ## Prompt
71
+ ู„ุฎุต ุฃู‡ู…ูŠุฉ ุงู„ุญูˆุณุจุฉ ุนุงู„ูŠุฉ ุงู„ุฃุฏุงุก ููŠ ุงู„ุจุญุซ ุงู„ุนู„ู…ูŠ.
72
+
73
+ ## Output
74
+ 2026-07-02 05:47:06,237 - nanochat.common - INFO - Distributed world size: 1
75
+ 2026-07-02 05:47:06,238 - nanochat.checkpoint_manager - INFO - Loading model from /home/bbabajan/nanochat-ar/hf_release_nanochat_ar/chatsft_checkpoints/ar-d12-eager with step 2
76
+ /home/bbabajan/nanochat-ar/nanochat/nanochat/checkpoint_manager.py:64: FutureWarning: You are using `torch.load` with `weights_only=False` (the current default value), which uses the default pickle module implicitly. It is possible to construct malicious pickle data which will execute arbitrary code during unpickling (See https://github.com/pytorch/pytorch/blob/main/SECURITY.md#untrusted-models for more details). In a future release, the default value for `weights_only` will be flipped to `True`. This limits the functions that could be executed during unpickling. Arbitrary objects will no longer be allowed to be loaded via this mode unless they are explicitly allowlisted by the user via `torch.serialization.add_safe_globals`. We recommend you start setting `weights_only=True` for any use case where you don't have full control of the loaded file. Please open an issue on GitHub for any issues related to this experimental feature.
77
+ model_data = torch.load(model_path, map_location=device)
78
+ 2026-07-02 05:47:06,981 - nanochat.checkpoint_manager - INFO - Building model with config: {'sequence_len': 1024, 'vocab_size': 32768, 'n_layer': 12, 'n_head': 6, 'n_kv_head': 6, 'n_embd': 768, 'window_pattern': 'L'}
79
+
80
+ NanoChat Interactive Mode
81
+ --------------------------------------------------
82
+ Type 'quit' or 'exit' to end the conversation
83
+ Type 'clear' to start a new conversation
84
+ --------------------------------------------------
85
+
86
+ Assistant: ุŒ ููŠ 19 ููŠ ุงู„ูˆู„ุงูŠุงุช ุงู„ู…ุชุญุฏุฉุŒ ุงู„ูˆุงู‚๏ฟฝ๏ฟฝ ููŠ ุงู„ุฃู„ุนุงุจ ุงู„ุขุณูŠูˆูŠุฉ 20ุŒุŒ ููŠ 13ุŒ ูˆู„ุฏ ููŠ 20ุŒ ููŠ ุงู„ุฃู„ุนุงุจ ููŠ ุงู„ูˆู„ุงูŠุงุช ุงู„ู…ุชุญุฏุฉุŒุŒ ุจูˆุงุณุทุฉ ููŠ 12ุŒ ุซู… ููŠ ุนุงู… 20. 18ุŒ ููŠ 20 ููŠ ุงู„ูˆู„ุงูŠุงุช ุงู„ู…ุชุญุฏุฉุŒ ุงู„ุชุฑูƒูŠุจุฉ ุงู„ุณูƒุงู†ูŠุฉ ุญุณุจ ููŠ ุชุนุฏุงุฏ ุงู„ูˆู„ุงูŠุงุช ุงู„ู…ุชุญุฏุฉุŒ ุงู„ุชุฑูƒูŠุจุฉ ุงู„ุณูƒุงู†ูŠุฉ ุญุณุจ ููŠ ู…ุฑูƒุฒุŒ ุงู„ุชุฑูƒูŠุจุฉ ุงู„ุณูƒุงู†ูŠุฉุŒ ุงู„ุชุฑูƒูŠุจุฉ ุงู„ุณูƒุงู†ูŠุฉ ููŠ 18ุŒ ููŠ ุงู„ูˆู„ุงูŠุงุช ุงู„ู…ุชุญุฏุฉุŒ 7 ู†ุณู…ุฉุŒ ููŠ 20ุŒ ุงู„ุชุฑูƒูŠุจุฉ ุงู„ุณูƒุงู†ูŠุฉ ุญุณุจ ุชุนุฏุงุฏ ุงู„ูˆู„ุงูŠุงุช ุงู„ู…ุชุญุฏุฉุŒ ุงู„ุชุฑูƒูŠุจุฉ ุงู„ุณูƒุงู†ูŠุฉ ุญุณุจ ุชุนุฏุงุฏุŒ ุงู„ุชุฑูƒูŠุจุฉ ุงู„ุณูƒุงู†ูŠุฉ ุญุณุจ ุชุนุฏุงุฏ ุงู„ูˆู„ุงูŠุงุช ุงู„ู…ุชุญุฏุฉุŒ ุงู„ุชุฑูƒูŠุจุฉ ุงู„ุณูƒุงู†ูŠุฉ ุญุณุจ ุชุนุฏุงุฏ ุงู„ูˆู„ุงูŠุงุชุŒ ุงู„ุชุฑูƒูŠุจุฉ ุงู„ุณูƒุงู†ูŠุฉุŒ ุงู„ุชุฑูƒูŠุจุฉ ุงู„ุณูƒุงู†ูŠุฉ ุญุณุจ ุชุนุฏุงุฏ ุงู„ูˆู„ุงูŠุงุช ุงู„ู…ุชุญุฏุฉุŒ ูˆู„ุนุจ 17ุŒ ุงู„ุชุฑูƒูŠุจุฉ ุงู„ุณูƒุงู†ูŠุฉ ุญุณุจ ุชุนุฏุงุฏ ุชุนุฏุงุฏ ุนุงู… 7 ู†ุณู…ุฉ ููŠ ุงู„ูˆู„ุงูŠุงุช ุงู„ู…ุชุญุฏุฉุŒ ุงู„ุชุฑูƒูŠุจุฉ ุงู„ุณูƒุงู†ูŠุฉุŒ ุงู„ุชุฑูƒูŠุจุฉ ุงู„ุณูƒุงู†ูŠุฉ ููŠ 21ุŒ ุงู„ุชุฑูƒูŠุจุฉ ุงู„ุณูƒุงู†ูŠุฉ 7ุŒ ุงู„ุชุฑูƒูŠุจุฉ ุงู„ุณูƒุงู†ูŠุฉ ุญุณุจ ุชุนุฏุงุฏ ุนุงู… 21ุŒ ุงู„ุชุฑูƒูŠุจุฉ ุงู„ุณูƒุงู†ูŠุฉ ููŠ ุชุนุฏุงุฏ 29 ู†ูˆูู…ุจุฑ 2002ุŒ ุชุนุฏุงุฏ ุงู„ูˆู„ุงูŠุงุช ุงู„ู…ุชุญุฏุฉ. ููŠ ุชุนุฏุงุฏ ุงู„ูˆู„ุงูŠุงุช ุงู„ู…ุชุญุฏุฉุŒ ุงู„ุชุฑูƒูŠุจุฉ ุงู„ุณูƒุงู†ูŠุฉ ููŠ ุชุนุฏุงุฏ ุงู„ูˆู„ุงูŠุงุช ุงู„ู…ุชุญุฏุฉุŒ ุงู„ุชุฑูƒูŠุจุฉ ุงู„ุณูƒุงู†ูŠุฉ ุญุณุจ ุชุนุฏุงุฏ ุนุงู… 21 ููŠ 6 ู†ุณู…ุฉ ููŠ ุนุงู… 2005ุŒ ูˆ 2002ุŒ ุงู„ุชุฑูƒูŠุจุฉ ุงู„ุณูƒุงู†ูŠุฉ ุญุณุจ ุชุนุฏุงุฏ 18ุŒ ุงู„ุชุฑูƒูŠุจุฉ ุงู„ุณูƒุงู†ูŠุฉ ุญุณุจ ุชุนุฏุงุฏ 20ุŒ ุงู„ุชุฑูƒูŠุจุฉ ุงู„ุณูƒุงู†ูŠุฉ ุญุณุจ ุชุนุฏุงุฏ ุนุงู… 2010 ููŠ ุชุนุฏุงุฏ ุงู„ูˆู„ุงูŠุงุช ุงู„ู…ุชุญุฏุฉ. 34 ู†ุณู…ุฉ ุญุณุจ ุชุนุฏุงุฏ ุนุงู… 2010ุŒ ุงู„ุชุฑูƒูŠุจุฉ ุงู„ุณูƒุงู†ูŠุฉ ุญุณุจ ุชุนุฏุงุฏ ุนุงู… 30 ู…ุงูŠูˆ
87
+
88
+ ---
89
+
90
+ ## Prompt
91
+ ุงูƒุชุจ ู‚ุงุฆู…ุฉ ุจุซู„ุงุซ ููˆุงุฆุฏ ู„ุชุนู„ู… ุงู„ุจุฑู…ุฌุฉ.
92
+
93
+ ## Output
94
+ 2026-07-02 05:47:28,115 - nanochat.common - INFO - Distributed world size: 1
95
+ 2026-07-02 05:47:28,117 - nanochat.checkpoint_manager - INFO - Loading model from /home/bbabajan/nanochat-ar/hf_release_nanochat_ar/chatsft_checkpoints/ar-d12-eager with step 2
96
+ /home/bbabajan/nanochat-ar/nanochat/nanochat/checkpoint_manager.py:64: FutureWarning: You are using `torch.load` with `weights_only=False` (the current default value), which uses the default pickle module implicitly. It is possible to construct malicious pickle data which will execute arbitrary code during unpickling (See https://github.com/pytorch/pytorch/blob/main/SECURITY.md#untrusted-models for more details). In a future release, the default value for `weights_only` will be flipped to `True`. This limits the functions that could be executed during unpickling. Arbitrary objects will no longer be allowed to be loaded via this mode unless they are explicitly allowlisted by the user via `torch.serialization.add_safe_globals`. We recommend you start setting `weights_only=True` for any use case where you don't have full control of the loaded file. Please open an issue on GitHub for any issues related to this experimental feature.
97
+ model_data = torch.load(model_path, map_location=device)
98
+ 2026-07-02 05:47:28,858 - nanochat.checkpoint_manager - INFO - Building model with config: {'sequence_len': 1024, 'vocab_size': 32768, 'n_layer': 12, 'n_head': 6, 'n_kv_head': 6, 'n_embd': 768, 'window_pattern': 'L'}
99
+
100
+ NanoChat Interactive Mode
101
+ --------------------------------------------------
102
+ Type 'quit' or 'exit' to end the conversation
103
+ Type 'clear' to start a new conversation
104
+ --------------------------------------------------
105
+
106
+ Assistant: (20 ู‡ูˆ ููŠู„ู… ุฃูˆ 20 ุฃูˆ ุฃูˆ 20ุŒ ู…ู† 20 ุนู„ู‰ ุฃูˆ ุฃูˆ. 13 (20ุŒ ู‡ูŠ ุฅุญุฏู‰ 10 (20ุŒ ุฃูˆ 18). ููŠ ู…ุฏูŠู†ุฉุŒ ุงู„ูˆุงู‚ุน ููŠ 10 ุญุณุจ ุฅุญุตุงุก 20ุŒ 20ุŒ ูˆ 20ุŒ 21ุŒ ูˆ 20ุŒ ููŠ 21) 20ุŒ ู…ู† 20ุŒ ููŠ 20ุŒ 20ุŒ ู‡ูˆ ู…ู† 20ุŒ 20ุŒ 20ุŒ ุฃูˆ 20ุŒ 21ุŒ 17ุŒ 20ุŒ 20ุŒ 18ุŒ 20 ููŠ 20ุŒ ููŠ 20ุŒ 21ุŒ ููŠ 21ุŒ 20ุŒ 18ุŒุŒ ูˆู„ุนุจ 21ุŒ 12ุŒ 29 โ€“ 20ุŒ 21ุŒ ู‡ูˆ 21ุŒ 17ุŒุŒ 21ุŒ ููŠ 18ุŒุŒ 20ุŒ 20ุŒุŒ 29 ู…ุงูŠูˆ โ€“ 20ุŒ 20ุŒ 21ุŒ 20ุŒ 30ุŒ 20 ููŠุŒ 12ุŒุŒ 17ุŒุŒ 12ุŒ 23 ู†ุณู…ุฉุŒ 34ุŒ ููŠ ุงู„ูˆู„ุงูŠุงุช ุงู„ู…ุชุญุฏุฉุŒ ูˆ 12ุŒ 20ุŒุŒ 21 ููŠ 20ุŒุŒ 20ุŒ ููŠ ุงู„ุฏูˆุฑูŠ 20ุŒ 21ุŒ 12ุŒ ููŠ ูุจุฑุงูŠุฑ 17ุŒ
107
+
108
+ ---
109
+