jieying0729
/

olmo3-190m-zh-full-4000-continue

continued-pretraining

Model card Files Files and versions

olmo3-190m-zh-full-4000-continue

378 MB

Ctrl+K

Ctrl+K

1 contributor

History: 2 commits

jieying0729's picture

llm001 L04 Continue: 200 steps, loss 5.53, catastrophic forgetting observed

78f47f8 verified 5 months ago

.gitattributes

1.52 kB
initial commit 5 months ago
README.md

787 Bytes
llm001 L04 Continue: 200 steps, loss 5.53, catastrophic forgetting observed 5 months ago
chat_template.jinja

427 Bytes
llm001 L04 Continue: 200 steps, loss 5.53, catastrophic forgetting observed 5 months ago
config.json

1 kB
llm001 L04 Continue: 200 steps, loss 5.53, catastrophic forgetting observed 5 months ago
generation_config.json

225 Bytes
llm001 L04 Continue: 200 steps, loss 5.53, catastrophic forgetting observed 5 months ago
model.safetensors

374 MB
xet

llm001 L04 Continue: 200 steps, loss 5.53, catastrophic forgetting observed 5 months ago
tokenizer.json

3.91 MB
llm001 L04 Continue: 200 steps, loss 5.53, catastrophic forgetting observed 5 months ago
tokenizer_config.json

300 Bytes
llm001 L04 Continue: 200 steps, loss 5.53, catastrophic forgetting observed 5 months ago
training_args.bin
Detected Pickle imports (10)
- "accelerate.utils.dataclasses.DistributedType",
- "transformers.trainer_pt_utils.AcceleratorConfig",
- "transformers.training_args.TrainingArguments",
- "transformers.trainer_utils.SchedulerType",
- "torch.device",
- "transformers.trainer_utils.HubStrategy",
- "accelerate.state.PartialState",
- "transformers.trainer_utils.SaveStrategy",
- "transformers.training_args.OptimizerNames",
- "transformers.trainer_utils.IntervalStrategy"
How to fix it?
4.86 kB
xet

llm001 L04 Continue: 200 steps, loss 5.53, catastrophic forgetting observed 5 months ago