internvl3_5-1b-korean-347k

OpenGVLab/InternVL3_5-1B ๋ฅผ ํ•œ๊ตญ์–ด ๋ฉ€ํ‹ฐ๋ชจ๋‹ฌ ๋ฐ์ดํ„ฐ๋กœ ํŒŒ์ธํŠœ๋‹ํ•œ InternVL3.5 specialist.

ํ•ญ๋ชฉ ๊ฐ’
Base model OpenGVLab/InternVL3_5-1B
Method Full FT
Domain ํ•œ๊ตญ์–ด ์ข…ํ•ฉ 347k

Hyperparameters

  • num_train_epochs: 5
  • steps: 10000 / max 13575
  • train_batch_size: 2
  • peak learning_rate: 3.999999772287927e-05

Training Loss

  • init 1.5136 โ†’ final 0.3429 (min 0.3178)
step loss
10 1.5136
1010 0.7029
2010 0.6294
3010 0.5353
4010 0.4988
5010 0.5090
6010 0.4190
7010 0.4065
8010 0.3964
9010 0.3448
10000 0.3429

Training Data

๊ตฌ์„ฑ: 18๊ฐœ ์„œ๋ธŒ์…‹ (ํ•œ๊ตญ์–ด specialist SFT)

subset repeat
aihub_visual_ShortQA_30k 1
hf_korLlava_Caption_20k 1
llava_ko_recap_30k 1
out_kor_llava_20k 1
chartRqa1_30k 1
chartRqa2_20k 1
tableVqa_Reason_20k 1
tableVqa_Caption_20k 1
aihub_subjectTxt_OCR_20k 1
aihub_visual_OCR_15k 1
kisti_arxiv_OCR_15k 1
kisti_hanbat_Reason_30k 1
kisti_documen_Reason_10k 1
aihub_mathMultiple_kor_M0 1
aihub_mathSubjective_kor_M0 1
kisti_hanbat_Vqa_25k 1
hf_latexUpdate_15k 1
aihub_subjectImg_Parse_10k 1

Usage

from transformers import AutoModel, AutoTokenizer
import torch
m = AutoModel.from_pretrained("yujuyeon/internvl3_5-1b-korean-347k", torch_dtype=torch.bfloat16,
                              trust_remote_code=True).eval().cuda()
tok = AutoTokenizer.from_pretrained("yujuyeon/internvl3_5-1b-korean-347k", trust_remote_code=True, use_fast=False)
Downloads last month
52
Safetensors
Model size
1B params
Tensor type
BF16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for yujuyeon/internvl3_5-1b-korean-347k