tokyotech-llm/swallow-code
Viewer • Updated • 129M • 1.66k • 67
SwallowCode
Rewriting Pre-Training Data Boosts LLM Performance in Math and Code
-
-
tokyotech-llm/Llama-3.1-8B-code-ablation-exp1-LR2.5e-5-MINLR2.5E-6-WD0.1-iter0002500
8B • Updated • 52 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp1-LR2.5e-5-MINLR2.5E-6-WD0.1-iter0005000
8B • Updated • 60 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp1-LR2.5e-5-MINLR2.5E-6-WD0.1-iter0007500
8B • Updated • 58 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp1-LR2.5e-5-MINLR2.5E-6-WD0.1-iter0010000
8B • Updated • 54 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp1-LR2.5e-5-MINLR2.5E-6-WD0.1-iter0012500
8B • Updated • 62 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp2-LR2.5e-5-MINLR2.5E-6-WD0.1-iter0002500
8B • Updated • 59 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp2-LR2.5e-5-MINLR2.5E-6-WD0.1-iter0005000
8B • Updated • 56 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp2-LR2.5e-5-MINLR2.5E-6-WD0.1-iter0007500
8B • Updated • 59 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp2-LR2.5e-5-MINLR2.5E-6-WD0.1-iter0010000
8B • Updated • 57 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp2-LR2.5e-5-MINLR2.5E-6-WD0.1-iter0012500
8B • Updated • 52 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp3-LR2.5e-5-MINLR2.5E-6-WD0.1-iter0002500
8B • Updated • 61 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp3-LR2.5e-5-MINLR2.5E-6-WD0.1-iter0005000
8B • Updated • 58 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp3-LR2.5e-5-MINLR2.5E-6-WD0.1-iter0007500
8B • Updated • 60 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp3-LR2.5e-5-MINLR2.5E-6-WD0.1-iter0010000
8B • Updated • 51 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp3-LR2.5e-5-MINLR2.5E-6-WD0.1-iter0012500
8B • Updated • 57 • 1 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp4-LR2.5e-5-MINLR2.5E-6-WD0.1-iter0002500
8B • Updated • 47 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp4-LR2.5e-5-MINLR2.5E-6-WD0.1-iter0005000
8B • Updated • 52 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp4-LR2.5e-5-MINLR2.5E-6-WD0.1-iter0007500
8B • Updated • 47 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp4-LR2.5e-5-MINLR2.5E-6-WD0.1-iter0010000
8B • Updated • 51 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp4-LR2.5e-5-MINLR2.5E-6-WD0.1-iter0012500
8B • Updated • 51 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp5-Llama-3.3-70B-LR2.5e-5-WD0.1-iter0002500
8B • Updated • 48 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp5-Llama-3.3-70B-LR2.5e-5-WD0.1-iter0005000
8B • Updated • 49 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp5-Llama-3.3-70B-LR2.5e-5-WD0.1-iter0007500
8B • Updated • 49 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp5-Llama-3.3-70B-LR2.5e-5-WD0.1-iter0010000
8B • Updated • 50 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp5-Llama-3.3-70B-LR2.5e-5-WD0.1-iter0012500
8B • Updated • 51 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp6-Llama-3.3-70B-LR2.5e-5-WD0.1-iter0002500
8B • Updated • 53 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp6-Llama-3.3-70B-LR2.5e-5-WD0.1-iter0005000
8B • Updated • 48 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp6-Llama-3.3-70B-LR2.5e-5-WD0.1-iter0007500
8B • Updated • 50 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp6-Llama-3.3-70B-LR2.5e-5-WD0.1-iter0010000
8B • Updated • 53 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp6-Llama-3.3-70B-LR2.5e-5-WD0.1-iter0012500
8B • Updated • 51 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp7-Llama-3.3-70B-LR2.5e-5-WD0.1-iter0002500
8B • Updated • 56 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp7-Llama-3.3-70B-LR2.5e-5-WD0.1-iter0005000
8B • Updated • 48 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp7-Llama-3.3-70B-LR2.5e-5-WD0.1-iter0007500
8B • Updated • 50 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp7-Llama-3.3-70B-LR2.5e-5-WD0.1-iter0010000
8B • Updated • 51 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp7-Llama-3.3-70B-LR2.5e-5-WD0.1-iter0012500
8B • Updated • 50 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp8-LR2.5e-5-WD0.1-iter0002500
8B • Updated • 53 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp8-LR2.5e-5-WD0.1-iter0005000
8B • Updated • 50 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp8-LR2.5e-5-WD0.1-iter0007500
8B • Updated • 49 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp8-LR2.5e-5-WD0.1-iter0010000
8B • Updated • 50 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp8-LR2.5e-5-WD0.1-iter0012500
8B • Updated • 50 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp9-LR2.5e-5-WD0.1-iter0002500
8B • Updated • 56 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp9-LR2.5e-5-WD0.1-iter0005000
8B • Updated • 48 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp9-LR2.5e-5-WD0.1-iter0007500
8B • Updated • 50 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp9-LR2.5e-5-WD0.1-iter0010000
8B • Updated • 50 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp9-LR2.5e-5-WD0.1-iter0012500
8B • Updated • 54 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp10-LR2.5e-5-WD0.1-iter0002500
8B • Updated • 49 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp10-LR2.5e-5-WD0.1-iter0005000
8B • Updated • 51 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp10-LR2.5e-5-WD0.1-iter0007500
8B • Updated • 47 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp10-LR2.5e-5-WD0.1-iter0010000
8B • Updated • 54 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp10-LR2.5e-5-WD0.1-iter0012500
8B • Updated • 47 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp11-LR2.5e-5-WD0.1-iter0002500
8B • Updated • 51 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp11-LR2.5e-5-WD0.1-iter0005000
8B • Updated • 49 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp11-LR2.5e-5-WD0.1-iter0007500
8B • Updated • 49 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp11-LR2.5e-5-WD0.1-iter0010000
8B • Updated • 49 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp11-LR2.5e-5-WD0.1-iter0012500
8B • Updated • 48 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp12-LR2.5e-5-WD0.1-iter0002500
8B • Updated • 54 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp12-LR2.5e-5-WD0.1-iter0005000
8B • Updated • 48 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp12-LR2.5e-5-WD0.1-iter0007500
8B • Updated • 46 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp12-LR2.5e-5-WD0.1-iter0010000
8B • Updated • 48 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp12-LR2.5e-5-WD0.1-iter0012500
8B • Updated • 50 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp13-LR2.5e-5-WD0.1-iter0002500
8B • Updated • 46 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp13-LR2.5e-5-WD0.1-iter0005000
8B • Updated • 46 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp13-LR2.5e-5-WD0.1-iter0007500
8B • Updated • 49 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp13-LR2.5e-5-WD0.1-iter0010000
8B • Updated • 49 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp13-LR2.5e-5-WD0.1-iter0012500
8B • Updated • 47