joelniklaus
/

legal-polish-roberta-base

Generated from Trainer

Model card Files Files and versions

Metrics Training metrics Community

legal-polish-roberta-base / tokenizer_config.json

joelniklaus's picture

joelniklaus HF Staff

Training in progress, step 50000

73e72f3 over 3 years ago

Raw History Blame Contribute Delete

395 Bytes

	{
	"bos_token": "<s>",
	"cls_token": "<s>",
	"eos_token": "</s>",
	"mask_token": "<mask>",
	"model_max_length": 512,
	"name_or_path": "data/plms/legal-polish-roberta-base",
	"pad_token": "<pad>",
	"sep_token": "</s>",
	"special_tokens_map_file": "data/plms/legal-polish-roberta-base_32k/special_tokens_map.json",
	"tokenizer_class": "PreTrainedTokenizerFast",
	"unk_token": "<unk>"
	}