Download added_tokens.json from CodeIsAbstract/language_parser: direct link, hf CLI and curl.
- Browser
- Download file 80 Bytes
-
https://huggingface.co/CodeIsAbstract/language_parser/resolve/main/added_tokens.json
- Command line
-
hf download hf://CodeIsAbstract/language_parser/added_tokens.json
-
curl -L -o added_tokens.json https://huggingface.co/CodeIsAbstract/language_parser/resolve/main/added_tokens.json
80 Bytes
| { | |
| "<|endoftext|>": 151643, | |
| "<|im_end|>": 151645, | |
| "<|im_start|>": 151644 | |
| } | |