Instructions to use conradcompagna/burmese-pos-dependency-spacy with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- spaCy
How to use conradcompagna/burmese-pos-dependency-spacy with spaCy:
!pip install https://huggingface.co/conradcompagna/burmese-pos-dependency-spacy/resolve/main/burmese-pos-dependency-spacy-any-py3-none-any.whl # Using spacy.load(). import spacy nlp = spacy.load("burmese-pos-dependency-spacy") # Importing as module. import burmese-pos-dependency-spacy nlp = burmese-pos-dependency-spacy.load() - Notebooks
- Google Colab
- Kaggle
Conrad Compagna commited on
Stage trained model weights and provenance
Browse files- .gitattributes +5 -0
- README.md +79 -0
- THIRD_PARTY_NOTICES.md +29 -0
- artifact-manifest.json +119 -0
- evaluation.json +150 -0
- model/config.cfg +168 -0
- model/meta.json +128 -0
- model/morphologizer/cfg +37 -0
- model/morphologizer/model +0 -0
- model/parser/cfg +11 -0
- model/parser/model +3 -0
- model/parser/moves +1 -0
- model/tok2vec/cfg +1 -0
- model/tok2vec/model +3 -0
- model/tokenizer +3 -0
- model/vocab/key2row +3 -0
- model/vocab/lookups.bin +3 -0
- model/vocab/strings.json +3 -0
- model/vocab/vectors +3 -0
- model/vocab/vectors.cfg +3 -0
- requirements.txt +2 -0
.gitattributes
CHANGED
|
@@ -33,3 +33,8 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
| 36 |
+
model/parser/model filter=lfs diff=lfs merge=lfs -text
|
| 37 |
+
model/tok2vec/model filter=lfs diff=lfs merge=lfs -text
|
| 38 |
+
model/vocab/key2row filter=lfs diff=lfs merge=lfs -text
|
| 39 |
+
model/vocab/strings.json filter=lfs diff=lfs merge=lfs -text
|
| 40 |
+
model/vocab/vectors filter=lfs diff=lfs merge=lfs -text
|
README.md
ADDED
|
@@ -0,0 +1,79 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
language:
|
| 3 |
+
- my
|
| 4 |
+
library_name: spacy
|
| 5 |
+
tags:
|
| 6 |
+
- dependency-parsing
|
| 7 |
+
- part-of-speech
|
| 8 |
+
- sentence-segmentation
|
| 9 |
+
- burmese
|
| 10 |
+
---
|
| 11 |
+
|
| 12 |
+
# Burmese POS and Dependency Parser
|
| 13 |
+
|
| 14 |
+
I trained this spaCy pipeline for the grammatical analysis stage of
|
| 15 |
+
[Burmese Neural Reader](https://github.com/conradcompagna/burmese-neural-reader).
|
| 16 |
+
It combines a shared tok2vec encoder, a morphologizer that assigns universal POS
|
| 17 |
+
tags, and a transition-based dependency parser with sentence-boundary prediction.
|
| 18 |
+
These are the trained components used by the deployed reader.
|
| 19 |
+
|
| 20 |
+
## Training and evaluation
|
| 21 |
+
|
| 22 |
+
I prepared the myUDTree v1.0 annotations as 4,320 multi-sentence documents and
|
| 23 |
+
trained the joint pipeline on a 95/5 document split: 4,104 training documents
|
| 24 |
+
and 216 development documents. Each document contains ten source sentences,
|
| 25 |
+
apart from the final six-sentence group. The training partition contains 536,791
|
| 26 |
+
tokens and the development partition 27,716 tokens.
|
| 27 |
+
|
| 28 |
+
| Development metric | Score |
|
| 29 |
+
| --- | ---: |
|
| 30 |
+
| Universal POS accuracy | 96.92% |
|
| 31 |
+
| Unlabeled attachment score | 92.39% |
|
| 32 |
+
| Labeled attachment score | 89.41% |
|
| 33 |
+
| Sentence-boundary F1 | 93.01% |
|
| 34 |
+
|
| 35 |
+
These scores are saved in the selected checkpoint. Re-evaluating it against the
|
| 36 |
+
retained development set with spaCy 3.8.11 reproduces the saved figures exactly.
|
| 37 |
+
|
| 38 |
+
The encoder combines multihash token features with 300-dimensional fastText
|
| 39 |
+
vectors and a six-layer, width-128 maxout window encoder. The task heads share
|
| 40 |
+
these representations. I trained with Adam, dropout 0.1 and seed 0, selecting
|
| 41 |
+
checkpoints using POS accuracy, dependency attachment and sentence-boundary F1.
|
| 42 |
+
|
| 43 |
+
## Use the trained pipeline
|
| 44 |
+
|
| 45 |
+
The model takes **already segmented Burmese words**. In my reader, dictionary
|
| 46 |
+
dynamic programming and unigram/bigram scoring determine the final word
|
| 47 |
+
boundaries before the grammatical analysis stage.
|
| 48 |
+
|
| 49 |
+
With the downloaded `model` directory and spaCy 3.8.11:
|
| 50 |
+
|
| 51 |
+
```python
|
| 52 |
+
import spacy
|
| 53 |
+
from spacy.tokens import Doc
|
| 54 |
+
|
| 55 |
+
nlp = spacy.load("model")
|
| 56 |
+
|
| 57 |
+
def analyze_words(words: list[str], spaces: list[bool]) -> Doc:
|
| 58 |
+
"""Preserve the word boundaries and spacing supplied by your segmenter."""
|
| 59 |
+
return nlp(Doc(nlp.vocab, words=words, spaces=spaces))
|
| 60 |
+
```
|
| 61 |
+
|
| 62 |
+
Read POS labels from `token.pos_`, dependency relations from `token.dep_`, heads
|
| 63 |
+
from `token.head`, and predicted sentences from `doc.sents`. The checkpoint uses
|
| 64 |
+
spaCy's `xx` language class to accept externally segmented Burmese text. Its
|
| 65 |
+
morphologizer's label set is POS-only. NER is a separate stage in the reader.
|
| 66 |
+
|
| 67 |
+
## Sources
|
| 68 |
+
|
| 69 |
+
The training annotations are from [myUDTree v1.0](https://github.com/ye-kyaw-thu/myUDTree)
|
| 70 |
+
by Zar Zar Hlaing, Ye Kyaw Thu and collaborators. The corpus is distributed under
|
| 71 |
+
[CC BY-NC-SA 4.0](https://github.com/ye-kyaw-thu/myUDTree/blob/main/LICENSE.md).
|
| 72 |
+
|
| 73 |
+
The static embeddings are the Burmese Common Crawl/Wikipedia
|
| 74 |
+
[fastText vectors](https://fasttext.cc/docs/en/crawl-vectors), distributed under
|
| 75 |
+
CC BY-SA 3.0. The spaCy vocabulary retains 200,000 vector rows and 335,230 word
|
| 76 |
+
keys. See Grave et al., *Learning Word Vectors for 157 Languages*, LREC 2018.
|
| 77 |
+
|
| 78 |
+
|
| 79 |
+
[Evaluation record](evaluation.json) · [Artifact identities](artifact-manifest.json) · [Third-party notices](THIRD_PARTY_NOTICES.md)
|
THIRD_PARTY_NOTICES.md
ADDED
|
@@ -0,0 +1,29 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Third-party sources
|
| 2 |
+
|
| 3 |
+
## myUDTree
|
| 4 |
+
|
| 5 |
+
Zar Zar Hlaing, Ye Kyaw Thu, Thepchai Supnithi and P. Netisopakul.
|
| 6 |
+
myUDTree v1.0: Myanmar Universal Dependencies treebank.
|
| 7 |
+
https://github.com/ye-kyaw-thu/myUDTree
|
| 8 |
+
Corpus license: Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International.
|
| 9 |
+
https://github.com/ye-kyaw-thu/myUDTree/blob/main/LICENSE.md
|
| 10 |
+
I converted the retained annotations to grouped spaCy documents, partitioned
|
| 11 |
+
them for training/development and trained the released joint pipeline.
|
| 12 |
+
The source corpus and DocBins are not bundled in this release.
|
| 13 |
+
|
| 14 |
+
## fastText word vectors
|
| 15 |
+
|
| 16 |
+
Edouard Grave, Piotr Bojanowski, Prakhar Gupta, Armand Joulin and Tomas Mikolov.
|
| 17 |
+
*Learning Word Vectors for 157 Languages.* LREC 2018.
|
| 18 |
+
https://fasttext.cc/docs/en/crawl-vectors
|
| 19 |
+
Burmese Common Crawl/Wikipedia vectors (cc.my.300):
|
| 20 |
+
Creative Commons Attribution-ShareAlike 3.0 Unported.
|
| 21 |
+
https://creativecommons.org/licenses/by-sa/3.0/
|
| 22 |
+
I converted the vectors to a spaCy vocabulary and retained 200,000 float32 rows.
|
| 23 |
+
The bundled vectors and their derived vocabulary remain subject to these terms;
|
| 24 |
+
they are not covered by fastText's separate MIT software license.
|
| 25 |
+
|
| 26 |
+
## spaCy
|
| 27 |
+
|
| 28 |
+
Explosion and spaCy contributors. https://spacy.io/ — MIT-licensed software,
|
| 29 |
+
installed separately. The released model uses spaCy 3.8.11's native format.
|
artifact-manifest.json
ADDED
|
@@ -0,0 +1,119 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"author": "Conrad Compagna",
|
| 3 |
+
"model_id": "burmese-pos-dependency-spacy",
|
| 4 |
+
"format": "spaCy 3.8.11 native directory",
|
| 5 |
+
"components": [
|
| 6 |
+
"tok2vec",
|
| 7 |
+
"morphologizer",
|
| 8 |
+
"parser"
|
| 9 |
+
],
|
| 10 |
+
"metadata_changes": "Author, description, model name/version and portable corpus/vector path placeholders; learned weights and vocabulary unchanged.",
|
| 11 |
+
"deployment_identity_checked": "2026-09-23",
|
| 12 |
+
"files": [
|
| 13 |
+
{
|
| 14 |
+
"path": "model/config.cfg",
|
| 15 |
+
"bytes": 3463,
|
| 16 |
+
"sha256": "12c2f22c92ac86dd6777f4ce98ca7f3a62b05583001c5e7f468adac64deee815",
|
| 17 |
+
"source_sha256": "faaefd85adf5305fabb6dfc10e02e08a224d2651eaec57d1d4fd287eb7f6149d",
|
| 18 |
+
"unchanged": false
|
| 19 |
+
},
|
| 20 |
+
{
|
| 21 |
+
"path": "model/meta.json",
|
| 22 |
+
"bytes": 3005,
|
| 23 |
+
"sha256": "964efe4b8dd9d045f1674693c6c0c69b066536f4cb4c515285c7a1264498eb90",
|
| 24 |
+
"source_sha256": "0395764139015847546d46a892b7cda6bd8e37071254554645633d1c49b04aa4",
|
| 25 |
+
"unchanged": false
|
| 26 |
+
},
|
| 27 |
+
{
|
| 28 |
+
"path": "model/morphologizer/cfg",
|
| 29 |
+
"bytes": 709,
|
| 30 |
+
"sha256": "3ee213f7a685c38747fd2dc414b6c159a5e15ebc0c93b5de4a18647dc984c0c1",
|
| 31 |
+
"source_sha256": "3ee213f7a685c38747fd2dc414b6c159a5e15ebc0c93b5de4a18647dc984c0c1",
|
| 32 |
+
"unchanged": true
|
| 33 |
+
},
|
| 34 |
+
{
|
| 35 |
+
"path": "model/morphologizer/model",
|
| 36 |
+
"bytes": 7657,
|
| 37 |
+
"sha256": "ddb801a6ee473e3defa3749241576f86da19c09e9323bf3f312bcf097459634a",
|
| 38 |
+
"source_sha256": "ddb801a6ee473e3defa3749241576f86da19c09e9323bf3f312bcf097459634a",
|
| 39 |
+
"unchanged": true
|
| 40 |
+
},
|
| 41 |
+
{
|
| 42 |
+
"path": "model/parser/cfg",
|
| 43 |
+
"bytes": 237,
|
| 44 |
+
"sha256": "e5a89d6eb4a017452db0e9c97e2441dbcd7070a117bd79c924e63a20e0dce606",
|
| 45 |
+
"source_sha256": "e5a89d6eb4a017452db0e9c97e2441dbcd7070a117bd79c924e63a20e0dce606",
|
| 46 |
+
"unchanged": true
|
| 47 |
+
},
|
| 48 |
+
{
|
| 49 |
+
"path": "model/parser/model",
|
| 50 |
+
"bytes": 1137521,
|
| 51 |
+
"sha256": "bb19e47f565e5207261286de4b1c410c5e7e05399cc1e255994dec8d1baf8c75",
|
| 52 |
+
"source_sha256": "bb19e47f565e5207261286de4b1c410c5e7e05399cc1e255994dec8d1baf8c75",
|
| 53 |
+
"unchanged": true
|
| 54 |
+
},
|
| 55 |
+
{
|
| 56 |
+
"path": "model/parser/moves",
|
| 57 |
+
"bytes": 360,
|
| 58 |
+
"sha256": "c37280a5c9c54dfd8a354b89a120e54d7a96069f7af8cf61098e08d71893c768",
|
| 59 |
+
"source_sha256": "c37280a5c9c54dfd8a354b89a120e54d7a96069f7af8cf61098e08d71893c768",
|
| 60 |
+
"unchanged": true
|
| 61 |
+
},
|
| 62 |
+
{
|
| 63 |
+
"path": "model/tok2vec/cfg",
|
| 64 |
+
"bytes": 2,
|
| 65 |
+
"sha256": "44136fa355b3678a1146ad16f7e8649e94fb4fc21fe77e8310c060f61caaff8a",
|
| 66 |
+
"source_sha256": "44136fa355b3678a1146ad16f7e8649e94fb4fc21fe77e8310c060f61caaff8a",
|
| 67 |
+
"unchanged": true
|
| 68 |
+
},
|
| 69 |
+
{
|
| 70 |
+
"path": "model/tok2vec/model",
|
| 71 |
+
"bytes": 43866168,
|
| 72 |
+
"sha256": "a9d79fe4e6d8c0cf66afa9212317d99f8e922f0346b45fd42ee74749dd225cf1",
|
| 73 |
+
"source_sha256": "a9d79fe4e6d8c0cf66afa9212317d99f8e922f0346b45fd42ee74749dd225cf1",
|
| 74 |
+
"unchanged": true
|
| 75 |
+
},
|
| 76 |
+
{
|
| 77 |
+
"path": "model/tokenizer",
|
| 78 |
+
"bytes": 37695,
|
| 79 |
+
"sha256": "0b22cd2a783cd6b384c4f370d068c47df6e13f28b9dd84ed1e4ca886bc960d51",
|
| 80 |
+
"source_sha256": "0b22cd2a783cd6b384c4f370d068c47df6e13f28b9dd84ed1e4ca886bc960d51",
|
| 81 |
+
"unchanged": true
|
| 82 |
+
},
|
| 83 |
+
{
|
| 84 |
+
"path": "model/vocab/key2row",
|
| 85 |
+
"bytes": 4540989,
|
| 86 |
+
"sha256": "b3384c5e5abe396bde867e24029db2c3c931ecd685d5301a372ca3e3ab6c6ed3",
|
| 87 |
+
"source_sha256": "b3384c5e5abe396bde867e24029db2c3c931ecd685d5301a372ca3e3ab6c6ed3",
|
| 88 |
+
"unchanged": true
|
| 89 |
+
},
|
| 90 |
+
{
|
| 91 |
+
"path": "model/vocab/lookups.bin",
|
| 92 |
+
"bytes": 1,
|
| 93 |
+
"sha256": "76be8b528d0075f7aae98d6fa57a6d3c83ae480a8469e668d7b0af968995ac71",
|
| 94 |
+
"source_sha256": "76be8b528d0075f7aae98d6fa57a6d3c83ae480a8469e668d7b0af968995ac71",
|
| 95 |
+
"unchanged": true
|
| 96 |
+
},
|
| 97 |
+
{
|
| 98 |
+
"path": "model/vocab/strings.json",
|
| 99 |
+
"bytes": 13875167,
|
| 100 |
+
"sha256": "9780c13e28f2cb314ccdffe7b7eb0af697dc03c0f360bfee4728470550d8e7fc",
|
| 101 |
+
"source_sha256": "9780c13e28f2cb314ccdffe7b7eb0af697dc03c0f360bfee4728470550d8e7fc",
|
| 102 |
+
"unchanged": true
|
| 103 |
+
},
|
| 104 |
+
{
|
| 105 |
+
"path": "model/vocab/vectors",
|
| 106 |
+
"bytes": 240000128,
|
| 107 |
+
"sha256": "37104220a2c2dc5857c895747e7e269fea8571c353ac1c616db27846d0ec0413",
|
| 108 |
+
"source_sha256": "37104220a2c2dc5857c895747e7e269fea8571c353ac1c616db27846d0ec0413",
|
| 109 |
+
"unchanged": true
|
| 110 |
+
},
|
| 111 |
+
{
|
| 112 |
+
"path": "model/vocab/vectors.cfg",
|
| 113 |
+
"bytes": 25,
|
| 114 |
+
"sha256": "3e73f507454ab6c2a0907a3c015942fe687ebf19e29a79a9b348c5995ab5480c",
|
| 115 |
+
"source_sha256": "3e73f507454ab6c2a0907a3c015942fe687ebf19e29a79a9b348c5995ab5480c",
|
| 116 |
+
"unchanged": true
|
| 117 |
+
}
|
| 118 |
+
]
|
| 119 |
+
}
|
evaluation.json
ADDED
|
@@ -0,0 +1,150 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"pipeline": [
|
| 3 |
+
"tok2vec",
|
| 4 |
+
"morphologizer",
|
| 5 |
+
"parser"
|
| 6 |
+
],
|
| 7 |
+
"model_origin": "Conrad Compagna custom training on myUDTree v1.0 annotations",
|
| 8 |
+
"source": {
|
| 9 |
+
"path": "source/myUDTree_ver1.0.conllu.pred.jsonl",
|
| 10 |
+
"sha256": "a1a5086d4e4e7618922127215807503e6e1877b2b408d2b998c3dff49df89d88",
|
| 11 |
+
"sentences": 43196,
|
| 12 |
+
"tokens": 564507,
|
| 13 |
+
"consecutive_groups_of_10": 4320,
|
| 14 |
+
"matched_selected_documents": 4320
|
| 15 |
+
},
|
| 16 |
+
"partitions": {
|
| 17 |
+
"selected_train": {
|
| 18 |
+
"file": "corpus/train_95.spacy",
|
| 19 |
+
"sha256": "d5aed379a7ac1c3f3c1d0d677089fbefc862d93b516be96b8ec1ad2921a82505",
|
| 20 |
+
"documents": 4104,
|
| 21 |
+
"tokens": 536791,
|
| 22 |
+
"sentence_boundaries": 41036,
|
| 23 |
+
"document_sentence_counts": {
|
| 24 |
+
"10": 4103,
|
| 25 |
+
"6": 1
|
| 26 |
+
}
|
| 27 |
+
},
|
| 28 |
+
"selected_dev": {
|
| 29 |
+
"file": "corpus/dev_5.spacy",
|
| 30 |
+
"sha256": "c81b9600765400a7197ec8a72c4878f59fafbf4cce58e6983919bd297dc54710",
|
| 31 |
+
"documents": 216,
|
| 32 |
+
"tokens": 27716,
|
| 33 |
+
"sentence_boundaries": 2160,
|
| 34 |
+
"document_sentence_counts": {
|
| 35 |
+
"10": 216
|
| 36 |
+
}
|
| 37 |
+
}
|
| 38 |
+
},
|
| 39 |
+
"annotation_identity": {
|
| 40 |
+
"documents_checked": 4320,
|
| 41 |
+
"documents_matching_source_tokens_POS_dependencies_boundaries": 4320
|
| 42 |
+
},
|
| 43 |
+
"saved_development_metrics": {
|
| 44 |
+
"pos_acc": 0.9691874729398181,
|
| 45 |
+
"morph_acc": 0.0,
|
| 46 |
+
"morph_per_feat": 0.0,
|
| 47 |
+
"dep_uas": 0.923907177549919,
|
| 48 |
+
"dep_las": 0.8941256421018969,
|
| 49 |
+
"dep_las_per_type": {
|
| 50 |
+
"compound": {
|
| 51 |
+
"p": 0.8145882352941176,
|
| 52 |
+
"r": 0.8138222849083215,
|
| 53 |
+
"f": 0.8142050799623707
|
| 54 |
+
},
|
| 55 |
+
"obl": {
|
| 56 |
+
"p": 0.8534354392682408,
|
| 57 |
+
"r": 0.8622394154309048,
|
| 58 |
+
"f": 0.857814838571734
|
| 59 |
+
},
|
| 60 |
+
"case": {
|
| 61 |
+
"p": 0.956580900544285,
|
| 62 |
+
"r": 0.9505838967424708,
|
| 63 |
+
"f": 0.9535729699734878
|
| 64 |
+
},
|
| 65 |
+
"advmod": {
|
| 66 |
+
"p": 0.8057553956834532,
|
| 67 |
+
"r": 0.7887323943661971,
|
| 68 |
+
"f": 0.797153024911032
|
| 69 |
+
},
|
| 70 |
+
"acl": {
|
| 71 |
+
"p": 0.8391472868217055,
|
| 72 |
+
"r": 0.8045336306205871,
|
| 73 |
+
"f": 0.8214760007588693
|
| 74 |
+
},
|
| 75 |
+
"mark": {
|
| 76 |
+
"p": 0.9117308798159862,
|
| 77 |
+
"r": 0.9326470588235294,
|
| 78 |
+
"f": 0.9220703692933993
|
| 79 |
+
},
|
| 80 |
+
"root": {
|
| 81 |
+
"p": 0.9256605463502016,
|
| 82 |
+
"r": 0.9569444444444445,
|
| 83 |
+
"f": 0.941042567721375
|
| 84 |
+
},
|
| 85 |
+
"amod": {
|
| 86 |
+
"p": 0.845945945945946,
|
| 87 |
+
"r": 0.8413978494623656,
|
| 88 |
+
"f": 0.8436657681940701
|
| 89 |
+
},
|
| 90 |
+
"nummod": {
|
| 91 |
+
"p": 0.8413284132841329,
|
| 92 |
+
"r": 0.8460111317254174,
|
| 93 |
+
"f": 0.8436632747456059
|
| 94 |
+
},
|
| 95 |
+
"nmod": {
|
| 96 |
+
"p": 0.6811594202898551,
|
| 97 |
+
"r": 0.5465116279069767,
|
| 98 |
+
"f": 0.6064516129032258
|
| 99 |
+
}
|
| 100 |
+
},
|
| 101 |
+
"sents_p": 0.9149126735333631,
|
| 102 |
+
"sents_r": 0.9458333333333333,
|
| 103 |
+
"sents_f": 0.930116093785568,
|
| 104 |
+
"tok2vec_loss": 56340.324038690655,
|
| 105 |
+
"morphologizer_loss": 22737.99054479599,
|
| 106 |
+
"parser_loss": 156748.46875
|
| 107 |
+
},
|
| 108 |
+
"development_reevaluation": {
|
| 109 |
+
"performed": "2026-09-24",
|
| 110 |
+
"spacy": "3.8.11",
|
| 111 |
+
"documents": 216,
|
| 112 |
+
"elapsed_seconds": 6.834078899933957,
|
| 113 |
+
"current_scores": {
|
| 114 |
+
"pos_acc": 0.9691874729398181,
|
| 115 |
+
"dep_uas": 0.923907177549919,
|
| 116 |
+
"dep_las": 0.8941256421018969,
|
| 117 |
+
"sents_p": 0.9149126735333631,
|
| 118 |
+
"sents_r": 0.9458333333333333,
|
| 119 |
+
"sents_f": 0.930116093785568
|
| 120 |
+
},
|
| 121 |
+
"saved_scores": {
|
| 122 |
+
"pos_acc": 0.9691874729398181,
|
| 123 |
+
"dep_uas": 0.923907177549919,
|
| 124 |
+
"dep_las": 0.8941256421018969,
|
| 125 |
+
"sents_p": 0.9149126735333631,
|
| 126 |
+
"sents_r": 0.9458333333333333,
|
| 127 |
+
"sents_f": 0.930116093785568
|
| 128 |
+
},
|
| 129 |
+
"difference": {
|
| 130 |
+
"pos_acc": 0.0,
|
| 131 |
+
"dep_uas": 0.0,
|
| 132 |
+
"dep_las": 0.0,
|
| 133 |
+
"sents_p": 0.0,
|
| 134 |
+
"sents_r": 0.0,
|
| 135 |
+
"sents_f": 0.0
|
| 136 |
+
},
|
| 137 |
+
"scope": "Same retained development DocBin; this is a verification of saved evaluation, not a new test split."
|
| 138 |
+
},
|
| 139 |
+
"vectors": {
|
| 140 |
+
"source": "fastText cc.my.300 Common Crawl/Wikipedia",
|
| 141 |
+
"license": "CC BY-SA 3.0",
|
| 142 |
+
"source_sha256": "7810d202899d3ca3e1256eaf7901f18f2eea1c02197f86ae2baa2d22e803987f",
|
| 143 |
+
"rows": 200000,
|
| 144 |
+
"dimensions": 300,
|
| 145 |
+
"source_rows_verified_identical": 200000
|
| 146 |
+
},
|
| 147 |
+
"other_runtime_neural_components": {
|
| 148 |
+
"Stanza tokenize/NER": "upstream ALT/UCSY models; final application segmentation is dictionary DP plus unigram/bigram scoring"
|
| 149 |
+
}
|
| 150 |
+
}
|
model/config.cfg
ADDED
|
@@ -0,0 +1,168 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
[paths]
|
| 2 |
+
train = "corpus/train_95.spacy"
|
| 3 |
+
dev = "corpus/dev_5.spacy"
|
| 4 |
+
vectors = "resources/cc_my_300_spacy_vectors"
|
| 5 |
+
init_tok2vec = null
|
| 6 |
+
|
| 7 |
+
[system]
|
| 8 |
+
gpu_allocator = null
|
| 9 |
+
seed = 0
|
| 10 |
+
|
| 11 |
+
[nlp]
|
| 12 |
+
lang = "xx"
|
| 13 |
+
pipeline = ["tok2vec","morphologizer","parser"]
|
| 14 |
+
batch_size = 256
|
| 15 |
+
disabled = []
|
| 16 |
+
before_creation = null
|
| 17 |
+
after_creation = null
|
| 18 |
+
after_pipeline_creation = null
|
| 19 |
+
tokenizer = {"@tokenizers":"spacy.Tokenizer.v1"}
|
| 20 |
+
vectors = {"@vectors":"spacy.Vectors.v1"}
|
| 21 |
+
|
| 22 |
+
[components]
|
| 23 |
+
|
| 24 |
+
[components.morphologizer]
|
| 25 |
+
factory = "morphologizer"
|
| 26 |
+
extend = false
|
| 27 |
+
label_smoothing = 0.0
|
| 28 |
+
overwrite = true
|
| 29 |
+
scorer = {"@scorers":"spacy.morphologizer_scorer.v1"}
|
| 30 |
+
|
| 31 |
+
[components.morphologizer.model]
|
| 32 |
+
@architectures = "spacy.Tagger.v2"
|
| 33 |
+
nO = null
|
| 34 |
+
normalize = false
|
| 35 |
+
|
| 36 |
+
[components.morphologizer.model.tok2vec]
|
| 37 |
+
@architectures = "spacy.Tok2VecListener.v1"
|
| 38 |
+
width = ${components.tok2vec.model.encode:width}
|
| 39 |
+
upstream = "tok2vec"
|
| 40 |
+
|
| 41 |
+
[components.parser]
|
| 42 |
+
factory = "parser"
|
| 43 |
+
learn_tokens = false
|
| 44 |
+
min_action_freq = 30
|
| 45 |
+
moves = null
|
| 46 |
+
scorer = {"@scorers":"spacy.parser_scorer.v1"}
|
| 47 |
+
update_with_oracle_cut_size = 100
|
| 48 |
+
|
| 49 |
+
[components.parser.model]
|
| 50 |
+
@architectures = "spacy.TransitionBasedParser.v2"
|
| 51 |
+
state_type = "parser"
|
| 52 |
+
extra_state_tokens = false
|
| 53 |
+
hidden_width = 128
|
| 54 |
+
maxout_pieces = 2
|
| 55 |
+
use_upper = true
|
| 56 |
+
nO = null
|
| 57 |
+
|
| 58 |
+
[components.parser.model.tok2vec]
|
| 59 |
+
@architectures = "spacy.Tok2VecListener.v1"
|
| 60 |
+
width = ${components.tok2vec.model.encode:width}
|
| 61 |
+
upstream = "tok2vec"
|
| 62 |
+
|
| 63 |
+
[components.tok2vec]
|
| 64 |
+
factory = "tok2vec"
|
| 65 |
+
|
| 66 |
+
[components.tok2vec.model]
|
| 67 |
+
@architectures = "spacy.Tok2Vec.v2"
|
| 68 |
+
|
| 69 |
+
[components.tok2vec.model.embed]
|
| 70 |
+
@architectures = "spacy.MultiHashEmbed.v2"
|
| 71 |
+
width = 128
|
| 72 |
+
attrs = ["ORTH","PREFIX","SUFFIX","SHAPE","LENGTH"]
|
| 73 |
+
rows = [50000,10000,10000,1000,500]
|
| 74 |
+
include_static_vectors = true
|
| 75 |
+
|
| 76 |
+
[components.tok2vec.model.encode]
|
| 77 |
+
@architectures = "spacy.MaxoutWindowEncoder.v2"
|
| 78 |
+
width = 128
|
| 79 |
+
depth = 6
|
| 80 |
+
window_size = 2
|
| 81 |
+
maxout_pieces = 3
|
| 82 |
+
|
| 83 |
+
[corpora]
|
| 84 |
+
|
| 85 |
+
[corpora.dev]
|
| 86 |
+
@readers = "spacy.Corpus.v1"
|
| 87 |
+
path = ${paths.dev}
|
| 88 |
+
max_length = 0
|
| 89 |
+
gold_preproc = false
|
| 90 |
+
limit = 0
|
| 91 |
+
augmenter = null
|
| 92 |
+
|
| 93 |
+
[corpora.train]
|
| 94 |
+
@readers = "spacy.Corpus.v1"
|
| 95 |
+
path = ${paths.train}
|
| 96 |
+
max_length = 0
|
| 97 |
+
gold_preproc = false
|
| 98 |
+
limit = 0
|
| 99 |
+
augmenter = null
|
| 100 |
+
|
| 101 |
+
[training]
|
| 102 |
+
dev_corpus = "corpora.dev"
|
| 103 |
+
train_corpus = "corpora.train"
|
| 104 |
+
seed = ${system:seed}
|
| 105 |
+
gpu_allocator = ${system:gpu_allocator}
|
| 106 |
+
dropout = 0.1
|
| 107 |
+
accumulate_gradient = 1
|
| 108 |
+
patience = 5000
|
| 109 |
+
max_epochs = 0
|
| 110 |
+
max_steps = 100000
|
| 111 |
+
eval_frequency = 1000
|
| 112 |
+
frozen_components = []
|
| 113 |
+
annotating_components = []
|
| 114 |
+
before_to_disk = null
|
| 115 |
+
before_update = null
|
| 116 |
+
|
| 117 |
+
[training.batcher]
|
| 118 |
+
@batchers = "spacy.batch_by_words.v1"
|
| 119 |
+
discard_oversize = false
|
| 120 |
+
tolerance = 0.2
|
| 121 |
+
get_length = null
|
| 122 |
+
|
| 123 |
+
[training.batcher.size]
|
| 124 |
+
@schedules = "compounding.v1"
|
| 125 |
+
start = 100
|
| 126 |
+
stop = 1000
|
| 127 |
+
compound = 1.001
|
| 128 |
+
t = 0.0
|
| 129 |
+
|
| 130 |
+
[training.logger]
|
| 131 |
+
@loggers = "spacy.ConsoleLogger.v1"
|
| 132 |
+
progress_bar = false
|
| 133 |
+
|
| 134 |
+
[training.optimizer]
|
| 135 |
+
@optimizers = "Adam.v1"
|
| 136 |
+
beta1 = 0.9
|
| 137 |
+
beta2 = 0.999
|
| 138 |
+
L2_is_weight_decay = true
|
| 139 |
+
L2 = 0.01
|
| 140 |
+
grad_clip = 1.0
|
| 141 |
+
use_averages = true
|
| 142 |
+
eps = 1e-8
|
| 143 |
+
learn_rate = 0.001
|
| 144 |
+
|
| 145 |
+
[training.score_weights]
|
| 146 |
+
pos_acc = 0.3
|
| 147 |
+
morph_acc = 0.0
|
| 148 |
+
morph_per_feat = null
|
| 149 |
+
dep_uas = 0.3
|
| 150 |
+
dep_las = 0.3
|
| 151 |
+
dep_las_per_type = null
|
| 152 |
+
sents_p = null
|
| 153 |
+
sents_r = null
|
| 154 |
+
sents_f = 0.1
|
| 155 |
+
|
| 156 |
+
[pretraining]
|
| 157 |
+
|
| 158 |
+
[initialize]
|
| 159 |
+
vectors = ${paths.vectors}
|
| 160 |
+
init_tok2vec = ${paths.init_tok2vec}
|
| 161 |
+
vocab_data = null
|
| 162 |
+
lookups = null
|
| 163 |
+
before_init = null
|
| 164 |
+
after_init = null
|
| 165 |
+
|
| 166 |
+
[initialize.components]
|
| 167 |
+
|
| 168 |
+
[initialize.tokenizer]
|
model/meta.json
ADDED
|
@@ -0,0 +1,128 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"lang": "xx",
|
| 3 |
+
"name": "burmese_pos_dependency",
|
| 4 |
+
"version": "1.0.0",
|
| 5 |
+
"spacy_version": ">=3.8.11,<3.9.0",
|
| 6 |
+
"description": "Burmese POS, dependency parsing and sentence boundaries over pretokenized words.",
|
| 7 |
+
"author": "Conrad Compagna",
|
| 8 |
+
"email": "conradcompagna@gmail.com",
|
| 9 |
+
"url": "https://github.com/conradcompagna/burmese-neural-reader",
|
| 10 |
+
"license": "",
|
| 11 |
+
"spacy_git_version": "e7a662a",
|
| 12 |
+
"vectors": {
|
| 13 |
+
"width": 300,
|
| 14 |
+
"vectors": 200000,
|
| 15 |
+
"keys": 335230,
|
| 16 |
+
"name": "xx_pipeline.vectors",
|
| 17 |
+
"mode": "default"
|
| 18 |
+
},
|
| 19 |
+
"labels": {
|
| 20 |
+
"tok2vec": [],
|
| 21 |
+
"morphologizer": [
|
| 22 |
+
"POS=NUM",
|
| 23 |
+
"POS=SCONJ",
|
| 24 |
+
"POS=NOUN",
|
| 25 |
+
"POS=PART",
|
| 26 |
+
"POS=ADP",
|
| 27 |
+
"POS=VERB",
|
| 28 |
+
"POS=PUNCT",
|
| 29 |
+
"POS=CCONJ",
|
| 30 |
+
"POS=ADJ",
|
| 31 |
+
"POS=PRON",
|
| 32 |
+
"POS=PROPN",
|
| 33 |
+
"POS=ADV",
|
| 34 |
+
"POS=INTJ",
|
| 35 |
+
"POS=SYM"
|
| 36 |
+
],
|
| 37 |
+
"parser": [
|
| 38 |
+
"ROOT",
|
| 39 |
+
"acl",
|
| 40 |
+
"advmod",
|
| 41 |
+
"amod",
|
| 42 |
+
"case",
|
| 43 |
+
"compound",
|
| 44 |
+
"dep",
|
| 45 |
+
"mark",
|
| 46 |
+
"nmod",
|
| 47 |
+
"nummod",
|
| 48 |
+
"obl",
|
| 49 |
+
"punct"
|
| 50 |
+
]
|
| 51 |
+
},
|
| 52 |
+
"pipeline": [
|
| 53 |
+
"tok2vec",
|
| 54 |
+
"morphologizer",
|
| 55 |
+
"parser"
|
| 56 |
+
],
|
| 57 |
+
"components": [
|
| 58 |
+
"tok2vec",
|
| 59 |
+
"morphologizer",
|
| 60 |
+
"parser"
|
| 61 |
+
],
|
| 62 |
+
"disabled": [],
|
| 63 |
+
"performance": {
|
| 64 |
+
"pos_acc": 0.9691874729398181,
|
| 65 |
+
"morph_acc": 0.0,
|
| 66 |
+
"morph_per_feat": 0.0,
|
| 67 |
+
"dep_uas": 0.923907177549919,
|
| 68 |
+
"dep_las": 0.8941256421018969,
|
| 69 |
+
"dep_las_per_type": {
|
| 70 |
+
"compound": {
|
| 71 |
+
"p": 0.8145882352941176,
|
| 72 |
+
"r": 0.8138222849083215,
|
| 73 |
+
"f": 0.8142050799623707
|
| 74 |
+
},
|
| 75 |
+
"obl": {
|
| 76 |
+
"p": 0.8534354392682408,
|
| 77 |
+
"r": 0.8622394154309048,
|
| 78 |
+
"f": 0.857814838571734
|
| 79 |
+
},
|
| 80 |
+
"case": {
|
| 81 |
+
"p": 0.956580900544285,
|
| 82 |
+
"r": 0.9505838967424708,
|
| 83 |
+
"f": 0.9535729699734878
|
| 84 |
+
},
|
| 85 |
+
"advmod": {
|
| 86 |
+
"p": 0.8057553956834532,
|
| 87 |
+
"r": 0.7887323943661971,
|
| 88 |
+
"f": 0.797153024911032
|
| 89 |
+
},
|
| 90 |
+
"acl": {
|
| 91 |
+
"p": 0.8391472868217055,
|
| 92 |
+
"r": 0.8045336306205871,
|
| 93 |
+
"f": 0.8214760007588693
|
| 94 |
+
},
|
| 95 |
+
"mark": {
|
| 96 |
+
"p": 0.9117308798159862,
|
| 97 |
+
"r": 0.9326470588235294,
|
| 98 |
+
"f": 0.9220703692933993
|
| 99 |
+
},
|
| 100 |
+
"root": {
|
| 101 |
+
"p": 0.9256605463502016,
|
| 102 |
+
"r": 0.9569444444444445,
|
| 103 |
+
"f": 0.941042567721375
|
| 104 |
+
},
|
| 105 |
+
"amod": {
|
| 106 |
+
"p": 0.845945945945946,
|
| 107 |
+
"r": 0.8413978494623656,
|
| 108 |
+
"f": 0.8436657681940701
|
| 109 |
+
},
|
| 110 |
+
"nummod": {
|
| 111 |
+
"p": 0.8413284132841329,
|
| 112 |
+
"r": 0.8460111317254174,
|
| 113 |
+
"f": 0.8436632747456059
|
| 114 |
+
},
|
| 115 |
+
"nmod": {
|
| 116 |
+
"p": 0.6811594202898551,
|
| 117 |
+
"r": 0.5465116279069767,
|
| 118 |
+
"f": 0.6064516129032258
|
| 119 |
+
}
|
| 120 |
+
},
|
| 121 |
+
"sents_p": 0.9149126735333631,
|
| 122 |
+
"sents_r": 0.9458333333333333,
|
| 123 |
+
"sents_f": 0.930116093785568,
|
| 124 |
+
"tok2vec_loss": 56340.324038690655,
|
| 125 |
+
"morphologizer_loss": 22737.99054479599,
|
| 126 |
+
"parser_loss": 156748.46875
|
| 127 |
+
}
|
| 128 |
+
}
|
model/morphologizer/cfg
ADDED
|
@@ -0,0 +1,37 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"extend": false,
|
| 3 |
+
"label_smoothing": 0.0,
|
| 4 |
+
"labels_morph": {
|
| 5 |
+
"POS=NUM": "",
|
| 6 |
+
"POS=SCONJ": "",
|
| 7 |
+
"POS=NOUN": "",
|
| 8 |
+
"POS=PART": "",
|
| 9 |
+
"POS=ADP": "",
|
| 10 |
+
"POS=VERB": "",
|
| 11 |
+
"POS=PUNCT": "",
|
| 12 |
+
"POS=CCONJ": "",
|
| 13 |
+
"POS=ADJ": "",
|
| 14 |
+
"POS=PRON": "",
|
| 15 |
+
"POS=PROPN": "",
|
| 16 |
+
"POS=ADV": "",
|
| 17 |
+
"POS=INTJ": "",
|
| 18 |
+
"POS=SYM": ""
|
| 19 |
+
},
|
| 20 |
+
"labels_pos": {
|
| 21 |
+
"POS=NUM": 93,
|
| 22 |
+
"POS=SCONJ": 98,
|
| 23 |
+
"POS=NOUN": 92,
|
| 24 |
+
"POS=PART": 94,
|
| 25 |
+
"POS=ADP": 85,
|
| 26 |
+
"POS=VERB": 100,
|
| 27 |
+
"POS=PUNCT": 97,
|
| 28 |
+
"POS=CCONJ": 89,
|
| 29 |
+
"POS=ADJ": 84,
|
| 30 |
+
"POS=PRON": 95,
|
| 31 |
+
"POS=PROPN": 96,
|
| 32 |
+
"POS=ADV": 86,
|
| 33 |
+
"POS=INTJ": 91,
|
| 34 |
+
"POS=SYM": 99
|
| 35 |
+
},
|
| 36 |
+
"overwrite": true
|
| 37 |
+
}
|
model/morphologizer/model
ADDED
|
Binary file (7.66 kB). View file
|
|
|
model/parser/cfg
ADDED
|
@@ -0,0 +1,11 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"moves": null,
|
| 3 |
+
"update_with_oracle_cut_size": 100,
|
| 4 |
+
"multitasks": [],
|
| 5 |
+
"min_action_freq": 30,
|
| 6 |
+
"learn_tokens": false,
|
| 7 |
+
"beam_width": 1,
|
| 8 |
+
"beam_density": 0.0,
|
| 9 |
+
"beam_update_prob": 0.0,
|
| 10 |
+
"incorrect_spans_key": null
|
| 11 |
+
}
|
model/parser/model
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:bb19e47f565e5207261286de4b1c410c5e7e05399cc1e255994dec8d1baf8c75
|
| 3 |
+
size 1137521
|
model/parser/moves
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
��moves�P{"0":{"":210556},"1":{"":285201},"2":{"obl":82245,"acl":50265,"compound":40130,"advmod":15827,"amod":7264,"nummod":6768,"case":6054,"nmod":1284,"punct":384,"mark":334,"dep":0},"3":{"case":151633,"mark":64170,"punct":51263,"obl":9234,"nummod":3860,"compound":3116,"acl":1153,"advmod":455,"amod":233,"nmod":82,"dep":0},"4":{"ROOT":41036}}�cfg��neg_key�
|
model/tok2vec/cfg
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
{}
|
model/tok2vec/model
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a9d79fe4e6d8c0cf66afa9212317d99f8e922f0346b45fd42ee74749dd225cf1
|
| 3 |
+
size 43866168
|
model/tokenizer
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
��prefix_search��^§|^%|^=|^—|^–|^\+(?![0-9])|^…|^……|^,|^:|^;|^\!|^\?|^¿|^؟|^¡|^\(|^\)|^\[|^\]|^\{|^\}|^<|^>|^_|^#|^\*|^&|^。|^?|^!|^,|^、|^;|^:|^~|^·|^।|^،|^۔|^؛|^٪|^\.\.+|^…|^\'|^"|^”|^“|^`|^‘|^´|^’|^‚|^,|^„|^»|^«|^「|^」|^『|^』|^(|^)|^〔|^〕|^【|^】|^《|^》|^〈|^〉|^〈|^〉|^⟦|^⟧|^\$|^£|^€|^¥|^฿|^US\$|^C\$|^A\$|^₽|^﷼|^₴|^₠|^₡|^₢|^₣|^₤|^₥|^₦|^₧|^₨|^₩|^₪|^₫|^€|^₭|^₮|^₯|^₰|^₱|^₲|^₳|^₴|^₵|^₶|^₷|^₸|^₹|^₺|^₻|^₼|^₽|^₾|^₿|^[\u00A6\u00A9\u00AE\u00B0\u0482\u058D\u058E\u060E\u060F\u06DE\u06E9\u06FD\u06FE\u07F6\u09FA\u0B70\u0BF3-\u0BF8\u0BFA\u0C7F\u0D4F\u0D79\u0F01-\u0F03\u0F13\u0F15-\u0F17\u0F1A-\u0F1F\u0F34\u0F36\u0F38\u0FBE-\u0FC5\u0FC7-\u0FCC\u0FCE\u0FCF\u0FD5-\u0FD8\u109E\u109F\u1390-\u1399\u1940\u19DE-\u19FF\u1B61-\u1B6A\u1B74-\u1B7C\u2100\u2101\u2103-\u2106\u2108\u2109\u2114\u2116\u2117\u211E-\u2123\u2125\u2127\u2129\u212E\u213A\u213B\u214A\u214C\u214D\u214F\u218A\u218B\u2195-\u2199\u219C-\u219F\u21A1\u21A2\u21A4\u21A5\u21A7-\u21AD\u21AF-\u21CD\u21D0\u21D1\u21D3\u21D5-\u21F3\u2300-\u2307\u230C-\u231F\u2322-\u2328\u232B-\u237B\u237D-\u239A\u23B4-\u23DB\u23E2-\u2426\u2440-\u244A\u249C-\u24E9\u2500-\u25B6\u25B8-\u25C0\u25C2-\u25F7\u2600-\u266E\u2670-\u2767\u2794-\u27BF\u2800-\u28FF\u2B00-\u2B2F\u2B45\u2B46\u2B4D-\u2B73\u2B76-\u2B95\u2B98-\u2BC8\u2BCA-\u2BFE\u2CE5-\u2CEA\u2E80-\u2E99\u2E9B-\u2EF3\u2F00-\u2FD5\u2FF0-\u2FFB\u3004\u3012\u3013\u3020\u3036\u3037\u303E\u303F\u3190\u3191\u3196-\u319F\u31C0-\u31E3\u3200-\u321E\u322A-\u3247\u3250\u3260-\u327F\u328A-\u32B0\u32C0-\u32FE\u3300-\u33FF\u4DC0-\u4DFF\uA490-\uA4C6\uA828-\uA82B\uA836\uA837\uA839\uAA77-\uAA79\uFDFD\uFFE4\uFFE8\uFFED\uFFEE\uFFFC\uFFFD\U00010137-\U0001013F\U00010179-\U00010189\U0001018C-\U0001018E\U00010190-\U0001019B\U000101A0\U000101D0-\U000101FC\U00010877\U00010878\U00010AC8\U0001173F\U00016B3C-\U00016B3F\U00016B45\U0001BC9C\U0001D000-\U0001D0F5\U0001D100-\U0001D126\U0001D129-\U0001D164\U0001D16A-\U0001D16C\U0001D183\U0001D184\U0001D18C-\U0001D1A9\U0001D1AE-\U0001D1E8\U0001D200-\U0001D241\U0001D245\U0001D300-\U0001D356\U0001D800-\U0001D9FF\U0001DA37-\U0001DA3A\U0001DA6D-\U0001DA74\U0001DA76-\U0001DA83\U0001DA85\U0001DA86\U0001ECAC\U0001F000-\U0001F02B\U0001F030-\U0001F093\U0001F0A0-\U0001F0AE\U0001F0B1-\U0001F0BF\U0001F0C1-\U0001F0CF\U0001F0D1-\U0001F0F5\U0001F110-\U0001F16B\U0001F170-\U0001F1AC\U0001F1E6-\U0001F202\U0001F210-\U0001F23B\U0001F240-\U0001F248\U0001F250\U0001F251\U0001F260-\U0001F265\U0001F300-\U0001F3FA\U0001F400-\U0001F6D4\U0001F6E0-\U0001F6EC\U0001F6F0-\U0001F6F9\U0001F700-\U0001F773\U0001F780-\U0001F7D8\U0001F800-\U0001F80B\U0001F810-\U0001F847\U0001F850-\U0001F859\U0001F860-\U0001F887\U0001F890-\U0001F8AD\U0001F900-\U0001F90B\U0001F910-\U0001F93E\U0001F940-\U0001F970\U0001F973-\U0001F976\U0001F97A\U0001F97C-\U0001F9A2\U0001F9B0-\U0001F9B9\U0001F9C0-\U0001F9C2\U0001F9D0-\U0001F9FF\U0001FA60-\U0001FA6D]�suffix_search�2�…$|……$|,$|:$|;$|\!$|\?$|¿$|؟$|¡$|\($|\)$|\[$|\]$|\{$|\}$|<$|>$|_$|#$|\*$|&$|。$|?$|!$|,$|、$|;$|:$|~$|·$|।$|،$|۔$|؛$|٪$|\.\.+$|…$|\'$|"$|”$|“$|`$|‘$|´$|’$|‚$|,$|„$|»$|«$|「$|」$|『$|』$|($|)$|〔$|〕$|【$|】$|《$|》$|〈$|〉$|〈$|〉$|⟦$|⟧$|[\u00A6\u00A9\u00AE\u00B0\u0482\u058D\u058E\u060E\u060F\u06DE\u06E9\u06FD\u06FE\u07F6\u09FA\u0B70\u0BF3-\u0BF8\u0BFA\u0C7F\u0D4F\u0D79\u0F01-\u0F03\u0F13\u0F15-\u0F17\u0F1A-\u0F1F\u0F34\u0F36\u0F38\u0FBE-\u0FC5\u0FC7-\u0FCC\u0FCE\u0FCF\u0FD5-\u0FD8\u109E\u109F\u1390-\u1399\u1940\u19DE-\u19FF\u1B61-\u1B6A\u1B74-\u1B7C\u2100\u2101\u2103-\u2106\u2108\u2109\u2114\u2116\u2117\u211E-\u2123\u2125\u2127\u2129\u212E\u213A\u213B\u214A\u214C\u214D\u214F\u218A\u218B\u2195-\u2199\u219C-\u219F\u21A1\u21A2\u21A4\u21A5\u21A7-\u21AD\u21AF-\u21CD\u21D0\u21D1\u21D3\u21D5-\u21F3\u2300-\u2307\u230C-\u231F\u2322-\u2328\u232B-\u237B\u237D-\u239A\u23B4-\u23DB\u23E2-\u2426\u2440-\u244A\u249C-\u24E9\u2500-\u25B6\u25B8-\u25C0\u25C2-\u25F7\u2600-\u266E\u2670-\u2767\u2794-\u27BF\u2800-\u28FF\u2B00-\u2B2F\u2B45\u2B46\u2B4D-\u2B73\u2B76-\u2B95\u2B98-\u2BC8\u2BCA-\u2BFE\u2CE5-\u2CEA\u2E80-\u2E99\u2E9B-\u2EF3\u2F00-\u2FD5\u2FF0-\u2FFB\u3004\u3012\u3013\u3020\u3036\u3037\u303E\u303F\u3190\u3191\u3196-\u319F\u31C0-\u31E3\u3200-\u321E\u322A-\u3247\u3250\u3260-\u327F\u328A-\u32B0\u32C0-\u32FE\u3300-\u33FF\u4DC0-\u4DFF\uA490-\uA4C6\uA828-\uA82B\uA836\uA837\uA839\uAA77-\uAA79\uFDFD\uFFE4\uFFE8\uFFED\uFFEE\uFFFC\uFFFD\U00010137-\U0001013F\U00010179-\U00010189\U0001018C-\U0001018E\U00010190-\U0001019B\U000101A0\U000101D0-\U000101FC\U00010877\U00010878\U00010AC8\U0001173F\U00016B3C-\U00016B3F\U00016B45\U0001BC9C\U0001D000-\U0001D0F5\U0001D100-\U0001D126\U0001D129-\U0001D164\U0001D16A-\U0001D16C\U0001D183\U0001D184\U0001D18C-\U0001D1A9\U0001D1AE-\U0001D1E8\U0001D200-\U0001D241\U0001D245\U0001D300-\U0001D356\U0001D800-\U0001D9FF\U0001DA37-\U0001DA3A\U0001DA6D-\U0001DA74\U0001DA76-\U0001DA83\U0001DA85\U0001DA86\U0001ECAC\U0001F000-\U0001F02B\U0001F030-\U0001F093\U0001F0A0-\U0001F0AE\U0001F0B1-\U0001F0BF\U0001F0C1-\U0001F0CF\U0001F0D1-\U0001F0F5\U0001F110-\U0001F16B\U0001F170-\U0001F1AC\U0001F1E6-\U0001F202\U0001F210-\U0001F23B\U0001F240-\U0001F248\U0001F250\U0001F251\U0001F260-\U0001F265\U0001F300-\U0001F3FA\U0001F400-\U0001F6D4\U0001F6E0-\U0001F6EC\U0001F6F0-\U0001F6F9\U0001F700-\U0001F773\U0001F780-\U0001F7D8\U0001F800-\U0001F80B\U0001F810-\U0001F847\U0001F850-\U0001F859\U0001F860-\U0001F887\U0001F890-\U0001F8AD\U0001F900-\U0001F90B\U0001F910-\U0001F93E\U0001F940-\U0001F970\U0001F973-\U0001F976\U0001F97A\U0001F97C-\U0001F9A2\U0001F9B0-\U0001F9B9\U0001F9C0-\U0001F9C2\U0001F9D0-\U0001F9FF\U0001FA60-\U0001FA6D]$|'s$|'S$|’s$|’S$|—$|–$|(?<=[0-9])\+$|(?<=°[FfCcKk])\.$|(?<=[0-9])(?:\$|£|€|¥|฿|US\$|C\$|A\$|₽|﷼|₴|₠|₡|₢|₣|₤|₥|₦|₧|₨|₩|₪|₫|€|₭|₮|₯|₰|₱|₲|₳|₴|₵|₶|₷|₸|₹|₺|₻|₼|₽|₾|₿)$|(?<=[0-9])(?:km|km²|km³|m|m²|m³|dm|dm²|dm³|cm|cm²|cm³|mm|mm²|mm³|ha|µm|nm|yd|in|ft|kg|g|mg|µg|t|lb|oz|m/s|km/h|kmh|mph|hPa|Pa|mbar|mb|MB|kb|KB|gb|GB|tb|TB|T|G|M|K|%|км|км²|км³|м|м²|м³|дм|дм²|дм³|см|см²|см³|мм|мм²|мм³|нм|кг|г|мг|м/с|км/ч|кПа|Па|мбар|Кб|КБ|кб|Мб|МБ|мб|Гб|ГБ|гб|Тб|ТБ|тбكم|كم²|كم³|م|م²|م³|سم|سم²|سم³|مم|مم²|مم³|كم|غرام|جرام|جم|كغ|ملغ|كوب|اكواب)$|(?<=[0-9a-z\uFF41-\uFF5A\u00DF-\u00F6\u00F8-\u00FF\u0101\u0103\u0105\u0107\u0109\u010B\u010D\u010F\u0111\u0113\u0115\u0117\u0119\u011B\u011D\u011F\u0121\u0123\u0125\u0127\u0129\u012B\u012D\u012F\u0131\u0133\u0135\u0137\u0138\u013A\u013C\u013E\u0140\u0142\u0144\u0146\u0148\u0149\u014B\u014D\u014F\u0151\u0153\u0155\u0157\u0159\u015B\u015D\u015F\u0161\u0163\u0165\u0167\u0169\u016B\u016D\u016F\u0171\u0173\u0175\u0177\u017A\u017C\u017E\u017F\u0180\u0183\u0185\u0188\u018C\u018D\u0192\u0195\u0199-\u019B\u019E\u01A1\u01A3\u01A5\u01A8\u01AA\u01AB\u01AD\u01B0\u01B4\u01B6\u01B9\u01BA\u01BD-\u01BF\u01C6\u01C9\u01CC\u01CE\u01D0\u01D2\u01D4\u01D6\u01D8\u01DA\u01DC\u01DD\u01DF\u01E1\u01E3\u01E5\u01E7\u01E9\u01EB\u01ED\u01EF\u01F0\u01F3\u01F5\u01F9\u01FB\u01FD\u01FF\u0201\u0203\u0205\u0207\u0209\u020B\u020D\u020F\u0211\u0213\u0215\u0217\u0219\u021B\u021D\u021F\u0221\u0223\u0225\u0227\u0229\u022B\u022D\u022F\u0231\u0233-\u0239\u023C\u023F\u0240\u0242\u0247\u0249\u024B\u024D\u024F\u2C61\u2C65\u2C66\u2C68\u2C6A\u2C6C\u2C71\u2C73\u2C74\u2C76-\u2C7B\uA723\uA725\uA727\uA729\uA72B\uA72D\uA72F-\uA731\uA733\uA735\uA737\uA739\uA73B\uA73D\uA73F\uA741\uA743\uA745\uA747\uA749\uA74B\uA74D\uA74F\uA751\uA753\uA755\uA757\uA759\uA75B\uA75D\uA75F\uA761\uA763\uA765\uA767\uA769\uA76B\uA76D\uA76F\uA771-\uA778\uA77A\uA77C\uA77F\uA781\uA783\uA785\uA787\uA78C\uA78E\uA791\uA793-\uA795\uA797\uA799\uA79B\uA79D\uA79F\uA7A1\uA7A3\uA7A5\uA7A7\uA7A9\uA7AF\uA7B5\uA7B7\uA7B9\uA7FA\uAB30-\uAB5A\uAB60-\uAB64\u0250-\u02AF\u1D00-\u1D25\u1D6B-\u1D77\u1D79-\u1D9A\u1E01\u1E03\u1E05\u1E07\u1E09\u1E0B\u1E0D\u1E0F\u1E11\u1E13\u1E15\u1E17\u1E19\u1E1B\u1E1D\u1E1F\u1E21\u1E23\u1E25\u1E27\u1E29\u1E2B\u1E2D\u1E2F\u1E31\u1E33\u1E35\u1E37\u1E39\u1E3B\u1E3D\u1E3F\u1E41\u1E43\u1E45\u1E47\u1E49\u1E4B\u1E4D\u1E4F\u1E51\u1E53\u1E55\u1E57\u1E59\u1E5B\u1E5D\u1E5F\u1E61\u1E63\u1E65\u1E67\u1E69\u1E6B\u1E6D\u1E6F\u1E71\u1E73\u1E75\u1E77\u1E79\u1E7B\u1E7D\u1E7F\u1E81\u1E83\u1E85\u1E87\u1E89\u1E8B\u1E8D\u1E8F\u1E91\u1E93\u1E95-\u1E9D\u1E9F\u1EA1\u1EA3\u1EA5\u1EA7\u1EA9\u1EAB\u1EAD\u1EAF\u1EB1\u1EB3\u1EB5\u1EB7\u1EB9\u1EBB\u1EBD\u1EBF\u1EC1\u1EC3\u1EC5\u1EC7\u1EC9\u1ECB\u1ECD\u1ECF\u1ED1\u1ED3\u1ED5\u1ED7\u1ED9\u1EDB\u1EDD\u1EDF\u1EE1\u1EE3\u1EE5\u1EE7\u1EE9\u1EEB\u1EED\u1EEF\u1EF1\u1EF3\u1EF5\u1EF7\u1EF9\u1EFB\u1EFD\u1EFFёа-яәөүҗңһα-ωάέίόώήύа-щюяіїєґѓѕјљњќѐѝ\u1200-\u137F\u0980-\u09FF\u0591-\u05F4\uFB1D-\uFB4F\u0620-\u064A\u066E-\u06D5\u06E5-\u06FF\u0750-\u077F\u08A0-\u08BD\uFB50-\uFBB1\uFBD3-\uFD3D\uFD50-\uFDC7\uFDF0-\uFDFB\uFE70-\uFEFC\U0001EE00-\U0001EEBB\u0D80-\u0DFF\u0900-\u097F\u0C80-\u0CFF\u0B80-\u0BFF\u0C00-\u0C7F\uAC00-\uD7AF\u1100-\u11FF\u3040-\u309F\u30A0-\u30FFー\u4E00-\u62FF\u6300-\u77FF\u7800-\u8CFF\u8D00-\u9FFF\u3400-\u4DBF\U00020000-\U000215FF\U00021600-\U000230FF\U00023100-\U000245FF\U00024600-\U000260FF\U00026100-\U000275FF\U00027600-\U000290FF\U00029100-\U0002A6DF\U0002A700-\U0002B73F\U0002B740-\U0002B81F\U0002B820-\U0002CEAF\U0002CEB0-\U0002EBEF\u2E80-\u2EFF\u2F00-\u2FDF\u2FF0-\u2FFF\u3000-\u303F\u31C0-\u31EF\u3200-\u32FF\u3300-\u33FF\uF900-\uFAFF\uFE30-\uFE4F\U0001F200-\U0001F2FF\U0002F800-\U0002FA1F%²\-\+…|……|,|:|;|\!|\?|¿|؟|¡|\(|\)|\[|\]|\{|\}|<|>|_|#|\*|&|。|?|!|,|、|;|:|~|·|।|،|۔|؛|٪(?:\'"”“`‘´’‚,„»«「」『』()〔〕【】《》〈〉〈〉⟦⟧)])\.$|(?<=[A-Z\uFF21-\uFF3A\u00C0-\u00D6\u00D8-\u00DE\u0100\u0102\u0104\u0106\u0108\u010A\u010C\u010E\u0110\u0112\u0114\u0116\u0118\u011A\u011C\u011E\u0120\u0122\u0124\u0126\u0128\u012A\u012C\u012E\u0130\u0132\u0134\u0136\u0139\u013B\u013D\u013F\u0141\u0143\u0145\u0147\u014A\u014C\u014E\u0150\u0152\u0154\u0156\u0158\u015A\u015C\u015E\u0160\u0162\u0164\u0166\u0168\u016A\u016C\u016E\u0170\u0172\u0174\u0176\u0178\u0179\u017B\u017D\u0181\u0182\u0184\u0186\u0187\u0189-\u018B\u018E-\u0191\u0193\u0194\u0196-\u0198\u019C\u019D\u019F\u01A0\u01A2\u01A4\u01A6\u01A7\u01A9\u01AC\u01AE\u01AF\u01B1-\u01B3\u01B5\u01B7\u01B8\u01BC\u01C4\u01C7\u01CA\u01CD\u01CF\u01D1\u01D3\u01D5\u01D7\u01D9\u01DB\u01DE\u01E0\u01E2\u01E4\u01E6\u01E8\u01EA\u01EC\u01EE\u01F1\u01F4\u01F6-\u01F8\u01FA\u01FC\u01FE\u0200\u0202\u0204\u0206\u0208\u020A\u020C\u020E\u0210\u0212\u0214\u0216\u0218\u021A\u021C\u021E\u0220\u0222\u0224\u0226\u0228\u022A\u022C\u022E\u0230\u0232\u023A\u023B\u023D\u023E\u0241\u0243-\u0246\u0248\u024A\u024C\u024E\u2C60\u2C62-\u2C64\u2C67\u2C69\u2C6B\u2C6D-\u2C70\u2C72\u2C75\u2C7E\u2C7F\uA722\uA724\uA726\uA728\uA72A\uA72C\uA72E\uA732\uA734\uA736\uA738\uA73A\uA73C\uA73E\uA740\uA742\uA744\uA746\uA748\uA74A\uA74C\uA74E\uA750\uA752\uA754\uA756\uA758\uA75A\uA75C\uA75E\uA760\uA762\uA764\uA766\uA768\uA76A\uA76C\uA76E\uA779\uA77B\uA77D\uA77E\uA780\uA782\uA784\uA786\uA78B\uA78D\uA790\uA792\uA796\uA798\uA79A\uA79C\uA79E\uA7A0\uA7A2\uA7A4\uA7A6\uA7A8\uA7AA-\uA7AE\uA7B0-\uA7B4\uA7B6\uA7B8\u1E00\u1E02\u1E04\u1E06\u1E08\u1E0A\u1E0C\u1E0E\u1E10\u1E12\u1E14\u1E16\u1E18\u1E1A\u1E1C\u1E1E\u1E20\u1E22\u1E24\u1E26\u1E28\u1E2A\u1E2C\u1E2E\u1E30\u1E32\u1E34\u1E36\u1E38\u1E3A\u1E3C\u1E3E\u1E40\u1E42\u1E44\u1E46\u1E48\u1E4A\u1E4C\u1E4E\u1E50\u1E52\u1E54\u1E56\u1E58\u1E5A\u1E5C\u1E5E\u1E60\u1E62\u1E64\u1E66\u1E68\u1E6A\u1E6C\u1E6E\u1E70\u1E72\u1E74\u1E76\u1E78\u1E7A\u1E7C\u1E7E\u1E80\u1E82\u1E84\u1E86\u1E88\u1E8A\u1E8C\u1E8E\u1E90\u1E92\u1E94\u1E9E\u1EA0\u1EA2\u1EA4\u1EA6\u1EA8\u1EAA\u1EAC\u1EAE\u1EB0\u1EB2\u1EB4\u1EB6\u1EB8\u1EBA\u1EBC\u1EBE\u1EC0\u1EC2\u1EC4\u1EC6\u1EC8\u1ECA\u1ECC\u1ECE\u1ED0\u1ED2\u1ED4\u1ED6\u1ED8\u1EDA\u1EDC\u1EDE\u1EE0\u1EE2\u1EE4\u1EE6\u1EE8\u1EEA\u1EEC\u1EEE\u1EF0\u1EF2\u1EF4\u1EF6\u1EF8\u1EFA\u1EFC\u1EFEЁА-ЯӘӨҮҖҢҺΑ-ΩΆΈΊΌΏΉΎА-ЩЮЯІЇЄҐЃЅЈЉЊЌЀЍ\u1200-\u137F\u0980-\u09FF\u0591-\u05F4\uFB1D-\uFB4F\u0620-\u064A\u066E-\u06D5\u06E5-\u06FF\u0750-\u077F\u08A0-\u08BD\uFB50-\uFBB1\uFBD3-\uFD3D\uFD50-\uFDC7\uFDF0-\uFDFB\uFE70-\uFEFC\U0001EE00-\U0001EEBB\u0D80-\u0DFF\u0900-\u097F\u0C80-\u0CFF\u0B80-\u0BFF\u0C00-\u0C7F\uAC00-\uD7AF\u1100-\u11FF\u3040-\u309F\u30A0-\u30FFー\u4E00-\u62FF\u6300-\u77FF\u7800-\u8CFF\u8D00-\u9FFF\u3400-\u4DBF\U00020000-\U000215FF\U00021600-\U000230FF\U00023100-\U000245FF\U00024600-\U000260FF\U00026100-\U000275FF\U00027600-\U000290FF\U00029100-\U0002A6DF\U0002A700-\U0002B73F\U0002B740-\U0002B81F\U0002B820-\U0002CEAF\U0002CEB0-\U0002EBEF\u2E80-\u2EFF\u2F00-\u2FDF\u2FF0-\u2FFF\u3000-\u303F\u31C0-\u31EF\u3200-\u32FF\u3300-\u33FF\uF900-\uFAFF\uFE30-\uFE4F\U0001F200-\U0001F2FF\U0002F800-\U0002FA1F][A-Z\uFF21-\uFF3A\u00C0-\u00D6\u00D8-\u00DE\u0100\u0102\u0104\u0106\u0108\u010A\u010C\u010E\u0110\u0112\u0114\u0116\u0118\u011A\u011C\u011E\u0120\u0122\u0124\u0126\u0128\u012A\u012C\u012E\u0130\u0132\u0134\u0136\u0139\u013B\u013D\u013F\u0141\u0143\u0145\u0147\u014A\u014C\u014E\u0150\u0152\u0154\u0156\u0158\u015A\u015C\u015E\u0160\u0162\u0164\u0166\u0168\u016A\u016C\u016E\u0170\u0172\u0174\u0176\u0178\u0179\u017B\u017D\u0181\u0182\u0184\u0186\u0187\u0189-\u018B\u018E-\u0191\u0193\u0194\u0196-\u0198\u019C\u019D\u019F\u01A0\u01A2\u01A4\u01A6\u01A7\u01A9\u01AC\u01AE\u01AF\u01B1-\u01B3\u01B5\u01B7\u01B8\u01BC\u01C4\u01C7\u01CA\u01CD\u01CF\u01D1\u01D3\u01D5\u01D7\u01D9\u01DB\u01DE\u01E0\u01E2\u01E4\u01E6\u01E8\u01EA\u01EC\u01EE\u01F1\u01F4\u01F6-\u01F8\u01FA\u01FC\u01FE\u0200\u0202\u0204\u0206\u0208\u020A\u020C\u020E\u0210\u0212\u0214\u0216\u0218\u021A\u021C\u021E\u0220\u0222\u0224\u0226\u0228\u022A\u022C\u022E\u0230\u0232\u023A\u023B\u023D\u023E\u0241\u0243-\u0246\u0248\u024A\u024C\u024E\u2C60\u2C62-\u2C64\u2C67\u2C69\u2C6B\u2C6D-\u2C70\u2C72\u2C75\u2C7E\u2C7F\uA722\uA724\uA726\uA728\uA72A\uA72C\uA72E\uA732\uA734\uA736\uA738\uA73A\uA73C\uA73E\uA740\uA742\uA744\uA746\uA748\uA74A\uA74C\uA74E\uA750\uA752\uA754\uA756\uA758\uA75A\uA75C\uA75E\uA760\uA762\uA764\uA766\uA768\uA76A\uA76C\uA76E\uA779\uA77B\uA77D\uA77E\uA780\uA782\uA784\uA786\uA78B\uA78D\uA790\uA792\uA796\uA798\uA79A\uA79C\uA79E\uA7A0\uA7A2\uA7A4\uA7A6\uA7A8\uA7AA-\uA7AE\uA7B0-\uA7B4\uA7B6\uA7B8\u1E00\u1E02\u1E04\u1E06\u1E08\u1E0A\u1E0C\u1E0E\u1E10\u1E12\u1E14\u1E16\u1E18\u1E1A\u1E1C\u1E1E\u1E20\u1E22\u1E24\u1E26\u1E28\u1E2A\u1E2C\u1E2E\u1E30\u1E32\u1E34\u1E36\u1E38\u1E3A\u1E3C\u1E3E\u1E40\u1E42\u1E44\u1E46\u1E48\u1E4A\u1E4C\u1E4E\u1E50\u1E52\u1E54\u1E56\u1E58\u1E5A\u1E5C\u1E5E\u1E60\u1E62\u1E64\u1E66\u1E68\u1E6A\u1E6C\u1E6E\u1E70\u1E72\u1E74\u1E76\u1E78\u1E7A\u1E7C\u1E7E\u1E80\u1E82\u1E84\u1E86\u1E88\u1E8A\u1E8C\u1E8E\u1E90\u1E92\u1E94\u1E9E\u1EA0\u1EA2\u1EA4\u1EA6\u1EA8\u1EAA\u1EAC\u1EAE\u1EB0\u1EB2\u1EB4\u1EB6\u1EB8\u1EBA\u1EBC\u1EBE\u1EC0\u1EC2\u1EC4\u1EC6\u1EC8\u1ECA\u1ECC\u1ECE\u1ED0\u1ED2\u1ED4\u1ED6\u1ED8\u1EDA\u1EDC\u1EDE\u1EE0\u1EE2\u1EE4\u1EE6\u1EE8\u1EEA\u1EEC\u1EEE\u1EF0\u1EF2\u1EF4\u1EF6\u1EF8\u1EFA\u1EFC\u1EFEЁА-ЯӘӨҮҖҢҺΑ-ΩΆΈΊΌΏΉΎА-ЩЮЯІЇЄҐЃЅЈЉЊЌЀЍ\u1200-\u137F\u0980-\u09FF\u0591-\u05F4\uFB1D-\uFB4F\u0620-\u064A\u066E-\u06D5\u06E5-\u06FF\u0750-\u077F\u08A0-\u08BD\uFB50-\uFBB1\uFBD3-\uFD3D\uFD50-\uFDC7\uFDF0-\uFDFB\uFE70-\uFEFC\U0001EE00-\U0001EEBB\u0D80-\u0DFF\u0900-\u097F\u0C80-\u0CFF\u0B80-\u0BFF\u0C00-\u0C7F\uAC00-\uD7AF\u1100-\u11FF\u3040-\u309F\u30A0-\u30FFー\u4E00-\u62FF\u6300-\u77FF\u7800-\u8CFF\u8D00-\u9FFF\u3400-\u4DBF\U00020000-\U000215FF\U00021600-\U000230FF\U00023100-\U000245FF\U00024600-\U000260FF\U00026100-\U000275FF\U00027600-\U000290FF\U00029100-\U0002A6DF\U0002A700-\U0002B73F\U0002B740-\U0002B81F\U0002B820-\U0002CEAF\U0002CEB0-\U0002EBEF\u2E80-\u2EFF\u2F00-\u2FDF\u2FF0-\u2FFF\u3000-\u303F\u31C0-\u31EF\u3200-\u32FF\u3300-\u33FF\uF900-\uFAFF\uFE30-\uFE4F\U0001F200-\U0001F2FF\U0002F800-\U0002FA1F])\.$�infix_finditer�>�\.\.+|…|[\u00A6\u00A9\u00AE\u00B0\u0482\u058D\u058E\u060E\u060F\u06DE\u06E9\u06FD\u06FE\u07F6\u09FA\u0B70\u0BF3-\u0BF8\u0BFA\u0C7F\u0D4F\u0D79\u0F01-\u0F03\u0F13\u0F15-\u0F17\u0F1A-\u0F1F\u0F34\u0F36\u0F38\u0FBE-\u0FC5\u0FC7-\u0FCC\u0FCE\u0FCF\u0FD5-\u0FD8\u109E\u109F\u1390-\u1399\u1940\u19DE-\u19FF\u1B61-\u1B6A\u1B74-\u1B7C\u2100\u2101\u2103-\u2106\u2108\u2109\u2114\u2116\u2117\u211E-\u2123\u2125\u2127\u2129\u212E\u213A\u213B\u214A\u214C\u214D\u214F\u218A\u218B\u2195-\u2199\u219C-\u219F\u21A1\u21A2\u21A4\u21A5\u21A7-\u21AD\u21AF-\u21CD\u21D0\u21D1\u21D3\u21D5-\u21F3\u2300-\u2307\u230C-\u231F\u2322-\u2328\u232B-\u237B\u237D-\u239A\u23B4-\u23DB\u23E2-\u2426\u2440-\u244A\u249C-\u24E9\u2500-\u25B6\u25B8-\u25C0\u25C2-\u25F7\u2600-\u266E\u2670-\u2767\u2794-\u27BF\u2800-\u28FF\u2B00-\u2B2F\u2B45\u2B46\u2B4D-\u2B73\u2B76-\u2B95\u2B98-\u2BC8\u2BCA-\u2BFE\u2CE5-\u2CEA\u2E80-\u2E99\u2E9B-\u2EF3\u2F00-\u2FD5\u2FF0-\u2FFB\u3004\u3012\u3013\u3020\u3036\u3037\u303E\u303F\u3190\u3191\u3196-\u319F\u31C0-\u31E3\u3200-\u321E\u322A-\u3247\u3250\u3260-\u327F\u328A-\u32B0\u32C0-\u32FE\u3300-\u33FF\u4DC0-\u4DFF\uA490-\uA4C6\uA828-\uA82B\uA836\uA837\uA839\uAA77-\uAA79\uFDFD\uFFE4\uFFE8\uFFED\uFFEE\uFFFC\uFFFD\U00010137-\U0001013F\U00010179-\U00010189\U0001018C-\U0001018E\U00010190-\U0001019B\U000101A0\U000101D0-\U000101FC\U00010877\U00010878\U00010AC8\U0001173F\U00016B3C-\U00016B3F\U00016B45\U0001BC9C\U0001D000-\U0001D0F5\U0001D100-\U0001D126\U0001D129-\U0001D164\U0001D16A-\U0001D16C\U0001D183\U0001D184\U0001D18C-\U0001D1A9\U0001D1AE-\U0001D1E8\U0001D200-\U0001D241\U0001D245\U0001D300-\U0001D356\U0001D800-\U0001D9FF\U0001DA37-\U0001DA3A\U0001DA6D-\U0001DA74\U0001DA76-\U0001DA83\U0001DA85\U0001DA86\U0001ECAC\U0001F000-\U0001F02B\U0001F030-\U0001F093\U0001F0A0-\U0001F0AE\U0001F0B1-\U0001F0BF\U0001F0C1-\U0001F0CF\U0001F0D1-\U0001F0F5\U0001F110-\U0001F16B\U0001F170-\U0001F1AC\U0001F1E6-\U0001F202\U0001F210-\U0001F23B\U0001F240-\U0001F248\U0001F250\U0001F251\U0001F260-\U0001F265\U0001F300-\U0001F3FA\U0001F400-\U0001F6D4\U0001F6E0-\U0001F6EC\U0001F6F0-\U0001F6F9\U0001F700-\U0001F773\U0001F780-\U0001F7D8\U0001F800-\U0001F80B\U0001F810-\U0001F847\U0001F850-\U0001F859\U0001F860-\U0001F887\U0001F890-\U0001F8AD\U0001F900-\U0001F90B\U0001F910-\U0001F93E\U0001F940-\U0001F970\U0001F973-\U0001F976\U0001F97A\U0001F97C-\U0001F9A2\U0001F9B0-\U0001F9B9\U0001F9C0-\U0001F9C2\U0001F9D0-\U0001F9FF\U0001FA60-\U0001FA6D]|(?<=[0-9])[+\-\*^](?=[0-9-])|(?<=[a-z\uFF41-\uFF5A\u00DF-\u00F6\u00F8-\u00FF\u0101\u0103\u0105\u0107\u0109\u010B\u010D\u010F\u0111\u0113\u0115\u0117\u0119\u011B\u011D\u011F\u0121\u0123\u0125\u0127\u0129\u012B\u012D\u012F\u0131\u0133\u0135\u0137\u0138\u013A\u013C\u013E\u0140\u0142\u0144\u0146\u0148\u0149\u014B\u014D\u014F\u0151\u0153\u0155\u0157\u0159\u015B\u015D\u015F\u0161\u0163\u0165\u0167\u0169\u016B\u016D\u016F\u0171\u0173\u0175\u0177\u017A\u017C\u017E\u017F\u0180\u0183\u0185\u0188\u018C\u018D\u0192\u0195\u0199-\u019B\u019E\u01A1\u01A3\u01A5\u01A8\u01AA\u01AB\u01AD\u01B0\u01B4\u01B6\u01B9\u01BA\u01BD-\u01BF\u01C6\u01C9\u01CC\u01CE\u01D0\u01D2\u01D4\u01D6\u01D8\u01DA\u01DC\u01DD\u01DF\u01E1\u01E3\u01E5\u01E7\u01E9\u01EB\u01ED\u01EF\u01F0\u01F3\u01F5\u01F9\u01FB\u01FD\u01FF\u0201\u0203\u0205\u0207\u0209\u020B\u020D\u020F\u0211\u0213\u0215\u0217\u0219\u021B\u021D\u021F\u0221\u0223\u0225\u0227\u0229\u022B\u022D\u022F\u0231\u0233-\u0239\u023C\u023F\u0240\u0242\u0247\u0249\u024B\u024D\u024F\u2C61\u2C65\u2C66\u2C68\u2C6A\u2C6C\u2C71\u2C73\u2C74\u2C76-\u2C7B\uA723\uA725\uA727\uA729\uA72B\uA72D\uA72F-\uA731\uA733\uA735\uA737\uA739\uA73B\uA73D\uA73F\uA741\uA743\uA745\uA747\uA749\uA74B\uA74D\uA74F\uA751\uA753\uA755\uA757\uA759\uA75B\uA75D\uA75F\uA761\uA763\uA765\uA767\uA769\uA76B\uA76D\uA76F\uA771-\uA778\uA77A\uA77C\uA77F\uA781\uA783\uA785\uA787\uA78C\uA78E\uA791\uA793-\uA795\uA797\uA799\uA79B\uA79D\uA79F\uA7A1\uA7A3\uA7A5\uA7A7\uA7A9\uA7AF\uA7B5\uA7B7\uA7B9\uA7FA\uAB30-\uAB5A\uAB60-\uAB64\u0250-\u02AF\u1D00-\u1D25\u1D6B-\u1D77\u1D79-\u1D9A\u1E01\u1E03\u1E05\u1E07\u1E09\u1E0B\u1E0D\u1E0F\u1E11\u1E13\u1E15\u1E17\u1E19\u1E1B\u1E1D\u1E1F\u1E21\u1E23\u1E25\u1E27\u1E29\u1E2B\u1E2D\u1E2F\u1E31\u1E33\u1E35\u1E37\u1E39\u1E3B\u1E3D\u1E3F\u1E41\u1E43\u1E45\u1E47\u1E49\u1E4B\u1E4D\u1E4F\u1E51\u1E53\u1E55\u1E57\u1E59\u1E5B\u1E5D\u1E5F\u1E61\u1E63\u1E65\u1E67\u1E69\u1E6B\u1E6D\u1E6F\u1E71\u1E73\u1E75\u1E77\u1E79\u1E7B\u1E7D\u1E7F\u1E81\u1E83\u1E85\u1E87\u1E89\u1E8B\u1E8D\u1E8F\u1E91\u1E93\u1E95-\u1E9D\u1E9F\u1EA1\u1EA3\u1EA5\u1EA7\u1EA9\u1EAB\u1EAD\u1EAF\u1EB1\u1EB3\u1EB5\u1EB7\u1EB9\u1EBB\u1EBD\u1EBF\u1EC1\u1EC3\u1EC5\u1EC7\u1EC9\u1ECB\u1ECD\u1ECF\u1ED1\u1ED3\u1ED5\u1ED7\u1ED9\u1EDB\u1EDD\u1EDF\u1EE1\u1EE3\u1EE5\u1EE7\u1EE9\u1EEB\u1EED\u1EEF\u1EF1\u1EF3\u1EF5\u1EF7\u1EF9\u1EFB\u1EFD\u1EFFёа-яәөүҗңһα-ωάέίόώήύа-щюяіїєґѓѕјљњќѐѝ\u1200-\u137F\u0980-\u09FF\u0591-\u05F4\uFB1D-\uFB4F\u0620-\u064A\u066E-\u06D5\u06E5-\u06FF\u0750-\u077F\u08A0-\u08BD\uFB50-\uFBB1\uFBD3-\uFD3D\uFD50-\uFDC7\uFDF0-\uFDFB\uFE70-\uFEFC\U0001EE00-\U0001EEBB\u0D80-\u0DFF\u0900-\u097F\u0C80-\u0CFF\u0B80-\u0BFF\u0C00-\u0C7F\uAC00-\uD7AF\u1100-\u11FF\u3040-\u309F\u30A0-\u30FFー\u4E00-\u62FF\u6300-\u77FF\u7800-\u8CFF\u8D00-\u9FFF\u3400-\u4DBF\U00020000-\U000215FF\U00021600-\U000230FF\U00023100-\U000245FF\U00024600-\U000260FF\U00026100-\U000275FF\U00027600-\U000290FF\U00029100-\U0002A6DF\U0002A700-\U0002B73F\U0002B740-\U0002B81F\U0002B820-\U0002CEAF\U0002CEB0-\U0002EBEF\u2E80-\u2EFF\u2F00-\u2FDF\u2FF0-\u2FFF\u3000-\u303F\u31C0-\u31EF\u3200-\u32FF\u3300-\u33FF\uF900-\uFAFF\uFE30-\uFE4F\U0001F200-\U0001F2FF\U0002F800-\U0002FA1F\'"”“`‘´’‚,„»«「」『』()〔〕【】《》〈〉〈〉⟦⟧])\.(?=[A-Z\uFF21-\uFF3A\u00C0-\u00D6\u00D8-\u00DE\u0100\u0102\u0104\u0106\u0108\u010A\u010C\u010E\u0110\u0112\u0114\u0116\u0118\u011A\u011C\u011E\u0120\u0122\u0124\u0126\u0128\u012A\u012C\u012E\u0130\u0132\u0134\u0136\u0139\u013B\u013D\u013F\u0141\u0143\u0145\u0147\u014A\u014C\u014E\u0150\u0152\u0154\u0156\u0158\u015A\u015C\u015E\u0160\u0162\u0164\u0166\u0168\u016A\u016C\u016E\u0170\u0172\u0174\u0176\u0178\u0179\u017B\u017D\u0181\u0182\u0184\u0186\u0187\u0189-\u018B\u018E-\u0191\u0193\u0194\u0196-\u0198\u019C\u019D\u019F\u01A0\u01A2\u01A4\u01A6\u01A7\u01A9\u01AC\u01AE\u01AF\u01B1-\u01B3\u01B5\u01B7\u01B8\u01BC\u01C4\u01C7\u01CA\u01CD\u01CF\u01D1\u01D3\u01D5\u01D7\u01D9\u01DB\u01DE\u01E0\u01E2\u01E4\u01E6\u01E8\u01EA\u01EC\u01EE\u01F1\u01F4\u01F6-\u01F8\u01FA\u01FC\u01FE\u0200\u0202\u0204\u0206\u0208\u020A\u020C\u020E\u0210\u0212\u0214\u0216\u0218\u021A\u021C\u021E\u0220\u0222\u0224\u0226\u0228\u022A\u022C\u022E\u0230\u0232\u023A\u023B\u023D\u023E\u0241\u0243-\u0246\u0248\u024A\u024C\u024E\u2C60\u2C62-\u2C64\u2C67\u2C69\u2C6B\u2C6D-\u2C70\u2C72\u2C75\u2C7E\u2C7F\uA722\uA724\uA726\uA728\uA72A\uA72C\uA72E\uA732\uA734\uA736\uA738\uA73A\uA73C\uA73E\uA740\uA742\uA744\uA746\uA748\uA74A\uA74C\uA74E\uA750\uA752\uA754\uA756\uA758\uA75A\uA75C\uA75E\uA760\uA762\uA764\uA766\uA768\uA76A\uA76C\uA76E\uA779\uA77B\uA77D\uA77E\uA780\uA782\uA784\uA786\uA78B\uA78D\uA790\uA792\uA796\uA798\uA79A\uA79C\uA79E\uA7A0\uA7A2\uA7A4\uA7A6\uA7A8\uA7AA-\uA7AE\uA7B0-\uA7B4\uA7B6\uA7B8\u1E00\u1E02\u1E04\u1E06\u1E08\u1E0A\u1E0C\u1E0E\u1E10\u1E12\u1E14\u1E16\u1E18\u1E1A\u1E1C\u1E1E\u1E20\u1E22\u1E24\u1E26\u1E28\u1E2A\u1E2C\u1E2E\u1E30\u1E32\u1E34\u1E36\u1E38\u1E3A\u1E3C\u1E3E\u1E40\u1E42\u1E44\u1E46\u1E48\u1E4A\u1E4C\u1E4E\u1E50\u1E52\u1E54\u1E56\u1E58\u1E5A\u1E5C\u1E5E\u1E60\u1E62\u1E64\u1E66\u1E68\u1E6A\u1E6C\u1E6E\u1E70\u1E72\u1E74\u1E76\u1E78\u1E7A\u1E7C\u1E7E\u1E80\u1E82\u1E84\u1E86\u1E88\u1E8A\u1E8C\u1E8E\u1E90\u1E92\u1E94\u1E9E\u1EA0\u1EA2\u1EA4\u1EA6\u1EA8\u1EAA\u1EAC\u1EAE\u1EB0\u1EB2\u1EB4\u1EB6\u1EB8\u1EBA\u1EBC\u1EBE\u1EC0\u1EC2\u1EC4\u1EC6\u1EC8\u1ECA\u1ECC\u1ECE\u1ED0\u1ED2\u1ED4\u1ED6\u1ED8\u1EDA\u1EDC\u1EDE\u1EE0\u1EE2\u1EE4\u1EE6\u1EE8\u1EEA\u1EEC\u1EEE\u1EF0\u1EF2\u1EF4\u1EF6\u1EF8\u1EFA\u1EFC\u1EFEЁА-ЯӘӨҮҖҢҺΑ-ΩΆΈΊΌΏΉΎА-ЩЮЯІЇЄҐЃЅЈЉЊЌЀЍ\u1200-\u137F\u0980-\u09FF\u0591-\u05F4\uFB1D-\uFB4F\u0620-\u064A\u066E-\u06D5\u06E5-\u06FF\u0750-\u077F\u08A0-\u08BD\uFB50-\uFBB1\uFBD3-\uFD3D\uFD50-\uFDC7\uFDF0-\uFDFB\uFE70-\uFEFC\U0001EE00-\U0001EEBB\u0D80-\u0DFF\u0900-\u097F\u0C80-\u0CFF\u0B80-\u0BFF\u0C00-\u0C7F\uAC00-\uD7AF\u1100-\u11FF\u3040-\u309F\u30A0-\u30FFー\u4E00-\u62FF\u6300-\u77FF\u7800-\u8CFF\u8D00-\u9FFF\u3400-\u4DBF\U00020000-\U000215FF\U00021600-\U000230FF\U00023100-\U000245FF\U00024600-\U000260FF\U00026100-\U000275FF\U00027600-\U000290FF\U00029100-\U0002A6DF\U0002A700-\U0002B73F\U0002B740-\U0002B81F\U0002B820-\U0002CEAF\U0002CEB0-\U0002EBEF\u2E80-\u2EFF\u2F00-\u2FDF\u2FF0-\u2FFF\u3000-\u303F\u31C0-\u31EF\u3200-\u32FF\u3300-\u33FF\uF900-\uFAFF\uFE30-\uFE4F\U0001F200-\U0001F2FF\U0002F800-\U0002FA1F\'"”“`‘´’‚,„»«「」『』()〔〕【】《》〈〉〈〉⟦⟧])|(?<=[A-Za-z\uFF21-\uFF3A\uFF41-\uFF5A\u00C0-\u00D6\u00D8-\u00F6\u00F8-\u00FF\u0100-\u017F\u0180-\u01BF\u01C4-\u024F\u2C60-\u2C7B\u2C7E\u2C7F\uA722-\uA76F\uA771-\uA787\uA78B-\uA78E\uA790-\uA7B9\uA7FA\uAB30-\uAB5A\uAB60-\uAB64\u0250-\u02AF\u1D00-\u1D25\u1D6B-\u1D77\u1D79-\u1D9A\u1E00-\u1EFFёа-яЁА-ЯәөүҗңһӘӨҮҖҢҺα-ωάέίόώήύΑ-ΩΆΈΊΌΏΉΎа-щюяіїєґА-ЩЮЯІЇЄҐѓѕјљњќѐѝЃЅЈЉЊЌЀЍ\u1200-\u137F\u0980-\u09FF\u0591-\u05F4\uFB1D-\uFB4F\u0620-\u064A\u066E-\u06D5\u06E5-\u06FF\u0750-\u077F\u08A0-\u08BD\uFB50-\uFBB1\uFBD3-\uFD3D\uFD50-\uFDC7\uFDF0-\uFDFB\uFE70-\uFEFC\U0001EE00-\U0001EEBB\u0D80-\u0DFF\u0900-\u097F\u0C80-\u0CFF\u0B80-\u0BFF\u0C00-\u0C7F\uAC00-\uD7AF\u1100-\u11FF\u3040-\u309F\u30A0-\u30FFー\u4E00-\u62FF\u6300-\u77FF\u7800-\u8CFF\u8D00-\u9FFF\u3400-\u4DBF\U00020000-\U000215FF\U00021600-\U000230FF\U00023100-\U000245FF\U00024600-\U000260FF\U00026100-\U000275FF\U00027600-\U000290FF\U00029100-\U0002A6DF\U0002A700-\U0002B73F\U0002B740-\U0002B81F\U0002B820-\U0002CEAF\U0002CEB0-\U0002EBEF\u2E80-\u2EFF\u2F00-\u2FDF\u2FF0-\u2FFF\u3000-\u303F\u31C0-\u31EF\u3200-\u32FF\u3300-\u33FF\uF900-\uFAFF\uFE30-\uFE4F\U0001F200-\U0001F2FF\U0002F800-\U0002FA1F]),(?=[A-Za-z\uFF21-\uFF3A\uFF41-\uFF5A\u00C0-\u00D6\u00D8-\u00F6\u00F8-\u00FF\u0100-\u017F\u0180-\u01BF\u01C4-\u024F\u2C60-\u2C7B\u2C7E\u2C7F\uA722-\uA76F\uA771-\uA787\uA78B-\uA78E\uA790-\uA7B9\uA7FA\uAB30-\uAB5A\uAB60-\uAB64\u0250-\u02AF\u1D00-\u1D25\u1D6B-\u1D77\u1D79-\u1D9A\u1E00-\u1EFFёа-яЁА-ЯәөүҗңһӘӨҮҖҢҺα-ωάέίόώήύΑ-ΩΆΈΊΌΏΉΎа-щюяіїєґА-ЩЮЯІЇЄҐѓѕјљњќѐѝЃЅЈЉЊЌЀЍ\u1200-\u137F\u0980-\u09FF\u0591-\u05F4\uFB1D-\uFB4F\u0620-\u064A\u066E-\u06D5\u06E5-\u06FF\u0750-\u077F\u08A0-\u08BD\uFB50-\uFBB1\uFBD3-\uFD3D\uFD50-\uFDC7\uFDF0-\uFDFB\uFE70-\uFEFC\U0001EE00-\U0001EEBB\u0D80-\u0DFF\u0900-\u097F\u0C80-\u0CFF\u0B80-\u0BFF\u0C00-\u0C7F\uAC00-\uD7AF\u1100-\u11FF\u3040-\u309F\u30A0-\u30FFー\u4E00-\u62FF\u6300-\u77FF\u7800-\u8CFF\u8D00-\u9FFF\u3400-\u4DBF\U00020000-\U000215FF\U00021600-\U000230FF\U00023100-\U000245FF\U00024600-\U000260FF\U00026100-\U000275FF\U00027600-\U000290FF\U00029100-\U0002A6DF\U0002A700-\U0002B73F\U0002B740-\U0002B81F\U0002B820-\U0002CEAF\U0002CEB0-\U0002EBEF\u2E80-\u2EFF\u2F00-\u2FDF\u2FF0-\u2FFF\u3000-\u303F\u31C0-\u31EF\u3200-\u32FF\u3300-\u33FF\uF900-\uFAFF\uFE30-\uFE4F\U0001F200-\U0001F2FF\U0002F800-\U0002FA1F])|(?<=[A-Za-z\uFF21-\uFF3A\uFF41-\uFF5A\u00C0-\u00D6\u00D8-\u00F6\u00F8-\u00FF\u0100-\u017F\u0180-\u01BF\u01C4-\u024F\u2C60-\u2C7B\u2C7E\u2C7F\uA722-\uA76F\uA771-\uA787\uA78B-\uA78E\uA790-\uA7B9\uA7FA\uAB30-\uAB5A\uAB60-\uAB64\u0250-\u02AF\u1D00-\u1D25\u1D6B-\u1D77\u1D79-\u1D9A\u1E00-\u1EFFёа-яЁА-ЯәөүҗңһӘӨҮҖҢҺα-ωάέίόώήύΑ-ΩΆΈΊΌΏΉΎа-щюяіїєґА-ЩЮЯІЇЄҐѓѕјљњќѐѝЃЅЈЉЊЌЀЍ\u1200-\u137F\u0980-\u09FF\u0591-\u05F4\uFB1D-\uFB4F\u0620-\u064A\u066E-\u06D5\u06E5-\u06FF\u0750-\u077F\u08A0-\u08BD\uFB50-\uFBB1\uFBD3-\uFD3D\uFD50-\uFDC7\uFDF0-\uFDFB\uFE70-\uFEFC\U0001EE00-\U0001EEBB\u0D80-\u0DFF\u0900-\u097F\u0C80-\u0CFF\u0B80-\u0BFF\u0C00-\u0C7F\uAC00-\uD7AF\u1100-\u11FF\u3040-\u309F\u30A0-\u30FFー\u4E00-\u62FF\u6300-\u77FF\u7800-\u8CFF\u8D00-\u9FFF\u3400-\u4DBF\U00020000-\U000215FF\U00021600-\U000230FF\U00023100-\U000245FF\U00024600-\U000260FF\U00026100-\U000275FF\U00027600-\U000290FF\U00029100-\U0002A6DF\U0002A700-\U0002B73F\U0002B740-\U0002B81F\U0002B820-\U0002CEAF\U0002CEB0-\U0002EBEF\u2E80-\u2EFF\u2F00-\u2FDF\u2FF0-\u2FFF\u3000-\u303F\u31C0-\u31EF\u3200-\u32FF\u3300-\u33FF\uF900-\uFAFF\uFE30-\uFE4F\U0001F200-\U0001F2FF\U0002F800-\U0002FA1F])(?:-|–|—|--|---|——|~)(?=[A-Za-z\uFF21-\uFF3A\uFF41-\uFF5A\u00C0-\u00D6\u00D8-\u00F6\u00F8-\u00FF\u0100-\u017F\u0180-\u01BF\u01C4-\u024F\u2C60-\u2C7B\u2C7E\u2C7F\uA722-\uA76F\uA771-\uA787\uA78B-\uA78E\uA790-\uA7B9\uA7FA\uAB30-\uAB5A\uAB60-\uAB64\u0250-\u02AF\u1D00-\u1D25\u1D6B-\u1D77\u1D79-\u1D9A\u1E00-\u1EFFёа-яЁА-ЯәөүҗңһӘӨҮҖҢҺα-ωάέίόώήύΑ-ΩΆΈΊΌΏΉΎа-щюяіїєґА-ЩЮЯІЇЄҐѓѕјљњќѐѝЃЅЈЉЊЌЀЍ\u1200-\u137F\u0980-\u09FF\u0591-\u05F4\uFB1D-\uFB4F\u0620-\u064A\u066E-\u06D5\u06E5-\u06FF\u0750-\u077F\u08A0-\u08BD\uFB50-\uFBB1\uFBD3-\uFD3D\uFD50-\uFDC7\uFDF0-\uFDFB\uFE70-\uFEFC\U0001EE00-\U0001EEBB\u0D80-\u0DFF\u0900-\u097F\u0C80-\u0CFF\u0B80-\u0BFF\u0C00-\u0C7F\uAC00-\uD7AF\u1100-\u11FF\u3040-\u309F\u30A0-\u30FFー\u4E00-\u62FF\u6300-\u77FF\u7800-\u8CFF\u8D00-\u9FFF\u3400-\u4DBF\U00020000-\U000215FF\U00021600-\U000230FF\U00023100-\U000245FF\U00024600-\U000260FF\U00026100-\U000275FF\U00027600-\U000290FF\U00029100-\U0002A6DF\U0002A700-\U0002B73F\U0002B740-\U0002B81F\U0002B820-\U0002CEAF\U0002CEB0-\U0002EBEF\u2E80-\u2EFF\u2F00-\u2FDF\u2FF0-\u2FFF\u3000-\u303F\u31C0-\u31EF\u3200-\u32FF\u3300-\u33FF\uF900-\uFAFF\uFE30-\uFE4F\U0001F200-\U0001F2FF\U0002F800-\U0002FA1F])|(?<=[A-Za-z\uFF21-\uFF3A\uFF41-\uFF5A\u00C0-\u00D6\u00D8-\u00F6\u00F8-\u00FF\u0100-\u017F\u0180-\u01BF\u01C4-\u024F\u2C60-\u2C7B\u2C7E\u2C7F\uA722-\uA76F\uA771-\uA787\uA78B-\uA78E\uA790-\uA7B9\uA7FA\uAB30-\uAB5A\uAB60-\uAB64\u0250-\u02AF\u1D00-\u1D25\u1D6B-\u1D77\u1D79-\u1D9A\u1E00-\u1EFFёа-яЁА-ЯәөүҗңһӘӨҮҖҢҺα-ωάέίόώήύΑ-ΩΆΈΊΌΏΉΎа-щюяіїєґА-ЩЮЯІЇЄҐѓѕјљњќѐѝЃЅЈЉЊЌЀЍ\u1200-\u137F\u0980-\u09FF\u0591-\u05F4\uFB1D-\uFB4F\u0620-\u064A\u066E-\u06D5\u06E5-\u06FF\u0750-\u077F\u08A0-\u08BD\uFB50-\uFBB1\uFBD3-\uFD3D\uFD50-\uFDC7\uFDF0-\uFDFB\uFE70-\uFEFC\U0001EE00-\U0001EEBB\u0D80-\u0DFF\u0900-\u097F\u0C80-\u0CFF\u0B80-\u0BFF\u0C00-\u0C7F\uAC00-\uD7AF\u1100-\u11FF\u3040-\u309F\u30A0-\u30FFー\u4E00-\u62FF\u6300-\u77FF\u7800-\u8CFF\u8D00-\u9FFF\u3400-\u4DBF\U00020000-\U000215FF\U00021600-\U000230FF\U00023100-\U000245FF\U00024600-\U000260FF\U00026100-\U000275FF\U00027600-\U000290FF\U00029100-\U0002A6DF\U0002A700-\U0002B73F\U0002B740-\U0002B81F\U0002B820-\U0002CEAF\U0002CEB0-\U0002EBEF\u2E80-\u2EFF\u2F00-\u2FDF\u2FF0-\u2FFF\u3000-\u303F\u31C0-\u31EF\u3200-\u32FF\u3300-\u33FF\uF900-\uFAFF\uFE30-\uFE4F\U0001F200-\U0001F2FF\U0002F800-\U0002FA1F0-9])[:<>=/](?=[A-Za-z\uFF21-\uFF3A\uFF41-\uFF5A\u00C0-\u00D6\u00D8-\u00F6\u00F8-\u00FF\u0100-\u017F\u0180-\u01BF\u01C4-\u024F\u2C60-\u2C7B\u2C7E\u2C7F\uA722-\uA76F\uA771-\uA787\uA78B-\uA78E\uA790-\uA7B9\uA7FA\uAB30-\uAB5A\uAB60-\uAB64\u0250-\u02AF\u1D00-\u1D25\u1D6B-\u1D77\u1D79-\u1D9A\u1E00-\u1EFFёа-яЁА-ЯәөүҗңһӘӨҮҖҢҺα-ωάέίόώήύΑ-ΩΆΈΊΌΏΉΎа-щюяіїєґА-ЩЮЯІЇЄҐѓѕјљњќѐѝЃЅЈЉЊЌЀЍ\u1200-\u137F\u0980-\u09FF\u0591-\u05F4\uFB1D-\uFB4F\u0620-\u064A\u066E-\u06D5\u06E5-\u06FF\u0750-\u077F\u08A0-\u08BD\uFB50-\uFBB1\uFBD3-\uFD3D\uFD50-\uFDC7\uFDF0-\uFDFB\uFE70-\uFEFC\U0001EE00-\U0001EEBB\u0D80-\u0DFF\u0900-\u097F\u0C80-\u0CFF\u0B80-\u0BFF\u0C00-\u0C7F\uAC00-\uD7AF\u1100-\u11FF\u3040-\u309F\u30A0-\u30FFー\u4E00-\u62FF\u6300-\u77FF\u7800-\u8CFF\u8D00-\u9FFF\u3400-\u4DBF\U00020000-\U000215FF\U00021600-\U000230FF\U00023100-\U000245FF\U00024600-\U000260FF\U00026100-\U000275FF\U00027600-\U000290FF\U00029100-\U0002A6DF\U0002A700-\U0002B73F\U0002B740-\U0002B81F\U0002B820-\U0002CEAF\U0002CEB0-\U0002EBEF\u2E80-\u2EFF\u2F00-\u2FDF\u2FF0-\u2FFF\u3000-\u303F\u31C0-\u31EF\u3200-\u32FF\u3300-\u33FF\uF900-\uFAFF\uFE30-\uFE4F\U0001F200-\U0001F2FF\U0002F800-\U0002FA1F])�token_match��url_match�
|
| 2 |
+
��A�
|
| 3 |
+
� ��A� �'��A�'�''��A�''�(*_*)��A�(*_*)�(-8��A�(-8�(-:��A�(-:�(-;��A�(-;�(-_-)��A�(-_-)�(._.)��A�(._.)�(:��A�(:�(;��A�(;�(=��A�(=�(>_<)��A�(>_<)�(^_^)��A�(^_^)�(o:��A�(o:�(¬_¬)��A�(¬_¬)�(ಠ_ಠ)��A�(ಠ_ಠ)�(╯°□°)╯︵┻━┻��A�(╯°□°)╯︵┻━┻�)-:��A�)-:�):��A�):�-_-��A�-_-�-__-��A�-__-�._.��A�._.�0.0��A�0.0�0.o��A�0.o�0_0��A�0_0�0_o��A�0_o�8)��A�8)�8-)��A�8-)�8-D��A�8-D�8D��A�8D�:'(��A�:'(�:')��A�:')�:'-(��A�:'-(�:'-)��A�:'-)�:(��A�:(�:((��A�:((�:(((��A�:(((�:()��A�:()�:)��A�:)�:))��A�:))�:)))��A�:)))�:*��A�:*�:-(��A�:-(�:-((��A�:-((�:-(((��A�:-(((�:-)��A�:-)�:-))��A�:-))�:-)))��A�:-)))�:-*��A�:-*�:-/��A�:-/�:-0��A�:-0�:-3��A�:-3�:->��A�:->�:-D��A�:-D�:-O��A�:-O�:-P��A�:-P�:-X��A�:-X�:-]��A�:-]�:-o��A�:-o�:-p��A�:-p�:-x��A�:-x�:-|��A�:-|�:-}��A�:-}�:/��A�:/�:0��A�:0�:1��A�:1�:3��A�:3�:>��A�:>�:D��A�:D�:O��A�:O�:P��A�:P�:X��A�:X�:]��A�:]�:o��A�:o�:o)��A�:o)�:p��A�:p�:x��A�:x�:|��A�:|�:}��A�:}�;)��A�;)�;-)��A�;-)�;-D��A�;-D�;D��A�;D�;_;��A�;_;�<.<��A�<.<�</3��A�</3�<3��A�<3�<33��A�<33�<333��A�<333�<space>��A�<space>�=(��A�=(�=)��A�=)�=/��A�=/�=3��A�=3�=D��A�=D�=[��A�=[�=]��A�=]�=|��A�=|�>.<��A�>.<�>.>��A�>.>�>:(��A�>:(�>:o��A�>:o�><(((*>��A�><(((*>�@_@��A�@_@�C++��A�C++�O.O��A�O.O�O.o��A�O.o�O_O��A�O_O�O_o��A�O_o�V.V��A�V.V�V_V��A�V_V�XD��A�XD�XDD��A�XDD�[-:��A�[-:�[:��A�[:�[=��A�[=�\")��A�\")�\n��A�\n�\t��A�\t�]=��A�]=�^_^��A�^_^�^__^��A�^__^�^___^��A�^___^�a.��A�a.�b.��A�b.�c.��A�c.�d.��A�d.�e.��A�e.�f.��A�f.�g.��A�g.�h.��A�h.�i.��A�i.�j.��A�j.�k.��A�k.�l.��A�l.�m.��A�m.�n.��A�n.�o.��A�o.�o.0��A�o.0�o.O��A�o.O�o.o��A�o.o�o_0��A�o_0�o_O��A�o_O�o_o��A�o_o�p.��A�p.�q.��A�q.�r.��A�r.�s.��A�s.�t.��A�t.�u.��A�u.�v.��A�v.�v.v��A�v.v�v_v��A�v_v�w.��A�w.�x.��A�x.�xD��A�xD�xDD��A�xDD�y.��A�y.�z.��A�z.� ��A� C� �¯\(ツ)/¯��A�¯\(ツ)/¯�°C.��A�°�A�C�A�.�°F.��A�°�A�F�A�.�°K.��A�°�A�K�A�.�°c.��A�°�A�c�A�.�°f.��A�°�A�f�A�.�°k.��A�°�A�k�A�.�ä.��A�ä.�ö.��A�ö.�ü.��A�ü.�ಠ_ಠ��A�ಠ_ಠ�ಠ︵ಠ��A�ಠ︵ಠ�—��A�—�faster_heuristics�
|
model/vocab/key2row
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b3384c5e5abe396bde867e24029db2c3c931ecd685d5301a372ca3e3ab6c6ed3
|
| 3 |
+
size 4540989
|
model/vocab/lookups.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:76be8b528d0075f7aae98d6fa57a6d3c83ae480a8469e668d7b0af968995ac71
|
| 3 |
+
size 1
|
model/vocab/strings.json
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9780c13e28f2cb314ccdffe7b7eb0af697dc03c0f360bfee4728470550d8e7fc
|
| 3 |
+
size 13875167
|
model/vocab/vectors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:37104220a2c2dc5857c895747e7e269fea8571c353ac1c616db27846d0ec0413
|
| 3 |
+
size 240000128
|
model/vocab/vectors.cfg
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"mode": "default"
|
| 3 |
+
}
|
requirements.txt
ADDED
|
@@ -0,0 +1,2 @@
|
|
|
|
|
|
|
|
|
|
| 1 |
+
spacy==3.8.11
|
| 2 |
+
huggingface-hub>=0.36,<1
|