Download src/crayon/adaptive/__init__.py from Xerv-AI/CRAYON-tokenizer: direct link, hf CLI and curl.
- Browser
- Download file 700 Bytes
-
https://huggingface.co/Xerv-AI/CRAYON-tokenizer/resolve/708f4a32d1dad5ca970aa34e3bd3e309eacaf4cd/src/crayon/adaptive/__init__.py
- Command line
-
hf download hf://Xerv-AI/CRAYON-tokenizer@708f4a32d1dad5ca970aa34e3bd3e309eacaf4cd/src/crayon/adaptive/__init__.py
-
curl -L -o __init__.py https://huggingface.co/Xerv-AI/CRAYON-tokenizer/resolve/708f4a32d1dad5ca970aa34e3bd3e309eacaf4cd/src/crayon/adaptive/__init__.py
700 Bytes
| """ | |
| Crayon Adaptive Module. | |
| Implements vocabulary adaptation and stability management from Section 8 | |
| of the XERV Crayon Engineering Treatise. | |
| Components: | |
| - StableVocabularyManager: Deterministic ID assignment with reserved ranges | |
| - AdaptiveVocabularyManager: Real-time vocabulary adaptation | |
| - IncrementalVocabularyUpdater: Staged updates with rollback capability | |
| """ | |
| from .stability import StableVocabularyManager, TokenCategory, TokenMetadata | |
| from .manager import AdaptiveVocabularyManager | |
| from .updater import IncrementalVocabularyUpdater | |
| __all__ = [ | |
| "StableVocabularyManager", | |
| "TokenCategory", | |
| "TokenMetadata", | |
| "AdaptiveVocabularyManager", | |
| "IncrementalVocabularyUpdater", | |
| ] |