Text Generation
Transformers
Safetensors
Arabic
English
llama
translation
egyptian-arabic
english
arabic
small-language-model
slm
tiny-lm
chatml
scaling-study
text-generation-inference
Instructions to use oddadmix/Emhotob-10M-Egyptian-English-v2 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use oddadmix/Emhotob-10M-Egyptian-English-v2 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="oddadmix/Emhotob-10M-Egyptian-English-v2")# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("oddadmix/Emhotob-10M-Egyptian-English-v2") model = AutoModelForCausalLM.from_pretrained("oddadmix/Emhotob-10M-Egyptian-English-v2", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use oddadmix/Emhotob-10M-Egyptian-English-v2 with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "oddadmix/Emhotob-10M-Egyptian-English-v2" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "oddadmix/Emhotob-10M-Egyptian-English-v2", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/oddadmix/Emhotob-10M-Egyptian-English-v2
- SGLang
How to use oddadmix/Emhotob-10M-Egyptian-English-v2 with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "oddadmix/Emhotob-10M-Egyptian-English-v2" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "oddadmix/Emhotob-10M-Egyptian-English-v2", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "oddadmix/Emhotob-10M-Egyptian-English-v2" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "oddadmix/Emhotob-10M-Egyptian-English-v2", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use oddadmix/Emhotob-10M-Egyptian-English-v2 with Docker Model Runner:
docker model run hf.co/oddadmix/Emhotob-10M-Egyptian-English-v2
Add out-of-domain English->Egyptian leaderboard eval
Browse files
README.md
CHANGED
|
@@ -106,13 +106,13 @@ def translate(text, system=SYSTEM):
|
|
| 106 |
- **Eval split:** 3,000 deterministic held-out pairs (`seed=42`), scored both directions.
|
| 107 |
|
| 108 |
<!-- BEGIN: leaderboard-en2egy-eval -->
|
| 109 |
-
## Out-of-domain evaluation — Egyptian
|
| 110 |
|
| 111 |
The results above are **in-domain**: a held-out split of the same corpus this model was
|
| 112 |
-
trained on. The numbers below are **out-of-domain** — the same model scored on
|
| 113 |
-
[
|
| 114 |
-
|
| 115 |
-
|
| 116 |
|
| 117 |
Expect these to be substantially lower than the in-domain scores. That gap is the
|
| 118 |
generalization penalty, not a regression — both numbers are real, they measure different things.
|
|
@@ -149,9 +149,11 @@ translation that picks a different valid word is penalized — e.g. `فريش` v
|
|
| 149 |
good Egyptian; only one matches the reference. **chrF and METEOR track perceived quality more
|
| 150 |
closely here.**
|
| 151 |
|
| 152 |
-
|
| 153 |
-
|
| 154 |
-
|
|
|
|
|
|
|
| 155 |
<!-- END: leaderboard-en2egy-eval -->
|
| 156 |
|
| 157 |
## Limitations
|
|
|
|
| 106 |
- **Eval split:** 3,000 deterministic held-out pairs (`seed=42`), scored both directions.
|
| 107 |
|
| 108 |
<!-- BEGIN: leaderboard-en2egy-eval -->
|
| 109 |
+
## Out-of-domain evaluation — Egyptian Arabic Translation Benchmark
|
| 110 |
|
| 111 |
The results above are **in-domain**: a held-out split of the same corpus this model was
|
| 112 |
+
trained on. The numbers below are **out-of-domain** — the same model scored on the
|
| 113 |
+
[Egyptian Arabic Translation Benchmark](https://huggingface.co/datasets/oddadmix/egyptian-arabic-translation-benchmark)
|
| 114 |
+
(`oddadmix/egyptian-arabic-translation-benchmark`, 319 English→Egyptian pairs written by a different annotator with different
|
| 115 |
+
orthographic conventions).
|
| 116 |
|
| 117 |
Expect these to be substantially lower than the in-domain scores. That gap is the
|
| 118 |
generalization penalty, not a regression — both numbers are real, they measure different things.
|
|
|
|
| 149 |
good Egyptian; only one matches the reference. **chrF and METEOR track perceived quality more
|
| 150 |
closely here.**
|
| 151 |
|
| 152 |
+
At 319 rows, differences of roughly 1–2 BLEU between adjacent rungs are within noise.
|
| 153 |
+
|
| 154 |
+
These are small models — 5M to 50M parameters, orders of magnitude below the large systems
|
| 155 |
+
typically evaluated on this benchmark. The result of interest is the **scaling curve and
|
| 156 |
+
per-parameter efficiency**, not absolute rank against models 100–1000× the size.
|
| 157 |
<!-- END: leaderboard-en2egy-eval -->
|
| 158 |
|
| 159 |
## Limitations
|