Instructions to use oddadmix/Emhotob-500K-MSA-Egyptian-v2 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use oddadmix/Emhotob-500K-MSA-Egyptian-v2 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="oddadmix/Emhotob-500K-MSA-Egyptian-v2")# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("oddadmix/Emhotob-500K-MSA-Egyptian-v2") model = AutoModelForCausalLM.from_pretrained("oddadmix/Emhotob-500K-MSA-Egyptian-v2", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use oddadmix/Emhotob-500K-MSA-Egyptian-v2 with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "oddadmix/Emhotob-500K-MSA-Egyptian-v2" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "oddadmix/Emhotob-500K-MSA-Egyptian-v2", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/oddadmix/Emhotob-500K-MSA-Egyptian-v2
- SGLang
How to use oddadmix/Emhotob-500K-MSA-Egyptian-v2 with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "oddadmix/Emhotob-500K-MSA-Egyptian-v2" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "oddadmix/Emhotob-500K-MSA-Egyptian-v2", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "oddadmix/Emhotob-500K-MSA-Egyptian-v2" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "oddadmix/Emhotob-500K-MSA-Egyptian-v2", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use oddadmix/Emhotob-500K-MSA-Egyptian-v2 with Docker Model Runner:
docker model run hf.co/oddadmix/Emhotob-500K-MSA-Egyptian-v2
Emhotob-500K-MSA-Egyptian-v1 — Bidirectional MSA ↔ Egyptian Arabic (~0.5M params)
A 0.5M-parameter model that translates both ways between Modern Standard Arabic (الفصحى) and Egyptian colloquial Arabic (المصرية العامية). A single set of weights serves both directions; a direction-specific system prompt selects which way to translate.
Finetuned from oddadmix/Emhotob-500K-v2, a tiny Llama-architecture
base (hidden 16, 2 layers, 2 heads, vocab 32000, tied embeddings).
Scaling study. This is one rung of a from-scratch Arabic scaling study that runs an identical SFT + eval recipe across bases from 0.5M to 50M parameters to locate where translation emerges. On the headline MSA↔Egyptian pair, output is degenerate at ≤1M, becomes real-but-rough at 5M, and usable at 10M+. See the sibling
oddadmix/50M-MSA-Egyptian-v1for the fluent reference.
Evaluation
Deterministic held-out set of 3,000 pairs (seed=42),
decoded greedily (do_sample=False, no repetition penalty), scored with sacreBLEU:
| Direction | sacreBLEU | chrF |
|---|---|---|
| MSA → Egyptian | 0.00 | 2.99 |
| Egyptian → MSA | 0.01 | 3.39 |
Saved weights are the best checkpoint by validation loss (eval_loss = 6.513). 20 samples
per direction with references are in eval_bidirectional.json.
Example translations
Real greedy-decoded outputs from the held-out set:
MSA → Egyptian
| Source | Model output | Reference |
|---|---|---|
| أنا فقط أحاول أن أطمئن نفسي. ما هو الأسوأ الذي يمكن أن يحدث؟ إنه مرهق عقليًا فقط، لكنهم يقفون بحزم. حقًا، إنهم يقفون بحز | أنا يا رفاق.com الأحيان. الأحيان. الأحيان. الأحيان. الأحيان. الأحيان. الأحيان. الأحيان. الأحيان. الأحيان. الأحيان. الأحي | انا بس بحاول اطمن نفسي. ايه أسوأ حاجة ممكن تحصل؟ الموضوع متعب نفسيًا، بس هم واقفين ثابتين فعلاً. |
| شكرًا جزيلًا لك، أنت لطيف للغاية. | أنا يا رفاق.com الأحيان. الأحيان. الأحيان. الأحيان. الأحيان. الأحيان. الأحيان. الأحيان. الأحيان. الأحيان. الأحيان. الأحي | شكراً جداً، إنت طيب قوي. |
Egyptian → MSA
| Source | Model output | Reference |
|---|---|---|
| انا بس بحاول اطمن نفسي. ايه أسوأ حاجة ممكن تحصل؟ الموضوع متعب نفسيًا، بس هم واقفين ثابتين فعلاً. | أنا يا رفاق.com الأحيان. الأحيان. الأحيان. الأحيان. الأحيان. الأحيان. الأحيان. الأحيان. الأحيان. الأحيان. الأحيان. الأحي | أنا فقط أحاول أن أطمئن نفسي. ما هو الأسوأ الذي يمكن أن يحدث؟ إنه مرهق عقليًا فقط، لكنهم يقفون بحزم. حقًا، إنهم يقفون بحز |
| شكراً جداً، إنت طيب قوي. | أنا يا رفاق.com الأحيان. الأحيان. الأحيان. الأحيان. الأحيان. الأحيان. الأحيان. الأحيان. الأحيان. الأحيان. الأحيان. الأحي | شكرًا جزيلًا لك، أنت لطيف للغاية. |
Usage
ChatML format. Pick the system prompt for the direction you want:
import torch
from transformers import AutoModelForCausalLM, AutoTokenizer
model_id = "oddadmix/Emhotob-500K-MSA-Egyptian-v2"
tok = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(model_id, dtype=torch.bfloat16).to("cuda").eval()
SYSTEM = "أنت مترجم محترف. ترجم النص من اللغة العربية الفصحى إلى اللهجة المصرية العامية."
def translate(text, system=SYSTEM):
prompt = (f"<|im_start|>system\n{system}<|im_end|>\n"
f"<|im_start|>user\n{text.strip()}<|im_end|>\n<|im_start|>assistant\n")
ids = tok(prompt, return_tensors="pt", add_special_tokens=False).to(model.device)
if tok.bos_token_id is not None:
bos = torch.tensor([[tok.bos_token_id]], device=model.device)
ids["input_ids"] = torch.cat([bos, ids["input_ids"]], dim=1)
ids["attention_mask"] = torch.cat([torch.ones_like(bos), ids["attention_mask"]], dim=1)
out = model.generate(**ids, max_new_tokens=256, do_sample=False,
eos_token_id=tok.eos_token_id, pad_token_id=tok.pad_token_id)
return tok.decode(out[0, ids["input_ids"].size(1):], skip_special_tokens=True).strip()
Training
- Base model:
oddadmix/Emhotob-500K-v2(Llama arch, hidden 16, 2 layers, 2 heads, vocab 32000, tied embeddings; 518,256 params after resizing for 2 ChatML tokens) - Dataset:
oddadmix/egyptian-msa-2.9-openai-bytedance-translations - Method: HuggingFace
Trainer, ChatML, prompt-masked cross-entropy (loss only on the assistant turn). Each row is exploded into two training examples (one per direction). - Hyperparameters: 3 epochs · effective batch 64 · LR 3e-4 (cosine, 5% warmup) ·
bf16 · max length 1024 ·
load_best_model_at_endoneval_loss. - Eval split: 3,000 deterministic held-out pairs (
seed=42), scored both directions.
Limitations
A ~0.5M model: reliable on short/common sentences, but drift, repetition, and errors appear on long or rare inputs. Gender is disambiguated only from context. For fluent translation use the 50M sibling.
License
Apache-2.0, inherited from the base model.
- Downloads last month
- 17
Model tree for oddadmix/Emhotob-500K-MSA-Egyptian-v2
Base model
oddadmix/Emhotob-500K-v2