wl-ko-ner / README.md
ohohOD
docker
2a3f391
|
Raw
History Blame
2.06 kB
---
title: WygLore Leaf Korean NER
sdk: docker
app_port: 7860
pinned: false
---
# WygLore Leaf โ€” Korean NER endpoint
`wl-ko-ner-v2` (RP ๋„๋ฉ”์ธ ์ ์‘) ONNX ๋ฅผ CPU ๋กœ ์„œ๋น™. ํ•œ๊ตญ์–ด ํ…์ŠคํŠธ -> ์—”ํ‹ฐํ‹ฐ ์ŠคํŒฌ (PS / LC / OG / DT / TI / QT).
- **์šฉ๋„**: WygLore Leaf ํ”Œ๋Ÿฌ๊ทธ์ธ์˜ *๋ชจ๋ฐ”์ผ ์ €๋ฉ”๋ชจ๋ฆฌ ํด๋ฐฑ* โ€” on-device ๋กœ ๋ชจ๋ธ(215-430MB)์„ ๋ชป ์˜ฌ๋ฆฌ๋Š” ๊ธฐ๊ธฐ๊ฐ€ ์ด ์—”๋“œํฌ์ธํŠธ์— *NER ์ถ”๋ก ๋งŒ* ์œ„์ž„. canon-์•ต์ปค / POS ํ•„ํ„ฐ / assemble ์€ ํ”Œ๋Ÿฌ๊ทธ์ธ JS ๊ฐ€ ๊ทธ๋Œ€๋กœ ์ˆ˜ํ–‰.
- **๋ชจ๋ธ**: [m6dd8m/wl-ko-ner-v2](https://huggingface.co/m6dd8m/wl-ko-ner-v2) (CC-BY-SA-4.0). ํ† ํฌ๋‚˜์ด์ €๋Š” base `monologg/koelectra-base-v3-discriminator`.
- **์ถœ๋ ฅ ๋ชจ์–‘**: on-device `ner.js` ์™€ ๋™์ผ โ€” `[{text, type, score, start, end}, ...]`.
- **API** (FastAPI, ํ•œ ๋ฐฉ JSON):
- `POST /extract` โ€” `{"text":"..."}` -> `{"entities":[{text,type,score,start,end}, ...]}`
- `POST /extract_batch` โ€” `{"texts":[...]}` -> `{"results":[[...], ...]}` (์ฝœ๋“œ์Šคํƒ€ํŠธ ๋ฐฐ์น˜, max 512)
- `GET /health` -> `{ok, model, onnx}` ยท `GET /docs` -> ์ธํ„ฐ๋ž™ํ‹ฐ๋ธŒ Swagger UI
- UI(ํ…Œ์ŠคํŠธ์šฉ)๋Š” `/` ๊ทธ๋Œ€๋กœ. ํ”Œ๋Ÿฌ๊ทธ์ธ์€ `/extract` ๋ฅผ `host.nativeFetch` ๋กœ ํ˜ธ์ถœ. โ€ป fastapi/uvicorn ์€ gradio ์˜์กด์„ฑ์ด๋ผ requirements ๋ถˆ์š”.
## ํ•œ๊ณ„ / TODO (ํ”„๋กœ๋•์…˜ ์ „)
- ๋ฌด๋ฃŒ CPU Space: 48h *๋ฌดํŠธ๋ž˜ํ”ฝ* ์‹œ sleep -> ์ฒซ ์š”์ฒญ ~30-60s wake (์ผ์ผ ํŠธ๋ž˜ํ”ฝ ์žˆ์œผ๋ฉด ๊ณ„์† ๊นจ์–ด์žˆ์Œ).
- abuse ๋ณดํ˜ธ ์—†์Œ (public URL) โ€” rate-limit / ํ† ํฐ์€ FastAPI ์ด์ฃผ ์‹œ ์ถ”๊ฐ€.
- ํ”„๋ผ์ด๋ฒ„์‹œ (๋ฏผ๊ฐ ์œ ์ €): ์•ฑ์ด ์‚ฌ์šฉ์ž ํ…์ŠคํŠธ๋ฅผ *๋กœ๊ทธ/์ €์žฅ/ํ•™์Šต ์•ˆ ํ•จ* (stateless) ยท gradio analytics OFF ยท uvicorn access_log OFF ยท HTTPS. ๋‹จ ํ…์ŠคํŠธ๊ฐ€ HF ์ธํ”„๋ผ๋ฅผ *๊ฒฝ์œ *๋Š” ํ•จ -> ์„œ๋ฒ„ ๊ฒฝ๋กœ๋Š” ํ”Œ๋Ÿฌ๊ทธ์ธ์—์„œ **opt-in + ๊ณ ์ง€** (์ž๋™ ๋ผ์šฐํŒ… X). ์™„์ „-๋กœ์ปฌ ์›ํ•˜๋ฉด on-device/lean (๋กœ์ปฌ Ollama ์œ ์ € ๋“ฑ).
- ์ฒซ ๋ถ€ํŒ… ๋กœ๊ทธ(`[boot] ...`)์—์„œ (a) ์–ด๋–ค onnx ๊ฐ€ ์„ ํƒ๋๋Š”์ง€, (b) `id2label` ์ด `B-PS..` ์ธ์ง€(=์ •์ƒ) `LABEL_0..` ์ธ์ง€(=๋ผ๋ฒจ๋งต ํ•„์š”) ํ™•์ธ.