Instructions to use sdoerrich97/true_colon_yolov8m_realcolon_s123 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- ultralytics
How to use sdoerrich97/true_colon_yolov8m_realcolon_s123 with ultralytics:
from huggingface_hub import hf_hub_download from ultralytics import YOLO # pick the weights file from this repo's "Files and versions" tab weights = hf_hub_download("sdoerrich97/true_colon_yolov8m_realcolon_s123", "<weights>.pt") model = YOLO(weights) source = 'http://images.cocodataset.org/val2017/000000039769.jpg' model.predict(source=source, save=True) - Notebooks
- Google Colab
- Kaggle
Upload folder using huggingface_hub
Browse files- README.md +136 -0
- config.json +17 -0
- model.pt +3 -0
README.md
ADDED
|
@@ -0,0 +1,136 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: agpl-3.0
|
| 3 |
+
library_name: ultralytics
|
| 4 |
+
tags:
|
| 5 |
+
- object-detection
|
| 6 |
+
- medical-imaging
|
| 7 |
+
- colonoscopy
|
| 8 |
+
- polyp-detection
|
| 9 |
+
- endoscopy
|
| 10 |
+
pipeline_tag: object-detection
|
| 11 |
+
---
|
| 12 |
+
|
| 13 |
+
# TRUE-Colon — YOLOv8-M (REAL-Colon, seed 123)
|
| 14 |
+
|
| 15 |
+
YOLOv8-M trained on the **REAL-Colon** dataset of 60 complete, unedited colonoscopy
|
| 16 |
+
procedures, released alongside the TRUE-Colon evaluation protocol
|
| 17 |
+
(MICCAI 2026 EndoLINA workshop).
|
| 18 |
+
|
| 19 |
+
This is one of three seeds. Reporting a single seed of this model in isolation would
|
| 20 |
+
overstate its precision; the paper aggregates all three.
|
| 21 |
+
|
| 22 |
+
## Model Details
|
| 23 |
+
|
| 24 |
+
- **Developed by:** Chair of Explainable Machine Learning, Otto-Friedrich-University Bamberg
|
| 25 |
+
- **Model type:** Single-class object detector (`lesion`)
|
| 26 |
+
- **License:** AGPL-3.0, inherited from Ultralytics. This is **not** the MIT license of the
|
| 27 |
+
`true_colon` evaluation package. Using these weights in a product carries the AGPL's
|
| 28 |
+
source-availability obligations.
|
| 29 |
+
- **Framework:** Ultralytics
|
| 30 |
+
|
| 31 |
+
### Model Sources
|
| 32 |
+
|
| 33 |
+
- **Paper:** https://arxiv.org/abs/2608.13711
|
| 34 |
+
- **Repository:** https://github.com/sdoerrich97/true-colon
|
| 35 |
+
- **Protocol package:** https://pypi.org/project/true-colon/
|
| 36 |
+
|
| 37 |
+
### Architecture and training
|
| 38 |
+
|
| 39 |
+
| | |
|
| 40 |
+
|---|---|
|
| 41 |
+
| Backbone | YOLOv8 |
|
| 42 |
+
| Input | 640 x 640 |
|
| 43 |
+
| Classes | 1 (`lesion`) |
|
| 44 |
+
| Training data | REAL-Colon, patient-level split, 86.47% lesion-free training frames |
|
| 45 |
+
| Seed | 123 |
|
| 46 |
+
| Batch size | 208 |
|
| 47 |
+
| Optimizer | SGD, lr0 0.01, momentum 0.9, weight decay 5e-4 (resolved from `optimizer=auto`) |
|
| 48 |
+
| Schedule | 100 epochs, early stopping patience 10, 3-epoch warm-up |
|
| 49 |
+
| Initialization | COCO-pretrained, as shipped by Ultralytics |
|
| 50 |
+
| Ultralytics version | 8.3.232 |
|
| 51 |
+
|
| 52 |
+
This is the configuration this checkpoint was trained with. The paper states the recipe in
|
| 53 |
+
one sentence and otherwise defers to the frameworks' defaults, so the values it does not
|
| 54 |
+
state — the optimizer, learning rate, momentum, weight decay and warm-up — come from the
|
| 55 |
+
training run itself.
|
| 56 |
+
|
| 57 |
+
> **On the optimizer.** The run recorded `optimizer: auto`, which is the framework
|
| 58 |
+
> default the paper keeps. Ultralytics resolves that at runtime: SGD when the iteration
|
| 59 |
+
> budget exceeds 10,000, AdamW otherwise. This run reaches 820,500 iterations, so
|
| 60 |
+
> it trained with **SGD**, at `lr0=0.01` and `momentum=0.9` — `auto` sets both, so the
|
| 61 |
+
> run's own `momentum` entry does not apply.
|
| 62 |
+
|
| 63 |
+
## Uses
|
| 64 |
+
|
| 65 |
+
### Direct use
|
| 66 |
+
|
| 67 |
+
Research on polyp detection and on evaluation methodology for video-based computer-aided
|
| 68 |
+
detection. The intended use is reproducing and extending the TRUE-Colon benchmark.
|
| 69 |
+
|
| 70 |
+
### Out-of-scope use
|
| 71 |
+
|
| 72 |
+
**This is not a medical device and must not be used for clinical decision-making.** The
|
| 73 |
+
paper's own conclusion is that performance under realistic full-procedure conditions
|
| 74 |
+
remains insufficient for reliable clinical deployment. It has not been validated
|
| 75 |
+
prospectively, cleared by any regulator, or tested against the population, scope hardware
|
| 76 |
+
or bowel-preparation quality of any particular site.
|
| 77 |
+
|
| 78 |
+
## Bias, risks and limitations
|
| 79 |
+
|
| 80 |
+
- Trained on 60 procedures from 4 institutions; endoscope hardware, imaging mode and
|
| 81 |
+
patient population all shift performance.
|
| 82 |
+
- Detection is dominated by medium and large lesions; average precision on small lesions
|
| 83 |
+
is near zero.
|
| 84 |
+
- Two histological subtypes (SSL, TSA) appear only in the test split, and sessile serrated
|
| 85 |
+
lesions have the highest miss rates.
|
| 86 |
+
- Frame-level, with no temporal model: each frame is scored independently.
|
| 87 |
+
|
| 88 |
+
## How to get started
|
| 89 |
+
|
| 90 |
+
```python
|
| 91 |
+
from ultralytics import YOLO # or RTDETR for the RT-DETR variant
|
| 92 |
+
from huggingface_hub import hf_hub_download
|
| 93 |
+
|
| 94 |
+
weights = hf_hub_download("sdoerrich97/true_colon_yolov8m_realcolon_s123", "model.pt")
|
| 95 |
+
model = YOLO(weights)
|
| 96 |
+
results = model.predict("frame.jpg", conf=0.06)
|
| 97 |
+
```
|
| 98 |
+
|
| 99 |
+
Then evaluate under the protocol:
|
| 100 |
+
|
| 101 |
+
```python
|
| 102 |
+
import true_colon as tc
|
| 103 |
+
|
| 104 |
+
evaluator = tc.create_evaluator(dataset="realcolon", id_source="pred_string")
|
| 105 |
+
result = evaluator.evaluate_paths("gt.json", "predictions.json")
|
| 106 |
+
```
|
| 107 |
+
|
| 108 |
+
## Evaluation
|
| 109 |
+
|
| 110 |
+
Evaluate with the TRUE-Colon protocol rather than COCO mAP alone: the point of the
|
| 111 |
+
benchmark is that localization accuracy alone does not predict deployment behaviour. The
|
| 112 |
+
paper reports this architecture at a matched false-alert operating point of
|
| 113 |
+
**tau* = 0.06** on REAL-Colon, targeting a frame-level false-positive rate of 4-5%.
|
| 114 |
+
|
| 115 |
+
For the full result tables, see the paper. Per-seed numbers are not reproduced on this
|
| 116 |
+
card, because a single seed's values are not the quantity the paper reports.
|
| 117 |
+
|
| 118 |
+
## Citation
|
| 119 |
+
|
| 120 |
+
```bibtex
|
| 121 |
+
@inproceedings{doerrich2026truecolon,
|
| 122 |
+
title = {TRUE-Colon: Exposing a Consistent Transfer Asymmetry in Real-Time Polyp Detection},
|
| 123 |
+
author = {Doerrich, Sebastian and Schwab, Andreas Franz and Di Salvo, Francesco
|
| 124 |
+
and Rai, Shyam Nandan and Nguyen, Hanh Huyen My and Ledig, Christian},
|
| 125 |
+
booktitle = {MICCAI Workshop on Endoscopic Lesion Identification and Analysis (EndoLINA)},
|
| 126 |
+
year = {2026},
|
| 127 |
+
eprint = {2608.13711},
|
| 128 |
+
archivePrefix = {arXiv},
|
| 129 |
+
primaryClass = {eess.IV},
|
| 130 |
+
doi = {10.48550/arXiv.2608.13711}
|
| 131 |
+
}
|
| 132 |
+
```
|
| 133 |
+
|
| 134 |
+
## Contact
|
| 135 |
+
|
| 136 |
+
sebastian.doerrich@uni-bamberg.de
|
config.json
ADDED
|
@@ -0,0 +1,17 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"architectures": [
|
| 3 |
+
"YOLOv8"
|
| 4 |
+
],
|
| 5 |
+
"model_type": "yolov8",
|
| 6 |
+
"library_name": "ultralytics",
|
| 7 |
+
"input_size": 640,
|
| 8 |
+
"num_classes": 1,
|
| 9 |
+
"class_names": [
|
| 10 |
+
"lesion"
|
| 11 |
+
],
|
| 12 |
+
"training_dataset": "REAL-Colon",
|
| 13 |
+
"training_seed": 123,
|
| 14 |
+
"matched_threshold_realcolon": 0.06,
|
| 15 |
+
"license": "agpl-3.0",
|
| 16 |
+
"source_sha256": "a6c7f7065d1bf2d48cef84ca215b6bd13717bf13b4471c04babcb1cf641a0917"
|
| 17 |
+
}
|
model.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a6c7f7065d1bf2d48cef84ca215b6bd13717bf13b4471c04babcb1cf641a0917
|
| 3 |
+
size 103832394
|