Surgical video understanding
Collection
LoRA adapters, supervised baselines, and LemonFM linear probes trained for the SDSC x Chicago Booth surgical video understanding leaderboard. • 27 items • Updated
YOLOv12-m — PitVis-2023 instrument recognition
Supervised YOLOv12-m detector trained for the 18 PitVis-2023 instruments, then scored as multi-label presence.
This is the “YOLOv12-m” row on the Instruments tab of the SDSC × Chicago Booth surgical video understanding leaderboard.
Prompt example
This closed-set example mirrors the leaderboard format, not a text-input API for this checkpoint.
[surgical frame]
Which instruments are visible in this endoscopic pituitary-surgery frame?
Select every matching label.
- bipolar forceps
- cottle
- cup forceps
- dural scissors
- freer elevator
- haemostatic foam
- irrigation syringe
- kerrisons
- micro doppler
- nasal cutting forceps
- pituitary rongeurs
- retractable knife
- ring curette
- spatula dissector
- stealth pointer
- suction
- surgical drill
- tissue glue
Evaluation
Full PitVis-2023 validation split (95% bootstrap CI):
| Metric | Value |
|---|---|
| Exact match | 82.78% (82.36–83.20) |
| Micro-averaged F1 | 82.75% (82.32–83.20) |
License note
Derived from Ultralytics YOLO weights; distributed under AGPL-3.0.
References
- Skobelev, K., Fithian, E., Baranovski, Y., et al. A Comparative Study in Surgical AI: Potential and Limitations of Data, Compute, and Scaling. arXiv:2603.27341, 2026.
- Dataset: Das, A., Khan, D. Z., Psychogyios, D., et al. PitVis-2023 Challenge: Workflow Recognition in Videos of Endoscopic Pituitary Surgery. Medical Image Analysis, 106, 103716 (2025).
Limitations
Research baseline only. Not a medical device.
- Downloads last month
- 36