Instructions to use zjumty/so101-yolo11n-seg-plastic-cup with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- ultralytics
How to use zjumty/so101-yolo11n-seg-plastic-cup with ultralytics:
# Couldn't find a valid YOLO version tag. # Replace XX with the correct version. from ultralytics import YOLOvXX model = YOLOvXX.from_pretrained("zjumty/so101-yolo11n-seg-plastic-cup") source = 'http://images.cocodataset.org/val2017/000000039769.jpg' model.predict(source=source, save=True) - Notebooks
- Google Colab
- Kaggle
Upload fine-tuned YOLO11n-Seg model and metadata
Browse files- .gitattributes +6 -0
- README.md +78 -0
- best.pt +3 -0
- model/evaluation/BoxF1_curve.png +0 -0
- model/evaluation/BoxPR_curve.png +0 -0
- model/evaluation/BoxP_curve.png +0 -0
- model/evaluation/BoxR_curve.png +0 -0
- model/evaluation/MaskF1_curve.png +0 -0
- model/evaluation/MaskPR_curve.png +0 -0
- model/evaluation/MaskP_curve.png +0 -0
- model/evaluation/MaskR_curve.png +0 -0
- model/evaluation/confusion_matrix.png +0 -0
- model/evaluation/confusion_matrix_normalized.png +0 -0
- model/evaluation/val_batch0_labels.jpg +3 -0
- model/evaluation/val_batch0_pred.jpg +3 -0
- model/evaluation/val_batch1_labels.jpg +3 -0
- model/evaluation/val_batch1_pred.jpg +3 -0
- model/evaluation/val_batch2_labels.jpg +3 -0
- model/evaluation/val_batch2_pred.jpg +3 -0
- model/metrics.json +24 -0
- model/provenance.json +25 -0
- model/training-config.yaml +19 -0
.gitattributes
CHANGED
|
@@ -33,3 +33,9 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
| 36 |
+
model/evaluation/val_batch0_labels.jpg filter=lfs diff=lfs merge=lfs -text
|
| 37 |
+
model/evaluation/val_batch0_pred.jpg filter=lfs diff=lfs merge=lfs -text
|
| 38 |
+
model/evaluation/val_batch1_labels.jpg filter=lfs diff=lfs merge=lfs -text
|
| 39 |
+
model/evaluation/val_batch1_pred.jpg filter=lfs diff=lfs merge=lfs -text
|
| 40 |
+
model/evaluation/val_batch2_labels.jpg filter=lfs diff=lfs merge=lfs -text
|
| 41 |
+
model/evaluation/val_batch2_pred.jpg filter=lfs diff=lfs merge=lfs -text
|
README.md
ADDED
|
@@ -0,0 +1,78 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: agpl-3.0
|
| 3 |
+
library_name: ultralytics
|
| 4 |
+
pipeline_tag: image-segmentation
|
| 5 |
+
tags:
|
| 6 |
+
- yolo
|
| 7 |
+
- yolo11
|
| 8 |
+
- instance-segmentation
|
| 9 |
+
- robotics
|
| 10 |
+
- synthetic-data
|
| 11 |
+
- so-101
|
| 12 |
+
---
|
| 13 |
+
|
| 14 |
+
# SO-101 YOLO11n-Seg plastic cup model
|
| 15 |
+
|
| 16 |
+
This repository contains a YOLO11n-Seg model fine-tuned to segment the `plastic_cup` class in the SO-101 simulation scene. It also includes the synthetic dataset used for training and evaluation.
|
| 17 |
+
|
| 18 |
+
## Repository contents
|
| 19 |
+
|
| 20 |
+
- `best.pt`: fine-tuned Ultralytics checkpoint.
|
| 21 |
+
- `model/metrics.json`: metrics from the held-out synthetic test split.
|
| 22 |
+
- `model/training-config.yaml`: portable training settings.
|
| 23 |
+
- `model/evaluation/`: test plots and prediction previews.
|
| 24 |
+
- `dataset/`: YOLO segmentation images, polygon labels, per-sample truth, and the dataset manifest.
|
| 25 |
+
- `SHA256SUMS`: hashes for the uploaded files.
|
| 26 |
+
|
| 27 |
+
## Dataset
|
| 28 |
+
|
| 29 |
+
The dataset has 1,200 synthetic 640 x 480 images rendered from the SO-101 MuJoCo scene through `task_camera`. Object-ID segmentation supplied the label masks. The split is fixed by seed range:
|
| 30 |
+
|
| 31 |
+
| Split | Images | Labels | Seeds |
|
| 32 |
+
| --- | ---: | ---: | --- |
|
| 33 |
+
| train | 800 | 800 | 100000-100799 |
|
| 34 |
+
| validation | 200 | 200 | 200000-200199 |
|
| 35 |
+
| test | 200 | 200 | 300000-300199 |
|
| 36 |
+
|
| 37 |
+
The only class is `plastic_cup` (`class_id=0`). Samples include no-cup, one-cup, and multi-cup scenes. The manifest records the scenario, seed, visible instance count, image path, label path, and synthetic truth path for each sample.
|
| 38 |
+
|
| 39 |
+
Dataset generator commit: `2be8df09302feabffc7f028b16c90d06867f8055` (`build(perception): pin training runtime and labeled overlays`).
|
| 40 |
+
|
| 41 |
+
## Training
|
| 42 |
+
|
| 43 |
+
The run started from `yolo11n-seg.pt` and used Ultralytics segmentation training with these main settings:
|
| 44 |
+
|
| 45 |
+
| Setting | Value |
|
| 46 |
+
| --- | --- |
|
| 47 |
+
| image size | 640 |
|
| 48 |
+
| epochs | 100 |
|
| 49 |
+
| batch size | 32 |
|
| 50 |
+
| seed | 20260831 |
|
| 51 |
+
| deterministic | true |
|
| 52 |
+
| device | CUDA |
|
| 53 |
+
| AMP | false |
|
| 54 |
+
| optimizer | auto |
|
| 55 |
+
|
| 56 |
+
Checkpoint SHA-256: `f281d25258493e2c7c220dd1d84a7ca4f0501adf99ed4a921a065d74ace40781`.
|
| 57 |
+
|
| 58 |
+
## Synthetic test results
|
| 59 |
+
|
| 60 |
+
| Metric | Boxes | Masks |
|
| 61 |
+
| --- | ---: | ---: |
|
| 62 |
+
| precision | 0.999735 | 0.999735 |
|
| 63 |
+
| recall | 1.000000 | 1.000000 |
|
| 64 |
+
| mAP50 | 0.995000 | 0.995000 |
|
| 65 |
+
| mAP50-95 | 0.995000 | 0.973662 |
|
| 66 |
+
|
| 67 |
+
These numbers describe the fixed synthetic test split. They do not establish accuracy on real cameras, unfamiliar cup appearances, or physical grasp success.
|
| 68 |
+
|
| 69 |
+
## Use with Ultralytics
|
| 70 |
+
|
| 71 |
+
```python
|
| 72 |
+
from ultralytics import YOLO
|
| 73 |
+
|
| 74 |
+
model = YOLO("best.pt")
|
| 75 |
+
results = model.predict("image.png")
|
| 76 |
+
```
|
| 77 |
+
|
| 78 |
+
The checkpoint inherits the licensing requirements of its Ultralytics YOLO11 base model. The repository is private because a separate license has not been declared for the synthetic dataset.
|
best.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f281d25258493e2c7c220dd1d84a7ca4f0501adf99ed4a921a065d74ace40781
|
| 3 |
+
size 6001316
|
model/evaluation/BoxF1_curve.png
ADDED
|
model/evaluation/BoxPR_curve.png
ADDED
|
model/evaluation/BoxP_curve.png
ADDED
|
model/evaluation/BoxR_curve.png
ADDED
|
model/evaluation/MaskF1_curve.png
ADDED
|
model/evaluation/MaskPR_curve.png
ADDED
|
model/evaluation/MaskP_curve.png
ADDED
|
model/evaluation/MaskR_curve.png
ADDED
|
model/evaluation/confusion_matrix.png
ADDED
|
model/evaluation/confusion_matrix_normalized.png
ADDED
|
model/evaluation/val_batch0_labels.jpg
ADDED
|
Git LFS Details
|
model/evaluation/val_batch0_pred.jpg
ADDED
|
Git LFS Details
|
model/evaluation/val_batch1_labels.jpg
ADDED
|
Git LFS Details
|
model/evaluation/val_batch1_pred.jpg
ADDED
|
Git LFS Details
|
model/evaluation/val_batch2_labels.jpg
ADDED
|
Git LFS Details
|
model/evaluation/val_batch2_pred.jpg
ADDED
|
Git LFS Details
|
model/metrics.json
ADDED
|
@@ -0,0 +1,24 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"names": {
|
| 3 |
+
"0": "plastic_cup"
|
| 4 |
+
},
|
| 5 |
+
"results_dict": {
|
| 6 |
+
"fitness": 1.9686621837012601,
|
| 7 |
+
"metrics/mAP50(B)": 0.995,
|
| 8 |
+
"metrics/mAP50(M)": 0.995,
|
| 9 |
+
"metrics/mAP50-95(B)": 0.9949999999999999,
|
| 10 |
+
"metrics/mAP50-95(M)": 0.9736621837012602,
|
| 11 |
+
"metrics/precision(B)": 0.9997351414137473,
|
| 12 |
+
"metrics/precision(M)": 0.9997351414137473,
|
| 13 |
+
"metrics/recall(B)": 1.0,
|
| 14 |
+
"metrics/recall(M)": 1.0
|
| 15 |
+
},
|
| 16 |
+
"speed_ms": {
|
| 17 |
+
"inference": 0.9762399850001202,
|
| 18 |
+
"loss": 0.00019861499822582118,
|
| 19 |
+
"postprocess": 0.394080710000253,
|
| 20 |
+
"preprocess": 1.2785653700029798
|
| 21 |
+
},
|
| 22 |
+
"split": "test"
|
| 23 |
+
}
|
| 24 |
+
|
model/provenance.json
ADDED
|
@@ -0,0 +1,25 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"schema_version": 1,
|
| 3 |
+
"task": "segment",
|
| 4 |
+
"class_names": {
|
| 5 |
+
"0": "plastic_cup"
|
| 6 |
+
},
|
| 7 |
+
"base_model": "yolo11n-seg.pt",
|
| 8 |
+
"checkpoint_sha256": "f281d25258493e2c7c220dd1d84a7ca4f0501adf99ed4a921a065d74ace40781",
|
| 9 |
+
"dataset_generator_commit": "2be8df09302feabffc7f028b16c90d06867f8055",
|
| 10 |
+
"dataset_generator_commit_subject": "build(perception): pin training runtime and labeled overlays",
|
| 11 |
+
"training_run": "full-exp-012",
|
| 12 |
+
"training_seed": 20260831,
|
| 13 |
+
"dataset_sample_count": 1200,
|
| 14 |
+
"dataset_split_counts": {
|
| 15 |
+
"train": 800,
|
| 16 |
+
"val": 200,
|
| 17 |
+
"test": 200
|
| 18 |
+
},
|
| 19 |
+
"dataset_image_size": {
|
| 20 |
+
"width": 640,
|
| 21 |
+
"height": 480
|
| 22 |
+
},
|
| 23 |
+
"dataset_camera": "task_camera",
|
| 24 |
+
"dataset_manifest_schema_version": 1
|
| 25 |
+
}
|
model/training-config.yaml
ADDED
|
@@ -0,0 +1,19 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
task: segment
|
| 2 |
+
model: yolo11n-seg.pt
|
| 3 |
+
data: dataset/dataset.yaml
|
| 4 |
+
classes:
|
| 5 |
+
- 0
|
| 6 |
+
imgsz: 640
|
| 7 |
+
epochs: 100
|
| 8 |
+
batch: 32
|
| 9 |
+
workers: 8
|
| 10 |
+
seed: 20260831
|
| 11 |
+
deterministic: true
|
| 12 |
+
device: cuda
|
| 13 |
+
amp: false
|
| 14 |
+
optimizer: auto
|
| 15 |
+
patience: 20
|
| 16 |
+
save: true
|
| 17 |
+
plots: true
|
| 18 |
+
verbose: true
|
| 19 |
+
|