Reinforcement Learning
stable-baselines3
PyTorch
English
Korean
deep-reinforcement-learning
ppo
continuous-control
mujoco
pusher
pusher-v5
robotics
robot
robot-arm
robotic-manipulation
7-dof
gymnasium
Eval Results (legacy)
Instructions to use hwihwalab/pusher-v5-ppo with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- stable-baselines3
How to use hwihwalab/pusher-v5-ppo with stable-baselines3:
from huggingface_sb3 import load_from_hub checkpoint = load_from_hub( repo_id="hwihwalab/pusher-v5-ppo", filename="{MODEL FILENAME}.zip", ) - Notebooks
- Google Colab
- Kaggle
feat: deploy Pusher-v5 PPO model, telemetry cockpit, and video gallery
Browse files- README.md +18 -0
- README_KR.md +18 -0
README.md
CHANGED
|
@@ -195,6 +195,20 @@ This repository is governed by rigorous engineering protocols to ensure simulati
|
|
| 195 |
- **[`DOCS_DATA_SCHEMA.md`](https://github.com/Hwihwa-Lab/pusher-v5-ppo/blob/main/DOCS_DATA_SCHEMA.md)**: WebSocket Telemetry Protocol & REST Data Schema
|
| 196 |
- **[`DOCS_MODEL_EVALUATION_AND_HF_DEPLOY.md`](https://github.com/Hwihwa-Lab/pusher-v5-ppo/blob/main/DOCS_MODEL_EVALUATION_AND_HF_DEPLOY.md)**: Benchmark Evaluation & Hugging Face Hub Pipeline
|
| 197 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 198 |
---
|
| 199 |
|
| 200 |
## ๐ Open Source Hubs & Project Links
|
|
@@ -207,3 +221,7 @@ This repository is governed by rigorous engineering protocols to ensure simulati
|
|
| 207 |
## ๐ License
|
| 208 |
This project is licensed under the MIT License - see the [LICENSE](LICENSE) file for details.
|
| 209 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 195 |
- **[`DOCS_DATA_SCHEMA.md`](https://github.com/Hwihwa-Lab/pusher-v5-ppo/blob/main/DOCS_DATA_SCHEMA.md)**: WebSocket Telemetry Protocol & REST Data Schema
|
| 196 |
- **[`DOCS_MODEL_EVALUATION_AND_HF_DEPLOY.md`](https://github.com/Hwihwa-Lab/pusher-v5-ppo/blob/main/DOCS_MODEL_EVALUATION_AND_HF_DEPLOY.md)**: Benchmark Evaluation & Hugging Face Hub Pipeline
|
| 197 |
|
| 198 |
+
## ๐ Repository Contents
|
| 199 |
+
|
| 200 |
+
* `README.md`: English Model Card and benchmark performance guide.
|
| 201 |
+
* `README_KR.md`: Full Korean comprehensive manual ([ํ๊ตญ์ด ๋งค๋ด์ผ](README_KR.md)).
|
| 202 |
+
* `app.py`: FastAPI high-performance backend & 30 FPS WebSocket simulation server.
|
| 203 |
+
* `train.py`: Stable-Baselines3 PPO 7-DOF training engine with `VisualProgressCallback`.
|
| 204 |
+
* `evaluate.py`: Standalone 5-episode deterministic policy evaluator and video recorder.
|
| 205 |
+
* `visualizer.py`: Standalone Matplotlib visualizer and benchmark plotter.
|
| 206 |
+
* `web/`: 1-Screen zero-scroll telemetry cockpit frontend (`app.js`, `index.html`, `style.css`).
|
| 207 |
+
* `results/ppo_pusher.zip`: Pre-trained PPO neural network weights (300,000 steps, -32.4 pts).
|
| 208 |
+
* `ppo_pusher_bundle.zip`: Complete production archive with weights, 12 checkpoint videos, and plots.
|
| 209 |
+
* `deploy_to_hf.py`: One-click automated Hugging Face Model Hub deployer.
|
| 210 |
+
* `requirements.txt` & `packages.txt`: Python and system dependency manifests.
|
| 211 |
+
|
| 212 |
---
|
| 213 |
|
| 214 |
## ๐ Open Source Hubs & Project Links
|
|
|
|
| 221 |
## ๐ License
|
| 222 |
This project is licensed under the MIT License - see the [LICENSE](LICENSE) file for details.
|
| 223 |
|
| 224 |
+
---
|
| 225 |
+
|
| 226 |
+
*Trained and maintained by [hwihwalab](https://huggingface.co/hwihwalab/pusher-v5-ppo) & [Hwihwa-Lab](https://github.com/Hwihwa-Lab/pusher-v5-ppo).*
|
| 227 |
+
|
README_KR.md
CHANGED
|
@@ -162,6 +162,20 @@ env.close()
|
|
| 162 |
- **[`DOCS_DATA_SCHEMA.md`](https://github.com/Hwihwa-Lab/pusher-v5-ppo/blob/main/DOCS_DATA_SCHEMA.md)**: ํ
๋ ๋ฉํธ๋ฆฌ ํจํท ํ๋กํ ์ฝ ๋ฐ REST ๋ฐ์ดํฐ ์คํค๋ง
|
| 163 |
- **[`DOCS_MODEL_EVALUATION_AND_HF_DEPLOY.md`](https://github.com/Hwihwa-Lab/pusher-v5-ppo/blob/main/DOCS_MODEL_EVALUATION_AND_HF_DEPLOY.md)**: ๋ฒค์น๋งํฌ ํ๊ฐ ๋ฐ ํ๊น
ํ์ด์ค ๋ฐฐํฌ ๊ท๊ฒฉ์
|
| 164 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 165 |
---
|
| 166 |
|
| 167 |
## ๐ ์คํ์์ค ๊ณต์ ๋งํฌ (Open Source Hubs)
|
|
@@ -173,3 +187,7 @@ env.close()
|
|
| 173 |
|
| 174 |
## ๐ ๋ผ์ด์ ์ค
|
| 175 |
๋ณธ ํ๋ก์ ํธ๋ MIT License๋ฅผ ๋ฐ๋ฆ
๋๋ค.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 162 |
- **[`DOCS_DATA_SCHEMA.md`](https://github.com/Hwihwa-Lab/pusher-v5-ppo/blob/main/DOCS_DATA_SCHEMA.md)**: ํ
๋ ๋ฉํธ๋ฆฌ ํจํท ํ๋กํ ์ฝ ๋ฐ REST ๋ฐ์ดํฐ ์คํค๋ง
|
| 163 |
- **[`DOCS_MODEL_EVALUATION_AND_HF_DEPLOY.md`](https://github.com/Hwihwa-Lab/pusher-v5-ppo/blob/main/DOCS_MODEL_EVALUATION_AND_HF_DEPLOY.md)**: ๋ฒค์น๋งํฌ ํ๊ฐ ๋ฐ ํ๊น
ํ์ด์ค ๋ฐฐํฌ ๊ท๊ฒฉ์
|
| 164 |
|
| 165 |
+
## ๐ ๋ฆฌํฌ์งํ ๋ฆฌ ํ์ผ ๊ตฌ์ฑ (Repository Contents)
|
| 166 |
+
|
| 167 |
+
* `README.md`: ์๋ฌธ ๊ธ๋ก๋ฒ ๋ชจ๋ธ ์นด๋ ๋ฐ ๋ฒค์น๋งํฌ ๊ฐ์ด๋.
|
| 168 |
+
* `README_KR.md`: ํ๊ตญ์ด ์ข
ํฉ ๊ธฐ์ ๋งค๋ด์ผ ([ํ๊ตญ์ด ๋งค๋ด์ผ](README_KR.md)).
|
| 169 |
+
* `app.py`: FastAPI ๊ณ ์ฑ๋ฅ ๋ฐฑ์๋ ๋ฐ 30 FPS WebSocket ๋ฌผ๋ฆฌ ์คํธ๋ฆฌ๋ฐ ์๋ฒ.
|
| 170 |
+
* `train.py`: Stable-Baselines3 PPO 7์์ ๋ ๋ก๋ด ํ ๊ฐํํ์ต ์์ง (`VisualProgressCallback` ๋ด์ฅ).
|
| 171 |
+
* `evaluate.py`: ๋
๋ฆฝ 5ํ ์ฐ์ ๋กค์์ ์ฑ๋ฅ ํ๊ฐ๊ธฐ ๋ฐ ๋น๋์ค ๋
นํ๊ธฐ.
|
| 172 |
+
* `visualizer.py`: ๋
๋ฆฝ Matplotlib ํ
๋ ๋ฉํธ๋ฆฌ ์๊ฐํ ๋ฐ ๊ทธ๋ํ ์์ฑ ๋ชจ๋.
|
| 173 |
+
* `web/`: 1-ํ๋ฉด ์ ๋ก ์คํฌ๋กค ์น ๊ด์ ์ฝํ ํ๋ก ํธ์๋ (`app.js`, `index.html`, `style.css`).
|
| 174 |
+
* `results/ppo_pusher.zip`: 300,000 ์คํ
์์ฑํ PPO ์ ๊ฒฝ๋ง ๊ฐ์ค์น (ํ๊ท -32.4 pts).
|
| 175 |
+
* `ppo_pusher_bundle.zip`: ๊ฐ์ค์น, 12๊ฐ ์ฒดํฌํฌ์ธํธ ๋น๋์ค, ๋ถ์ ์ฐจํธ๊ฐ ํฌํจ๋ ๋จ์ผ ํ๋ก๋์
๋ฐฐํฌ ์์ถ๋ณธ.
|
| 176 |
+
* `deploy_to_hf.py`: ํ๊น
ํ์ด์ค ๋ชจ๋ธ ํ๋ธ ์ํด๋ฆญ ์๋ ๋ฐฐํฌ ์คํฌ๋ฆฝํธ.
|
| 177 |
+
* `requirements.txt` & `packages.txt`: ํ์ด์ฌ ํจํค์ง ๋ฐ OS ์์กด์ฑ ๋ช
์ธ์.
|
| 178 |
+
|
| 179 |
---
|
| 180 |
|
| 181 |
## ๐ ์คํ์์ค ๊ณต์ ๋งํฌ (Open Source Hubs)
|
|
|
|
| 187 |
|
| 188 |
## ๐ ๋ผ์ด์ ์ค
|
| 189 |
๋ณธ ํ๋ก์ ํธ๋ MIT License๋ฅผ ๋ฐ๋ฆ
๋๋ค.
|
| 190 |
+
|
| 191 |
+
---
|
| 192 |
+
|
| 193 |
+
*Trained and maintained by [hwihwalab](https://huggingface.co/hwihwalab/pusher-v5-ppo) & [Hwihwa-Lab](https://github.com/Hwihwa-Lab/pusher-v5-ppo).*
|