File size: 1,314 Bytes
eeb6475 6bdfa51 eeb6475 6bdfa51 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 | ---
library_name: stable-baselines3
tags:
- reinforcement-learning
- battleship
- ppo
- maskable-ppo
- sb3-contrib
- custom-environment
---
# Battleship PPO Agent — Hanks1234/battleship-ppo-dagger
A MaskablePPO agent trained on a 10x20 Battleship board with custom
T-shaped and Z-shaped ships using [sb3-contrib](https://sb3-contrib.readthedocs.io/).
## Environment
- **Board**: 10 columns x 20 rows
- **Ships**: 10 ships including T-shaped Battleships and Z-shaped Carriers
- **Observation**: 5-channel binary image (5, 20, 10)
- **Action**: Discrete(200) with action masking (no repeat shots)
## Training Config
| Parameter | Value |
|-----------|-------|
| `method` | `DAgger (Dataset Aggregation)` |
| `base_model` | `BC-pretrained MaskablePPO` |
| `observation_channels` | `15` |
| `board_size` | `10x20` |
| `expert` | `Monte Carlo solver (1000 samples)` |
| `disagree_only` | `True` |
| `confidence_threshold` | `0.3` |
| `freeze_cnn` | `True` |
## Evaluation Results
| Metric | Value |
|--------|-------|
| mean_shots_500_games | 100.90 |
| verified_games | 500 |
| seed | 20000 |
| notes | 15-channel DAgger; first model to break 100-shot barrier |
## Usage
```python
from training.hub import load_model_from_hub
model = load_model_from_hub("Hanks1234/battleship-ppo-dagger")
```
|