exp02_ppo_2x4: checkpoint, config, evaluation files, model card

README.md

@@ -0,0 +1,150 @@
+---
+license: mit
+library_name: stable-baselines3
+pipeline_tag: reinforcement-learning
+tags:
+- 4d-snake
+- 4d-snake-2x4
+- snake
+- reinforcement-learning
+- deep-reinforcement-learning
+- stable-baselines3
+- sb3-contrib
+- maskable-ppo
+model-index:
+- name: 4d-snake-exp02-ppo-2x4
+  results:
+  - task:
+      type: reinforcement-learning
+      name: reinforcement-learning
+    dataset:
+      name: 4d-snake-2x4
+      type: 4d-snake-2x4
+    metrics:
+    - type: completion_rate
+      name: completion rate (deterministic, 100 episodes x 3 seeds)
+      value: 0.877 +/- 0.041
+      verified: false
+    - type: mean_reward
+      name: mean episode return (deterministic)
+      value: 23.41
+      verified: false
+    - type: fill
+      name: mean final fill (deterministic)
+      value: 0.987
+      verified: false
+    - type: steps_to_complete
+      name: mean steps to complete (deterministic, won episodes)
+      value: 34.4
+      verified: false
+---
+
+# 4d-snake-exp02-ppo-2x4
+
+A `512x512` MLP policy for **4-dimensional snake on the 2^4 board** (16 cells, 8 moves): MaskablePPO trained from scratch, no curriculum, 5,000,000 environment steps. From a length-1 start it completes the board in 87.7 % of deterministic episodes, evaluated with the protocol of [docs/evaluation.md](https://github.com/BurnyCoder/4d-snake-rl/blob/main/docs/evaluation.md) (100 episodes x 3 seeds, masked `evaluate_policy`).
+
+## Results (`eval/summary.json`)
+
+| mode | completion +- std | mean fill | steps to complete | won within 4C |
+|---|---|---|---|---|
+| deterministic (argmax) | 0.877 +- 0.041 | 0.987 | 34.4 | 0.877 |
+| sampling | 0.853 +- 0.034 | 0.985 | 35.5 | 0.853 |
+
+## How to use
+
+The observation is this repository's `4*C + 2` float vector and the action space its `2*ndim` masked moves ([docs/game_rules.md](https://github.com/BurnyCoder/4d-snake-rl/blob/main/docs/game_rules.md)), so the checkpoint runs inside `snake4d`'s environment:
+
+```bash
+git clone https://github.com/BurnyCoder/4d-snake-rl.git && cd 4d-snake-rl && uv sync
+hf download BurnyCoder/4d-snake-exp02-ppo-2x4 best_model.zip --local-dir weights
+uv run snake4d evaluate --set model_path=weights/best_model.zip --set size=2 --set ndim=4
+```
+
+```python
+# https://sb3-contrib.readthedocs.io/en/master/modules/ppo_mask.html
+from sb3_contrib import MaskablePPO
+from sb3_contrib.common.maskable.utils import get_action_masks
+from snake4d.config import Config
+from snake4d.vec_env import make_env
+
+cfg = Config(size=2, ndim=4)
+model = MaskablePPO.load("weights/best_model.zip", device="cpu")
+env = make_env(cfg, 1, 0)  # one board; observation shape (1, 4*C + 2)
+obs = env.reset()
+masks = get_action_masks(env)  # the legal moves, one row per board
+action, _ = model.predict(obs, action_masks=masks, deterministic=True)
+```
+
+## Training
+
+- Phase `train`; experiment file `experiments/exp02_ppo_2x4.env`; write-up: https://github.com/BurnyCoder/4d-snake-rl/blob/main/reports/experiments/exp02_ppo_2x4.md.
+- Resolved configuration (`config.json`):
+
+```json
+{
+  "size": 2,
+  "ndim": 4,
+  "idle_mult": 4,
+  "r_food": 1.0,
+  "r_death": -1.0,
+  "r_win": 10.0,
+  "r_step": -0.001,
+  "shaping_coef": 0.0,
+  "n_envs": 1024,
+  "total_timesteps": 5000000,
+  "n_steps": 32,
+  "batch_size": 4096,
+  "n_epochs": 4,
+  "gamma": 0.99,
+  "gae_lambda": 0.95,
+  "lr_start": 0.0003,
+  "lr_end": 1e-05,
+  "clip_start": 0.2,
+  "clip_end": 0.05,
+  "ent_coef": 0.01,
+  "vf_coef": 0.5,
+  "max_grad_norm": 0.5,
+  "target_kl": 0.03,
+  "net_width": 512,
+  "device": "auto",
+  "torch_threads": 8,
+  "seed": 0,
+  "curriculum": 0,
+  "curriculum_window": 8,
+  "curriculum_delta": 0,
+  "curriculum_rho": 0.2,
+  "curriculum_min_eps": 200,
+  "p_true_start": 0.2,
+  "eval_episodes": 100,
+  "eval_every": 327680,
+  "ckpt_every": 1310720,
+  "eval_seeds": "0,1,2",
+  "bench_steps": 200000,
+  "runs_dir": "runs",
+  "run_name": "exp02_ppo_2x4",
+  "model_path": "",
+  "policy": "route"
+}
+```
+
+![exp02_ppo_2x4_curves.png](figures/exp02_ppo_2x4_curves.png)
+
+![exp02_ppo_2x4_fill_hist.png](figures/exp02_ppo_2x4_fill_hist.png)
+
+## Provenance
+
+- Code: https://github.com/BurnyCoder/4d-snake-rl at commit `212b78092dfcae4aa3947fb1106e7c65cc969c7c`.
+- Library versions (`versions.json`): torch 2.14.0+cu130, gymnasium 1.3.0, stable-baselines3 2.9.0, sb3-contrib 2.9.0, numpy 2.5.2, pygame-ce 2.5.8, cuda_device NVIDIA GeForce RTX 5070 Laptop GPU.
+- `eval/summary.json` and `eval/eval_episodes.csv` are the files the repository's reports quote; every evaluated network is compared in [reports/networks.md](https://github.com/BurnyCoder/4d-snake-rl/blob/main/reports/networks.md).
+- Collection: https://huggingface.co/collections/BurnyCoder/4d-snake-rl-all-evaluated-networks-6a9d0a0a66c7efcd101b7741
+
+## Files
+
+- `best_model.zip`: the evaluated checkpoint in Stable-Baselines3's save format (policy weights and optimizer state, https://stable-baselines3.readthedocs.io/en/master/guide/save_format.html).
+- `config.json`, `versions.json`: the run's resolved configuration and environment.
+- `eval/`: evaluation summary and one row per evaluation episode.
+- `train/progress.csv`: the SB3 training log; `figures/`: the learning curves.
+
+## Licence
+
+MIT, like the repository.

best_model.zip

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:57a4b48ac450f0947c6af1a1b4b5218c1e82c19a695fa58c635b89cd174facbc
+size 7582971

config.json

@@ -0,0 +1,44 @@
+{
+  "size": 2,
+  "ndim": 4,
+  "idle_mult": 4,
+  "r_food": 1.0,
+  "r_death": -1.0,
+  "r_win": 10.0,
+  "r_step": -0.001,
+  "shaping_coef": 0.0,
+  "n_envs": 1024,
+  "total_timesteps": 5000000,
+  "n_steps": 32,
+  "batch_size": 4096,
+  "n_epochs": 4,
+  "gamma": 0.99,
+  "gae_lambda": 0.95,
+  "lr_start": 0.0003,
+  "lr_end": 1e-05,
+  "clip_start": 0.2,
+  "clip_end": 0.05,
+  "ent_coef": 0.01,
+  "vf_coef": 0.5,
+  "max_grad_norm": 0.5,
+  "target_kl": 0.03,
+  "net_width": 512,
+  "device": "auto",
+  "torch_threads": 8,
+  "seed": 0,
+  "curriculum": 0,
+  "curriculum_window": 8,
+  "curriculum_delta": 0,
+  "curriculum_rho": 0.2,
+  "curriculum_min_eps": 200,
+  "p_true_start": 0.2,
+  "eval_episodes": 100,
+  "eval_every": 327680,
+  "ckpt_every": 1310720,
+  "eval_seeds": "0,1,2",
+  "bench_steps": 200000,
+  "runs_dir": "runs",
+  "run_name": "exp02_ppo_2x4",
+  "model_path": "",
+  "policy": "route"
+}

eval/eval_episodes.csv

@@ -0,0 +1,601 @@
+seed,deterministic,success,fill,length,return
+0,1,1,1.0,22,24.97899627685547
+0,1,1,1.0,26,24.974994659423828
+0,1,0,0.75,27,9.973998069763184
+0,1,1,1.0,27,24.973997116088867
+0,1,1,1.0,28,24.97299575805664
+0,1,1,1.0,29,24.971996307373047
+0,1,0,0.875,29,11.97199821472168
+0,1,1,1.0,29,24.971996307373047
+0,1,1,1.0,29,24.971996307373047
+0,1,1,1.0,30,24.970996856689453
+0,1,1,1.0,30,24.970996856689453
+0,1,1,1.0,30,24.970996856689453
+0,1,1,1.0,31,24.96999740600586
+0,1,1,1.0,31,24.969993591308594
+0,1,1,1.0,31,24.969993591308594
+0,1,1,1.0,31,24.96999740600586
+0,1,1,1.0,31,24.96999740600586
+0,1,1,1.0,31,24.96999740600586
+0,1,1,1.0,31,24.96999740600586
+0,1,1,1.0,31,24.96999740600586
+0,1,1,1.0,31,24.96999740600586
+0,1,1,1.0,31,24.96999740600586
+0,1,1,1.0,31,24.96999740600586
+0,1,1,1.0,31,24.96999740600586
+0,1,1,1.0,32,24.968997955322266
+0,1,1,1.0,32,24.968996047973633
+0,1,0,0.9375,32,12.968997955322266
+0,1,1,1.0,32,24.968996047973633
+0,1,1,1.0,32,24.968996047973633
+0,1,1,1.0,32,24.968997955322266
+0,1,1,1.0,33,24.96799659729004
+0,1,1,1.0,33,24.967998504638672
+0,1,1,1.0,33,24.967998504638672
+0,1,1,1.0,33,24.96799659729004
+0,1,1,1.0,33,24.96799659729004
+0,1,1,1.0,33,24.96799659729004
+0,1,1,1.0,33,24.967998504638672
+0,1,1,1.0,33,24.967994689941406
+0,1,1,1.0,33,24.967998504638672
+0,1,1,1.0,33,24.967998504638672
+0,1,1,1.0,33,24.967994689941406
+0,1,1,1.0,33,24.967994689941406
+0,1,1,1.0,33,24.967994689941406
+0,1,1,1.0,34,24.966997146606445
+0,1,1,1.0,34,24.966997146606445
+0,1,1,1.0,34,24.966995239257812
+0,1,1,1.0,34,24.966995239257812
+0,1,1,1.0,34,24.966997146606445
+0,1,1,1.0,35,24.96599578857422
+0,1,1,1.0,35,24.965993881225586
+0,1,1,1.0,35,24.96599578857422
+0,1,1,1.0,35,24.96599578857422
+0,1,0,0.9375,35,12.965997695922852
+0,1,1,1.0,35,24.96599578857422
+0,1,1,1.0,35,24.96599769592285
+0,1,1,1.0,35,24.96599578857422
+0,1,1,1.0,35,24.96599578857422
+0,1,1,1.0,35,24.96599578857422
+0,1,1,1.0,35,24.96599578857422
+0,1,1,1.0,35,24.96599578857422
+0,1,1,1.0,35,24.96599769592285
+0,1,1,1.0,35,24.96599578857422
+0,1,1,1.0,36,24.964996337890625
+0,1,1,1.0,36,24.964996337890625
+0,1,1,1.0,36,24.964996337890625
+0,1,1,1.0,36,24.964996337890625
+0,1,1,1.0,36,24.964996337890625
+0,1,1,1.0,36,24.964994430541992
+0,1,1,1.0,36,24.964996337890625
+0,1,1,1.0,36,24.964996337890625
+0,1,1,1.0,36,24.964996337890625
+0,1,0,0.9375,36,12.964995384216309
+0,1,1,1.0,36,24.964996337890625
+0,1,1,1.0,36,24.964994430541992
+0,1,1,1.0,36,24.964996337890625
+0,1,1,1.0,37,24.96399688720703
+0,1,1,1.0,37,24.96399688720703
+0,1,1,1.0,37,24.96399688720703
+0,1,0,0.9375,37,12.963994979858398
+0,1,1,1.0,37,24.96399688720703
+0,1,1,1.0,37,24.96399688720703
+0,1,1,1.0,37,24.96399688720703
+0,1,1,1.0,37,24.96399688720703
+0,1,1,1.0,37,24.9639949798584
+0,1,0,0.9375,37,12.963995933532715
+0,1,1,1.0,38,24.962995529174805
+0,1,1,1.0,38,24.962997436523438
+0,1,1,1.0,38,24.962995529174805
+0,1,1,1.0,38,24.96299171447754
+0,1,1,1.0,39,24.961994171142578
+0,1,1,1.0,39,24.96199607849121
+0,1,1,1.0,39,24.96199607849121
+0,1,1,1.0,39,24.961994171142578
+0,1,1,1.0,40,24.960994720458984
+0,1,1,1.0,40,24.960994720458984
+0,1,1,1.0,40,24.96099853515625
+0,1,1,1.0,41,24.95999526977539
+0,1,1,1.0,42,24.958995819091797
+0,1,1,1.0,43,24.95799446105957
+0,1,1,1.0,43,24.957992553710938
+1,1,1,1.0,24,24.97699546813965
+1,1,0,0.875,25,11.975997924804688
+1,1,0,0.9375,25,12.975996971130371
+1,1,1,1.0,25,24.975997924804688
+1,1,1,1.0,27,24.973997116088867
+1,1,0,0.75,27,9.9739990234375
+1,1,0,0.8125,27,10.97399616241455
+1,1,1,1.0,27,24.973997116088867
+1,1,0,0.9375,27,12.973997116088867
+1,1,1,1.0,28,24.97299575805664
+1,1,1,1.0,28,24.972999572753906
+1,1,1,1.0,28,24.972997665405273
+1,1,1,1.0,28,24.972997665405273
+1,1,1,1.0,28,24.97299575805664
+1,1,1,1.0,28,24.97299575805664
+1,1,1,1.0,29,24.971996307373047
+1,1,1,1.0,29,24.97199821472168
+1,1,1,1.0,29,24.971996307373047
+1,1,1,1.0,29,24.971996307373047
+1,1,1,1.0,30,24.970996856689453
+1,1,1,1.0,30,24.970996856689453
+1,1,1,1.0,30,24.970996856689453
+1,1,1,1.0,30,24.970996856689453
+1,1,1,1.0,30,24.970996856689453
+1,1,0,0.875,30,11.970995903015137
+1,1,1,1.0,30,24.97099494934082
+1,1,1,1.0,31,24.969995498657227
+1,1,1,1.0,31,24.96999740600586
+1,1,0,0.9375,31,12.96999740600586
+1,1,1,1.0,31,24.96999740600586
+1,1,0,0.875,31,11.969998359680176
+1,1,1,1.0,31,24.96999740600586
+1,1,1,1.0,31,24.96999740600586
+1,1,1,1.0,31,24.96999740600586
+1,1,1,1.0,31,24.969995498657227
+1,1,1,1.0,31,24.96999740600586
+1,1,1,1.0,32,24.968997955322266
+1,1,1,1.0,32,24.968996047973633
+1,1,1,1.0,33,24.967998504638672
+1,1,1,1.0,33,24.967994689941406
+1,1,1,1.0,33,24.96799659729004
+1,1,1,1.0,33,24.96799659729004
+1,1,1,1.0,33,24.967998504638672
+1,1,0,0.9375,33,12.967996597290039
+1,1,1,1.0,33,24.967994689941406
+1,1,1,1.0,33,24.967998504638672
+1,1,0,0.9375,33,12.967997550964355
+1,1,1,1.0,34,24.966997146606445
+1,1,1,1.0,34,24.966995239257812
+1,1,1,1.0,34,24.966995239257812
+1,1,1,1.0,34,24.966999053955078
+1,1,1,1.0,34,24.966997146606445
+1,1,1,1.0,34,24.966997146606445
+1,1,1,1.0,34,24.966995239257812
+1,1,1,1.0,34,24.966995239257812
+1,1,1,1.0,35,24.96599578857422
+1,1,1,1.0,35,24.96599769592285
+1,1,1,1.0,35,24.96599578857422
+1,1,1,1.0,35,24.96599578857422
+1,1,0,0.9375,35,12.965994834899902
+1,1,1,1.0,35,24.96599578857422
+1,1,1,1.0,35,24.96599578857422
+1,1,1,1.0,36,24.964996337890625
+1,1,1,1.0,36,24.964996337890625
+1,1,0,0.9375,36,12.964993476867676
+1,1,1,1.0,36,24.964996337890625
+1,1,1,1.0,36,24.964996337890625
+1,1,1,1.0,37,24.9639949798584
+1,1,1,1.0,37,24.96399688720703
+1,1,1,1.0,37,24.963993072509766
+1,1,1,1.0,37,24.96399688720703
+1,1,1,1.0,37,24.96399688720703
+1,1,1,1.0,37,24.96399688720703
+1,1,1,1.0,37,24.9639949798584
+1,1,1,1.0,38,24.962995529174805
+1,1,1,1.0,38,24.962995529174805
+1,1,1,1.0,38,24.962995529174805
+1,1,0,0.9375,38,12.962997436523438
+1,1,1,1.0,38,24.962995529174805
+1,1,1,1.0,39,24.961997985839844
+1,1,1,1.0,39,24.961997985839844
+1,1,1,1.0,39,24.961994171142578
+1,1,1,1.0,40,24.960994720458984
+1,1,1,1.0,40,24.960994720458984
+1,1,0,0.9375,40,12.960993766784668
+1,1,1,1.0,40,24.960996627807617
+1,1,1,1.0,40,24.960996627807617
+1,1,1,1.0,42,24.958995819091797
+1,1,1,1.0,42,24.958995819091797
+1,1,1,1.0,42,24.958995819091797
+1,1,1,1.0,42,24.958995819091797
+1,1,0,0.9375,42,12.958996772766113
+1,1,0,0.9375,43,12.957996368408203
+1,1,1,1.0,43,24.95799446105957
+1,1,1,1.0,43,24.957996368408203
+1,1,1,1.0,44,24.956995010375977
+1,1,1,1.0,45,24.95599365234375
+1,1,1,1.0,46,24.954994201660156
+1,1,0,0.9375,46,12.954996109008789
+1,1,1,1.0,46,24.95499610900879
+2,1,0,0.6875,22,8.979000091552734
+2,1,1,1.0,24,24.97699737548828
+2,1,0,0.875,24,11.976998329162598
+2,1,1,1.0,25,24.975997924804688
+2,1,1,1.0,25,24.975997924804688
+2,1,1,1.0,26,24.974998474121094
+2,1,1,1.0,28,24.97299575805664
+2,1,1,1.0,28,24.972997665405273
+2,1,0,0.9375,28,12.972997665405273
+2,1,1,1.0,28,24.972997665405273
+2,1,1,1.0,28,24.97299575805664
+2,1,1,1.0,29,24.971996307373047
+2,1,1,1.0,29,24.971996307373047
+2,1,1,1.0,29,24.971996307373047
+2,1,0,0.9375,29,12.97199821472168
+2,1,1,1.0,29,24.971996307373047
+2,1,1,1.0,29,24.971996307373047
+2,1,1,1.0,29,24.971996307373047
+2,1,1,1.0,29,24.97199821472168
+2,1,0,0.9375,29,12.971997261047363
+2,1,1,1.0,30,24.970996856689453
+2,1,1,1.0,30,24.97099494934082
+2,1,1,1.0,30,24.970996856689453
+2,1,1,1.0,30,24.970996856689453
+2,1,1,1.0,31,24.96999740600586
+2,1,1,1.0,31,24.96999740600586
+2,1,1,1.0,31,24.96999740600586
+2,1,1,1.0,31,24.969995498657227
+2,1,0,0.9375,31,12.969996452331543
+2,1,1,1.0,31,24.96999740600586
+2,1,0,0.875,31,11.969996452331543
+2,1,1,1.0,32,24.968997955322266
+2,1,0,0.8125,32,10.96899700164795
+2,1,1,1.0,32,24.968997955322266
+2,1,1,1.0,32,24.968996047973633
+2,1,1,1.0,32,24.968996047973633
+2,1,1,1.0,32,24.968996047973633
+2,1,1,1.0,32,24.968996047973633
+2,1,1,1.0,32,24.968997955322266
+2,1,1,1.0,32,24.968997955322266
+2,1,1,1.0,32,24.968997955322266
+2,1,1,1.0,33,24.967998504638672
+2,1,1,1.0,33,24.96799659729004
+2,1,1,1.0,33,24.96799659729004
+2,1,1,1.0,33,24.967994689941406
+2,1,1,1.0,33,24.967998504638672
+2,1,1,1.0,33,24.96799659729004
+2,1,1,1.0,33,24.967998504638672
+2,1,1,1.0,33,24.967998504638672
+2,1,1,1.0,34,24.966997146606445
+2,1,1,1.0,34,24.966995239257812
+2,1,0,0.875,34,11.966998100280762
+2,1,1,1.0,34,24.966995239257812
+2,1,1,1.0,34,24.966995239257812
+2,1,1,1.0,35,24.96599578857422
+2,1,0,0.875,35,11.965997695922852
+2,1,1,1.0,35,24.96599578857422
+2,1,1,1.0,35,24.96599769592285
+2,1,1,1.0,35,24.96599578857422
+2,1,1,1.0,35,24.965993881225586
+2,1,1,1.0,35,24.96599769592285
+2,1,1,1.0,36,24.964996337890625
+2,1,0,0.9375,36,12.964999198913574
+2,1,1,1.0,36,24.964996337890625
+2,1,1,1.0,36,24.964996337890625
+2,1,1,1.0,36,24.964996337890625
+2,1,1,1.0,37,24.96399688720703
+2,1,1,1.0,37,24.96399688720703
+2,1,1,1.0,37,24.96399688720703
+2,1,1,1.0,37,24.96399688720703
+2,1,1,1.0,37,24.96399688720703
+2,1,1,1.0,37,24.96399688720703
+2,1,1,1.0,37,24.96399688720703
+2,1,1,1.0,38,24.962993621826172
+2,1,1,1.0,38,24.962997436523438
+2,1,1,1.0,38,24.962993621826172
+2,1,1,1.0,38,24.962997436523438
+2,1,1,1.0,38,24.962997436523438
+2,1,1,1.0,39,24.96199607849121
+2,1,1,1.0,39,24.961997985839844
+2,1,1,1.0,39,24.961994171142578
+2,1,1,1.0,39,24.961994171142578
+2,1,1,1.0,39,24.961994171142578
+2,1,1,1.0,40,24.960994720458984
+2,1,0,0.8125,40,10.960996627807617
+2,1,1,1.0,40,24.960994720458984
+2,1,1,1.0,40,24.96099281311035
+2,1,1,1.0,40,24.96099853515625
+2,1,1,1.0,40,24.96099853515625
+2,1,1,1.0,41,24.95999526977539
+2,1,1,1.0,41,24.959997177124023
+2,1,1,1.0,41,24.959993362426758
+2,1,1,1.0,41,24.95999526977539
+2,1,1,1.0,42,24.958995819091797
+2,1,1,1.0,42,24.958995819091797
+2,1,0,0.9375,43,12.957995414733887
+2,1,1,1.0,44,24.956995010375977
+2,1,1,1.0,45,24.95599365234375
+2,1,1,1.0,45,24.95599365234375
+2,1,1,1.0,45,24.955997467041016
+0,0,0,0.875,23,11.977997779846191
+0,0,1,1.0,25,24.975997924804688
+0,0,1,1.0,26,24.97499656677246
+0,0,1,1.0,26,24.97499656677246
+0,0,0,0.8125,26,10.974998474121094
+0,0,1,1.0,27,24.9739990234375
+0,0,1,1.0,28,24.97299575805664
+0,0,1,1.0,28,24.97299575805664
+0,0,0,0.875,28,11.97299861907959
+0,0,0,0.75,29,9.971999168395996
+0,0,1,1.0,29,24.97199821472168
+0,0,0,0.875,30,11.970995903015137
+0,0,0,0.9375,30,12.97099494934082
+0,0,0,0.9375,30,12.97099781036377
+0,0,1,1.0,30,24.970996856689453
+0,0,1,1.0,30,24.970996856689453
+0,0,1,1.0,31,24.96999740600586
+0,0,1,1.0,31,24.96999740600586
+0,0,1,1.0,31,24.96999740600586
+0,0,1,1.0,31,24.96999740600586
+0,0,1,1.0,31,24.96999740600586
+0,0,1,1.0,31,24.969995498657227
+0,0,1,1.0,31,24.96999740600586
+0,0,1,1.0,31,24.969995498657227
+0,0,0,0.8125,32,10.96899700164795
+0,0,1,1.0,32,24.968997955322266
+0,0,1,1.0,32,24.968996047973633
+0,0,1,1.0,32,24.968997955322266
+0,0,1,1.0,32,24.968997955322266
+0,0,1,1.0,33,24.96799659729004
+0,0,1,1.0,33,24.967998504638672
+0,0,1,1.0,33,24.96799659729004
+0,0,1,1.0,33,24.967994689941406
+0,0,0,0.9375,33,12.967996597290039
+0,0,1,1.0,33,24.967998504638672
+0,0,1,1.0,33,24.967994689941406
+0,0,1,1.0,33,24.967994689941406
+0,0,1,1.0,33,24.967994689941406
+0,0,1,1.0,34,24.966997146606445
+0,0,1,1.0,34,24.966995239257812
+0,0,1,1.0,34,24.966995239257812
+0,0,1,1.0,34,24.966995239257812
+0,0,0,0.9375,34,12.966997146606445
+0,0,1,1.0,34,24.966997146606445
+0,0,1,1.0,34,24.966995239257812
+0,0,1,1.0,34,24.966995239257812
+0,0,1,1.0,34,24.966995239257812
+0,0,0,0.8125,34,10.966999053955078
+0,0,1,1.0,34,24.966997146606445
+0,0,0,0.9375,34,12.966995239257812
+0,0,1,1.0,34,24.966995239257812
+0,0,1,1.0,34,24.966999053955078
+0,0,1,1.0,35,24.96599578857422
+0,0,1,1.0,35,24.96599578857422
+0,0,1,1.0,36,24.964996337890625
+0,0,1,1.0,36,24.964996337890625
+0,0,1,1.0,36,24.964996337890625
+0,0,0,0.9375,36,12.964994430541992
+0,0,0,0.9375,36,12.964995384216309
+0,0,1,1.0,36,24.964996337890625
+0,0,1,1.0,36,24.96500015258789
+0,0,1,1.0,36,24.964994430541992
+0,0,1,1.0,36,24.964996337890625
+0,0,1,1.0,36,24.964996337890625
+0,0,0,0.9375,36,12.964998245239258
+0,0,1,1.0,37,24.96399688720703
+0,0,1,1.0,37,24.96399688720703
+0,0,1,1.0,37,24.9639949798584
+0,0,1,1.0,37,24.96399688720703
+0,0,1,1.0,37,24.96399688720703
+0,0,1,1.0,37,24.963993072509766
+0,0,1,1.0,37,24.9639949798584
+0,0,1,1.0,37,24.96399688720703
+0,0,1,1.0,38,24.962993621826172
+0,0,1,1.0,38,24.962997436523438
+0,0,1,1.0,38,24.962993621826172
+0,0,1,1.0,38,24.962995529174805
+0,0,1,1.0,38,24.962997436523438
+0,0,1,1.0,38,24.962997436523438
+0,0,0,0.9375,39,12.961996078491211
+0,0,1,1.0,39,24.96199607849121
+0,0,1,1.0,39,24.961994171142578
+0,0,1,1.0,39,24.961997985839844
+0,0,1,1.0,40,24.960994720458984
+0,0,1,1.0,40,24.960996627807617
+0,0,1,1.0,40,24.960994720458984
+0,0,1,1.0,41,24.959997177124023
+0,0,1,1.0,41,24.95999526977539
+0,0,1,1.0,41,24.95999526977539
+0,0,1,1.0,41,24.95999526977539
+0,0,1,1.0,41,24.95999526977539
+0,0,1,1.0,41,24.95999526977539
+0,0,1,1.0,43,24.957992553710938
+0,0,1,1.0,43,24.957996368408203
+0,0,1,1.0,44,24.95699691772461
+0,0,1,1.0,45,24.95599365234375
+0,0,1,1.0,46,24.95499610900879
+0,0,1,1.0,48,24.95299530029297
+0,0,1,1.0,49,24.951995849609375
+0,0,1,1.0,54,24.94699478149414
+1,0,1,1.0,25,24.975997924804688
+1,0,1,1.0,25,24.975997924804688
+1,0,1,1.0,25,24.975997924804688
+1,0,1,1.0,27,24.973997116088867
+1,0,1,1.0,27,24.9739990234375
+1,0,1,1.0,27,24.9739990234375
+1,0,1,1.0,27,24.973995208740234
+1,0,1,1.0,28,24.97299575805664
+1,0,1,1.0,28,24.97299575805664
+1,0,1,1.0,28,24.972999572753906
+1,0,1,1.0,29,24.971996307373047
+1,0,1,1.0,30,24.970996856689453
+1,0,1,1.0,30,24.970996856689453
+1,0,1,1.0,30,24.970996856689453
+1,0,1,1.0,30,24.970996856689453
+1,0,1,1.0,31,24.96999740600586
+1,0,1,1.0,31,24.96999740600586
+1,0,1,1.0,31,24.969993591308594
+1,0,1,1.0,31,24.96999740600586
+1,0,1,1.0,32,24.968997955322266
+1,0,1,1.0,32,24.968996047973633
+1,0,1,1.0,32,24.968997955322266
+1,0,1,1.0,32,24.968997955322266
+1,0,1,1.0,32,24.968997955322266
+1,0,1,1.0,32,24.968997955322266
+1,0,1,1.0,32,24.968994140625
+1,0,1,1.0,33,24.967994689941406
+1,0,1,1.0,33,24.96799659729004
+1,0,1,1.0,33,24.967994689941406
+1,0,1,1.0,33,24.967998504638672
+1,0,1,1.0,33,24.967994689941406
+1,0,1,1.0,34,24.966997146606445
+1,0,1,1.0,34,24.966995239257812
+1,0,1,1.0,34,24.966995239257812
+1,0,1,1.0,34,24.966997146606445
+1,0,1,1.0,34,24.966995239257812
+1,0,1,1.0,34,24.966999053955078
+1,0,1,1.0,34,24.966995239257812
+1,0,1,1.0,34,24.966995239257812
+1,0,1,1.0,34,24.966999053955078
+1,0,1,1.0,34,24.966995239257812
+1,0,1,1.0,35,24.96599578857422
+1,0,1,1.0,35,24.96599578857422
+1,0,1,1.0,35,24.96599578857422
+1,0,1,1.0,35,24.96599578857422
+1,0,1,1.0,35,24.96599578857422
+1,0,1,1.0,35,24.96599578857422
+1,0,1,1.0,35,24.96599578857422
+1,0,1,1.0,35,24.96599578857422
+1,0,1,1.0,35,24.96599769592285
+1,0,1,1.0,35,24.96599578857422
+1,0,1,1.0,35,24.965991973876953
+1,0,1,1.0,35,24.96599578857422
+1,0,1,1.0,35,24.96599769592285
+1,0,0,0.9375,35,12.965996742248535
+1,0,1,1.0,35,24.96599578857422
+1,0,1,1.0,36,24.964996337890625
+1,0,1,1.0,36,24.964998245239258
+1,0,1,1.0,36,24.964996337890625
+1,0,1,1.0,36,24.964996337890625
+1,0,1,1.0,36,24.964996337890625
+1,0,1,1.0,36,24.964996337890625
+1,0,1,1.0,36,24.964996337890625
+1,0,1,1.0,36,24.964996337890625
+1,0,1,1.0,37,24.96399688720703
+1,0,0,0.9375,37,12.963996887207031
+1,0,0,0.9375,37,12.963995933532715
+1,0,1,1.0,37,24.96399688720703
+1,0,0,0.9375,37,12.963996887207031
+1,0,1,1.0,37,24.96399688720703
+1,0,1,1.0,37,24.96399688720703
+1,0,0,0.9375,38,12.962995529174805
+1,0,1,1.0,38,24.962995529174805
+1,0,1,1.0,38,24.962997436523438
+1,0,0,0.875,38,11.962995529174805
+1,0,1,1.0,39,24.961994171142578
+1,0,1,1.0,39,24.961997985839844
+1,0,1,1.0,39,24.961994171142578
+1,0,1,1.0,39,24.961994171142578
+1,0,1,1.0,39,24.961997985839844
+1,0,0,0.9375,40,12.960997581481934
+1,0,1,1.0,40,24.960996627807617
+1,0,1,1.0,40,24.960994720458984
+1,0,1,1.0,40,24.96099853515625
+1,0,1,1.0,41,24.959997177124023
+1,0,1,1.0,41,24.95999526977539
+1,0,1,1.0,41,24.95999526977539
+1,0,1,1.0,42,24.95899772644043
+1,0,1,1.0,43,24.957992553710938
+1,0,1,1.0,43,24.957998275756836
+1,0,1,1.0,43,24.95799446105957
+1,0,1,1.0,43,24.957992553710938
+1,0,1,1.0,44,24.95699691772461
+1,0,0,0.9375,44,12.95699405670166
+1,0,1,1.0,44,24.956995010375977
+1,0,1,1.0,44,24.95699691772461
+1,0,0,0.9375,45,12.9559965133667
+1,0,1,1.0,45,24.95599365234375
+1,0,1,1.0,46,24.95499610900879
+1,0,0,0.9375,48,12.952998161315918
+2,0,0,0.8125,23,10.977998733520508
+2,0,1,1.0,27,24.973995208740234
+2,0,1,1.0,27,24.973995208740234
+2,0,1,1.0,27,24.973997116088867
+2,0,1,1.0,28,24.97299575805664
+2,0,1,1.0,28,24.97299575805664
+2,0,0,0.75,28,9.97299861907959
+2,0,0,0.9375,28,12.972996711730957
+2,0,1,1.0,29,24.971996307373047
+2,0,1,1.0,29,24.971996307373047
+2,0,1,1.0,29,24.971996307373047
+2,0,0,0.9375,29,12.97199821472168
+2,0,1,1.0,29,24.97199821472168
+2,0,1,1.0,29,24.971994400024414
+2,0,1,1.0,30,24.970996856689453
+2,0,1,1.0,30,24.970996856689453
+2,0,0,0.9375,30,12.970996856689453
+2,0,1,1.0,30,24.970996856689453
+2,0,1,1.0,30,24.970996856689453
+2,0,1,1.0,30,24.970996856689453
+2,0,1,1.0,30,24.970996856689453
+2,0,1,1.0,30,24.970996856689453
+2,0,1,1.0,30,24.970996856689453
+2,0,1,1.0,31,24.96999740600586
+2,0,1,1.0,31,24.96999740600586
+2,0,0,0.875,31,11.96999740600586
+2,0,1,1.0,31,24.96999740600586
+2,0,1,1.0,32,24.968996047973633
+2,0,1,1.0,32,24.968997955322266
+2,0,1,1.0,32,24.968996047973633
+2,0,1,1.0,32,24.968997955322266
+2,0,1,1.0,32,24.968996047973633
+2,0,1,1.0,33,24.967994689941406
+2,0,0,0.6875,33,8.967999458312988
+2,0,0,0.9375,33,12.967997550964355
+2,0,1,1.0,33,24.967994689941406
+2,0,0,0.6875,33,8.968000411987305
+2,0,1,1.0,33,24.967998504638672
+2,0,1,1.0,33,24.967994689941406
+2,0,1,1.0,33,24.967998504638672
+2,0,1,1.0,34,24.966999053955078
+2,0,1,1.0,34,24.966997146606445
+2,0,1,1.0,34,24.966997146606445
+2,0,1,1.0,34,24.966995239257812
+2,0,0,0.9375,34,12.966996192932129
+2,0,1,1.0,34,24.966997146606445
+2,0,1,1.0,35,24.965993881225586
+2,0,0,0.9375,35,12.965996742248535
+2,0,0,0.9375,36,12.964995384216309
+2,0,1,1.0,36,24.964996337890625
+2,0,1,1.0,36,24.964996337890625
+2,0,1,1.0,36,24.96499252319336
+2,0,1,1.0,36,24.964996337890625
+2,0,1,1.0,36,24.964996337890625
+2,0,1,1.0,36,24.964996337890625
+2,0,1,1.0,36,24.964996337890625
+2,0,1,1.0,36,24.964996337890625
+2,0,1,1.0,37,24.96399688720703
+2,0,1,1.0,37,24.96399688720703
+2,0,0,0.9375,37,12.963996887207031
+2,0,1,1.0,37,24.96399688720703
+2,0,1,1.0,37,24.9639949798584
+2,0,1,1.0,37,24.96399688720703
+2,0,1,1.0,37,24.96399688720703
+2,0,1,1.0,38,24.962997436523438
+2,0,1,1.0,38,24.962993621826172
+2,0,1,1.0,38,24.962995529174805
+2,0,1,1.0,38,24.962993621826172
+2,0,1,1.0,38,24.962997436523438
+2,0,1,1.0,39,24.961994171142578
+2,0,1,1.0,39,24.96199607849121
+2,0,1,1.0,39,24.961997985839844
+2,0,1,1.0,39,24.961994171142578
+2,0,1,1.0,39,24.96199607849121
+2,0,1,1.0,39,24.961994171142578
+2,0,0,0.9375,40,12.960997581481934
+2,0,0,0.9375,40,12.960994720458984
+2,0,1,1.0,40,24.96099853515625
+2,0,0,0.9375,40,12.9609956741333
+2,0,1,1.0,40,24.960994720458984
+2,0,1,1.0,40,24.960996627807617
+2,0,1,1.0,40,24.960994720458984
+2,0,1,1.0,40,24.960994720458984
+2,0,0,0.875,41,11.959994316101074
+2,0,1,1.0,41,24.959993362426758
+2,0,1,1.0,42,24.958995819091797
+2,0,1,1.0,42,24.958995819091797
+2,0,1,1.0,42,24.958995819091797
+2,0,1,1.0,43,24.957996368408203
+2,0,1,1.0,43,24.95799446105957
+2,0,1,1.0,43,24.957996368408203
+2,0,1,1.0,43,24.957996368408203
+2,0,1,1.0,43,24.957996368408203
+2,0,0,0.9375,44,12.956995964050293
+2,0,1,1.0,44,24.95699691772461
+2,0,1,1.0,44,24.956995010375977
+2,0,1,1.0,45,24.955995559692383
+2,0,1,1.0,46,24.95499610900879
+2,0,1,1.0,47,24.953994750976562
+2,0,1,1.0,49,24.951993942260742

eval/summary.json

@@ -0,0 +1,129 @@
+{
+  "board": "2^4",
+  "n_cells": 16,
+  "seeds": [
+    0,
+    1,
+    2
+  ],
+  "per_run": {
+    "deterministic=True/seed=0": {
+      "episodes": 100,
+      "success_rate": 0.93,
+      "fill_mean": 0.993125,
+      "return_mean": 24.086756258010865,
+      "length_mean": 34.24,
+      "steps_to_complete_mean": 34.31182795698925,
+      "win_within": {
+        "C": 0.0,
+        "2C": 0.27,
+        "4C": 0.93,
+        "C2/2": 0.93
+      }
+    },
+    "deterministic=True/seed=1": {
+      "episodes": 100,
+      "success_rate": 0.83,
+      "fill_mean": 0.984375,
+      "return_mean": 22.84671637535095,
+      "length_mean": 34.28,
+      "steps_to_complete_mean": 34.44578313253012,
+      "win_within": {
+        "C": 0.0,
+        "2C": 0.3,
+        "4C": 0.83,
+        "C2/2": 0.83
+      }
+    },
+    "deterministic=True/seed=2": {
+      "episodes": 100,
+      "success_rate": 0.87,
+      "fill_mean": 0.984375,
+      "return_mean": 23.286826572418214,
+      "length_mean": 34.17,
+      "steps_to_complete_mean": 34.51724137931034,
+      "win_within": {
+        "C": 0.0,
+        "2C": 0.33,
+        "4C": 0.87,
+        "C2/2": 0.87
+      }
+    },
+    "deterministic=False/seed=0": {
+      "episodes": 100,
+      "success_rate": 0.84,
+      "fill_mean": 0.9825,
+      "return_mean": 22.925896329879762,
+      "length_mean": 35.1,
+      "steps_to_complete_mean": 35.714285714285715,
+      "win_within": {
+        "C": 0.0,
+        "2C": 0.21,
+        "4C": 0.84,
+        "C2/2": 0.84
+      }
+    },
+    "deterministic=False/seed=1": {
+      "episodes": 100,
+      "success_rate": 0.9,
+      "fill_mean": 0.993125,
+      "return_mean": 23.75554636001587,
+      "length_mean": 35.45,
+      "steps_to_complete_mean": 34.955555555555556,
+      "win_within": {
+        "C": 0.0,
+        "2C": 0.26,
+        "4C": 0.9,
+        "C2/2": 0.9
+      }
+    },
+    "deterministic=False/seed=2": {
+      "episodes": 100,
+      "success_rate": 0.82,
+      "fill_mean": 0.979375,
+      "return_mean": 22.65548628807068,
+      "length_mean": 35.51,
+      "steps_to_complete_mean": 35.80487804878049,
+      "win_within": {
+        "C": 0.0,
+        "2C": 0.26,
+        "4C": 0.82,
+        "C2/2": 0.82
+      }
+    }
+  },
+  "modes": {
+    "deterministic=True": {
+      "success_rate_mean": 0.8766666666666666,
+      "success_rate_std": 0.04109609335312654,
+      "episodes": 300,
+      "success_rate": 0.8766666666666667,
+      "fill_mean": 0.9872916666666667,
+      "return_mean": 23.406766401926678,
+      "length_mean": 34.23,
+      "steps_to_complete_mean": 34.42205323193917,
+      "win_within": {
+        "C": 0.0,
+        "2C": 0.3,
+        "4C": 0.8766666666666667,
+        "C2/2": 0.8766666666666667
+      }
+    },
+    "deterministic=False": {
+      "success_rate_mean": 0.8533333333333334,
+      "success_rate_std": 0.033993463423951924,
+      "episodes": 300,
+      "success_rate": 0.8533333333333334,
+      "fill_mean": 0.985,
+      "return_mean": 23.112309659322104,
+      "length_mean": 35.35333333333333,
+      "steps_to_complete_mean": 35.4765625,
+      "win_within": {
+        "C": 0.0,
+        "2C": 0.24333333333333335,
+        "4C": 0.8533333333333334,
+        "C2/2": 0.8533333333333334
+      }
+    }
+  }
+}

train/progress.csv

@@ -0,0 +1,169 @@
+time/fps,time/total_timesteps,time/time_elapsed,rollout/episodes,time/iterations,train/entropy_loss,train/policy_gradient_loss,train/learning_rate,rollout/win_rate_true_start,train/value_loss,train/n_updates,rollout/fill_mean,train/clip_range,train/explained_variance,rollout/ep_rew_mean,train/loss,train/approx_kl,rollout/success_rate,rollout/ep_len_mean,rollout/fill_mean_true_start,train/clip_fraction,eval/mean_reward,eval/success_rate,eval/mean_ep_length
+45374,32768,0,0,1,,,,,,,,,,,,,,,,,,,
+36184,65536,1,33,2,-1.2298590205609798,-0.008514858505805023,0.000298099456,0.15151515151515152,0.5981473941355944,4,0.759469696969697,0.19901696,-0.03566265106201172,11.762028694152832,0.23298749327659607,0.004750251,0.15151515151515152,57.15151515151515,0.759469696969697,0.01049041748046875,,,
+37436,98304,2,392,3,-1.0303076170384884,-0.013458143221214414,0.000296198912,0.2193877551020408,1.1352169942110777,8,0.7758290816326531,0.19803392,0.0018221735954284668,12.857209205627441,0.47307562828063965,0.007482118,0.17,93.79,0.7758290816326531,0.03376007080078125,,,
+38048,131072,3,562,4,-0.8685530107468367,-0.008851662099914392,0.00029429836799999996,0.30071174377224197,3.94307604432106,12,0.8554270462633452,0.19705088,-0.01633894443511963,15.143428802490234,1.7189888954162598,0.008036027,0.31,107.57,0.8554270462633452,0.050537109375,,,
+38533,163840,4,515,5,-0.8836037330329418,-0.005467176597448997,0.00029239782399999997,0.2815533980582524,5.832688242197037,16,0.8569174757281554,0.19606784000000002,0.01765066385269165,16.045656204223633,2.5212085247039795,0.004620187,0.36,65.34,0.8569174757281554,0.010894775390625,,,
+38864,196608,5,672,6,-0.8098919801414013,-0.0067508312640711665,0.00029049728,0.3273809523809524,5.736965894699097,20,0.8733258928571429,0.1950848,-0.038764119148254395,15.864145278930664,2.607980251312256,0.0064091356,0.35,56.85,0.8733258928571429,0.0311279296875,,,
+39131,229376,5,750,7,-0.7509832438081503,-0.005204303910431918,0.000288596736,0.3293333333333333,6.741031587123871,24,0.87075,0.19410176,0.03934216499328613,15.454316139221191,3.1955575942993164,0.0055075064,0.32,46.68,0.87075,0.0245208740234375,,,
+39159,262144,6,801,8,-0.6815477143973112,-0.0032061211713880766,0.00028669619199999996,0.3408239700374532,7.493798851966858,28,0.8790574282147315,0.19311872000000002,0.13663989305496216,16.390687942504883,3.4556126594543457,0.0046379413,0.38,40.31,0.8790574282147315,0.0247955322265625,,,
+39032,294912,7,855,9,-0.6369648762047291,-0.0023605246242368594,0.00028479564799999997,0.39766081871345027,7.56130188703537,32,0.8945175438596491,0.19213568000000003,0.2452094554901123,16.683006286621094,3.8212900161743164,0.0030362937,0.4,37.99,0.8945175438596491,0.0226287841796875,,,
+,327680,,,,-0.5902354549616575,-0.0021221061106189154,0.000282895104,,8.041379109025002,36,,0.19115264,0.27194708585739136,,3.9957985877990723,0.0024653836,,,,0.01163482666015625,17.00164794921875,0.41,29.35
+37611,327680,8,908,10,,,,0.40198237885462557,,,0.8913133259911894,,,17.092615127563477,,,0.42,38.38,0.8913133259911894,,,,
+37768,360448,9,893,11,-0.5623621512204409,-0.00212671378540108,0.00028099455999999994,0.3807390817469205,8.673127442598343,40,0.8904675251959686,0.1901696,0.2954345941543579,16.49431800842285,4.264313220977783,0.0025184967,0.37,36.68,0.8904675251959686,0.01450347900390625,,,
+37818,393216,10,913,12,-0.5366190746426582,-0.0021580425491265487,0.00027909401599999996,0.4085432639649507,8.243786469101906,44,0.8966319824753559,0.18918656,0.34517019987106323,16.015186309814453,4.079951286315918,0.0038734935,0.36,35.81,0.8966319824753559,0.022796630859375,,,
+37935,425984,11,931,13,-0.5160411167889833,-0.0022683953284285963,0.00027719347199999997,0.4103114930182599,8.386807054281235,48,0.9011143931256713,0.18820352,0.3672773838043213,16.746456146240234,4.137474060058594,0.0036284453,0.4,34.54,0.9011143931256713,0.02803802490234375,,,
+38126,458752,12,954,14,-0.5003906656056643,-0.0011789923373726197,0.000275292928,0.44654088050314467,8.34321403503418,52,0.90625,0.18722048000000002,0.38966459035873413,17.096776962280273,4.287346363067627,0.0034752954,0.42,34.22,0.90625,0.0226898193359375,,,
+38152,491520,12,947,15,-0.4782369425520301,-0.0016513216542080045,0.000273392384,0.4276663146779303,8.510051548480988,56,0.9023231256599789,0.18623744,0.3620729446411133,17.407575607299805,4.22487211227417,0.0032609948,0.45,33.42,0.9023231256599789,0.02031707763671875,,,
+38220,524288,13,940,16,-0.4661674713715911,-0.0021418981850729324,0.00027149184,0.4946808510638298,8.486265391111374,60,0.9208776595744681,0.1852544,0.3852715492248535,17.386066436767578,4.042407512664795,0.0038803646,0.44,34.93,0.9208776595744681,0.0272979736328125,,,
+38299,557056,14,953,17,-0.4473287668079138,-0.0015660587814636528,0.00026959129599999997,0.46799580272822666,8.266986414790154,64,0.9127098635886673,0.18427136,0.36498069763183594,17.236696243286133,4.109747409820557,0.001776067,0.44,34.3,0.9127098635886673,0.01950836181640625,,,
+38359,589824,15,960,18,-0.44071072712540627,-0.0023058151637087576,0.000267690752,0.5104166666666666,8.674693256616592,68,0.9243489583333333,0.18328832,0.35938674211502075,19.466459274291992,4.290806770324707,0.0030687822,0.59,34.54,0.9243489583333333,0.024871826171875,,,
+38324,622592,16,940,19,-0.4206619318574667,-0.0011336647694406565,0.000265790208,0.5414893617021277,8.60516506433487,72,0.9246010638297872,0.18230528000000001,0.3473750948905945,19.46584701538086,4.295170307159424,0.0031198955,0.59,35.15,0.9246010638297872,0.029052734375,,,
+,655360,,,,-0.41536277532577515,-0.001454841829399811,0.00026388966399999996,,8.56160694360733,76,,0.18132224,0.33816349506378174,,4.4759674072265625,0.0029830104,,,,0.02698516845703125,19.720046997070312,0.6,30.95
+37799,655360,17,897,20,,,,0.5351170568561873,,,0.9271878483835005,,,18.055585861206055,,,0.49,35.41,0.9271878483835005,,,,
+37842,688128,18,944,21,-0.4087549028918147,-0.0013747410193900578,0.00026198911999999997,0.5434322033898306,8.002062693238258,80,0.9268405720338984,0.1803392,0.3552655577659607,17.686187744140625,4.151304244995117,0.0025554625,0.48,34.81,0.9268405720338984,0.02590179443359375,,,
+37837,720896,19,926,22,-0.4013946047052741,-0.0017760706177796237,0.000260088576,0.5615550755939525,8.444744944572449,84,0.9340577753779697,0.17935616000000001,0.34957414865493774,19.115877151489258,4.003615379333496,0.0031305857,0.57,35.12,0.9340577753779697,0.0299835205078125,,,
+37864,753664,19,944,23,-0.3913607643917203,-0.001236668864294188,0.000258188032,0.5614406779661016,8.078588455915451,88,0.932865466101695,0.17837312000000002,0.35854941606521606,18.37671661376953,3.9655656814575195,0.0019026956,0.51,34.28,0.932865466101695,0.01627349853515625,,,
+37845,786432,20,899,24,-0.3890055473893881,-0.001869889263616642,0.000256287488,0.5773081201334817,8.360190480947495,92,0.9334677419354839,0.17739008,0.37024062871932983,19.11520767211914,4.134017467498779,0.0034680972,0.56,35.79,0.9334677419354839,0.0325469970703125,,,
+37937,819200,21,897,25,-0.3869298445060849,-0.001180961618956644,0.00025438694399999997,0.5975473801560758,7.698728993535042,96,0.9406354515050167,0.17640704000000001,0.3767440915107727,19.745737075805664,3.9229283332824707,0.003622542,0.61,35.26,0.9406354515050167,0.0282745361328125,,,
+37968,851968,22,921,26,-0.37093012407422066,-0.0014023586154507939,0.0002524864,0.6199782844733985,7.708667129278183,100,0.9427252985884907,0.17542400000000002,0.3839501738548279,19.725387573242188,3.953946113586426,0.0032777297,0.6,35.61,0.9427252985884907,0.029815673828125,,,
+37979,884736,23,929,27,-0.3652730602771044,-0.001587526421644725,0.000250585856,0.620021528525296,7.467596933245659,104,0.9414020452099031,0.17444096,0.3770121932029724,19.855754852294922,3.911752462387085,0.0029490453,0.62,35.24,0.9414020452099031,0.02606201171875,,,
+38016,917504,24,897,28,-0.35919238720089197,-0.0007810205497662537,0.000248685312,0.6265328874024526,7.597260102629662,108,0.9449554069119287,0.17345792000000002,0.35878390073776245,21.03475570678711,3.6087446212768555,0.0026437214,0.7,36.24,0.9449554069119287,0.02613067626953125,,,
+38068,950272,24,891,29,-0.3555854856967926,-0.0013988140781293623,0.00024678476799999997,0.6273849607182941,7.4796677976846695,112,0.9434624017957352,0.17247488,0.37164103984832764,19.824155807495117,3.697204351425171,0.00204148,0.61,36.84,0.9434624017957352,0.0231781005859375,,,
+,983040,,,,-0.3516562031581998,-0.0005916068294027355,0.000244884224,,7.23417229950428,116,,0.17149184,0.38028019666671753,,3.4294025897979736,0.0027376728,,,,0.04203033447265625,20.66375732421875,0.7,37.17
+37490,983040,26,882,30,,,,0.6587301587301587,,,0.9479875283446711,,,20.274517059326172,,,0.67,36.48,0.9479875283446711,,,,
+37562,1015808,27,877,31,-0.3438162161037326,-0.0008528652288077865,0.00024298368,0.6818700114025086,7.005183607339859,120,0.951824401368301,0.17050880000000002,0.3747331500053406,20.564287185668945,3.592458486557007,0.0024284709,0.67,36.71,0.951824401368301,0.02719879150390625,,,
+37559,1048576,27,887,32,-0.3357018791139126,-0.0010960149156744592,0.00024108313599999995,0.6989853438556933,6.6867730766534805,124,0.9541995490417137,0.16952576,0.36965906620025635,20.764158248901367,3.123786211013794,0.0016515977,0.69,36.84,0.9541995490417137,0.01993560791015625,,,
+37615,1081344,28,899,33,-0.33290983457118273,-0.0015447276309714653,0.000239182592,0.6696329254727474,6.474198028445244,128,0.950083426028921,0.16854272,0.3703070878982544,21.364004135131836,3.3527982234954834,0.002957273,0.73,36.99,0.950083426028921,0.02936553955078125,,,
+37671,1114112,29,891,34,-0.3249432472512126,-0.0008640794840175658,0.00023728204799999998,0.7059483726150393,6.99108299612999,132,0.9580527497194163,0.16755968,0.3819214701652527,21.693584442138672,3.5696022510528564,0.0026736634,0.75,37.41,0.9580527497194163,0.038604736328125,,,
+37685,1146880,30,870,35,-0.32005843613296747,-0.0006704658444505185,0.000235381504,0.6781609195402298,6.462437078356743,136,0.954382183908046,0.16657664,0.396236777305603,19.901918411254883,3.404885768890381,0.0025193149,0.62,39.08,0.954382183908046,0.0261993408203125,,,
+37682,1179648,31,890,36,-0.31507246289402246,-0.0008787637525529135,0.00023348095999999998,0.6617977528089888,6.755030736327171,140,0.9488061797752809,0.1655936,0.40515851974487305,18.954267501831055,3.505863904953003,0.0029328617,0.55,36.73,0.9488061797752809,0.03510284423828125,,,
+37685,1212416,32,882,37,-0.31246635876595974,-0.0010542066556809004,0.000231580416,0.6938775510204082,6.970719054341316,144,0.9544359410430839,0.16461056000000002,0.4054747223854065,21.514375686645508,3.2942142486572266,0.0028700687,0.74,36.62,0.9544359410430839,0.03531646728515625,,,
+37698,1245184,33,904,38,-0.30700892955064774,-0.0004829993995372206,0.00022967987199999998,0.7212389380530974,6.387609645724297,148,0.9573423672566371,0.16362752,0.40839773416519165,21.573556900024414,3.2016937732696533,0.002294924,0.75,37.44,0.9573423672566371,0.03501129150390625,,,
+37715,1277952,33,896,39,-0.30077260360121727,-0.00010291579383192584,0.00022777932799999997,0.7176339285714286,6.416679814457893,152,0.96240234375,0.16264447999999998,0.39059585332870483,21.693605422973633,3.259964942932129,0.0016735181,0.75,37.39,0.96240234375,0.0238800048828125,,,
+,1310720,,,,-0.3022667486220598,-0.001242740221641725,0.000225878784,,6.201439082622528,156,,0.16166144,0.40867042541503906,,3.0658559799194336,0.0016520643,,,,0.023193359375,22.293773651123047,0.8,37.19
+37181,1310720,35,904,40,,,,0.6935840707964602,,,0.9582411504424779,,,21.384685516357422,,,0.73,36.31,0.9582411504424779,,,,
+37230,1343488,36,874,41,-0.30058860406279564,-0.0006729827291565016,0.00022397824000000002,0.7196796338672768,6.433982118964195,160,0.9610268878718535,0.1606784,0.415866494178772,22.023008346557617,3.2553439140319824,0.0034690336,0.78,37.99,0.9610268878718535,0.03125762939453125,,,
+37273,1376256,36,879,42,-0.29921972658485174,-0.0004370929018477909,0.00022207769599999998,0.7417519908987485,6.17134490609169,164,0.9616751990898749,0.15969536,0.4111033082008362,22.25445556640625,2.8929831981658936,0.001978454,0.79,36.54,0.9616751990898749,0.03466796875,,,
+37300,1409024,37,885,43,-0.29940648283809423,-0.0010479736010893248,0.000220177152,0.7367231638418079,5.823233470320702,168,0.9641949152542373,0.15871232000000002,0.41172367334365845,22.114887237548828,2.8673651218414307,0.0017581426,0.78,36.11,0.9641949152542373,0.017120361328125,,,
+37346,1441792,38,893,44,-0.29284314531832933,-0.0011125082746730186,0.000218276608,0.7178051511758119,5.909881457686424,172,0.9595464725643897,0.15772928,0.42098867893218994,21.684206008911133,2.9068140983581543,0.0024633314,0.76,36.79,0.9595464725643897,0.02176666259765625,,,
+37373,1474560,39,887,45,-0.29309672489762306,-0.0012948999647051096,0.00021637606399999996,0.7485907553551296,6.3573883175849915,176,0.9652621195039459,0.15674624,0.42365044355392456,21.55508041381836,3.2121341228485107,0.002784161,0.75,35.92,0.9652621195039459,0.038665771484375,,,
+37345,1507328,40,882,46,-0.2908890638500452,-0.0013122938617016189,0.00021447551999999998,0.7448979591836735,5.6627398282289505,180,0.9668367346938775,0.1557632,0.4405299425125122,21.923168182373047,2.8291304111480713,0.0025451393,0.77,37.83,0.9668367346938775,0.03295135498046875,,,
+37401,1540096,41,902,47,-0.28358306363224983,-0.001141109794843942,0.000212574976,0.7660753880266076,5.731951907277107,184,0.9641075388026608,0.15478016,0.4482705593109131,21.204015731811523,2.754823923110962,0.0024879081,0.72,36.98,0.9641075388026608,0.0327911376953125,,,
+37425,1572864,42,898,48,-0.2842884287238121,-0.00098928133957088,0.000210674432,0.7505567928730512,5.626303493976593,188,0.9665924276169265,0.15379712,0.4279376268386841,22.213665008544922,3.040269613265991,0.0018491434,0.79,37.33,0.9665924276169265,0.02243804931640625,,,
+37448,1605632,42,880,49,-0.28158252593129873,-0.001083266964997165,0.000208773888,0.7579545454545454,5.711370125412941,192,0.9677556818181818,0.15281408000000002,0.43647605180740356,22.44345474243164,2.788484811782837,0.0019136355,0.81,37.54,0.9677556818181818,0.02474212646484375,,,
+,1638400,,,,-0.2750613437965512,-0.0012144200190959964,0.00020687334399999998,,5.569181263446808,196,,0.15183104,0.44390225410461426,,2.7891383171081543,0.002071886,,,,0.02374267578125,21.59288787841797,0.75,38.08
+37134,1638400,44,917,50,,,,0.7666303162486369,,,0.965717011995638,,,21.87450408935547,,,0.77,36.49,0.965717011995638,,,,
+37176,1671168,44,899,51,-0.2738689137622714,-0.0007896152601460926,0.0002049728,0.7552836484983315,5.727614462375641,200,0.9682285873192435,0.150848,0.442674458026886,21.21472930908203,2.942171096801758,0.0018747828,0.71,36.27,0.9682285873192435,0.0289764404296875,,,
+37229,1703936,45,885,52,-0.2734556011855602,-0.0013386842765612528,0.000203072256,0.7728813559322034,5.714714661240578,204,0.9676553672316384,0.14986496,0.45878171920776367,22.485492706298828,2.7921032905578613,0.002284302,0.82,35.5,0.9676553672316384,0.03157806396484375,,,
+37283,1736704,46,887,53,-0.2710215197876096,-0.001136966842750553,0.00020117171199999996,0.7779030439684329,5.497001275420189,208,0.969771702367531,0.14888192,0.4554683566093445,22.464393615722656,2.7142632007598877,0.002452175,0.81,36.6,0.969771702367531,0.03469085693359375,,,
+37317,1769472,47,897,54,-0.2680910173803568,-0.0011056163421017118,0.00019927116799999998,0.7513935340022296,5.277519077062607,212,0.9650919732441472,0.14789888,0.47048598527908325,21.58514976501465,2.6139795780181885,0.0023511797,0.75,35.85,0.9650919732441472,0.03984832763671875,,,
+37335,1802240,48,892,55,-0.26904553454369307,-0.0009452978920307942,0.000197370624,0.765695067264574,5.806692570447922,216,0.968820067264574,0.14691584000000002,0.4563841223716736,21.564367294311523,2.7467539310455322,0.0016810604,0.75,36.63,0.968820067264574,0.02843475341796875,,,
+37379,1835008,49,903,56,-0.263420594856143,-0.0011439928130130284,0.00019547008,0.7718715393133998,5.495085567235947,220,0.9678848283499446,0.1459328,0.47424960136413574,21.95404815673828,2.6388044357299805,0.002843096,0.77,36.95,0.9678848283499446,0.03279876708984375,,,
+37393,1867776,49,901,57,-0.26316916663199663,-0.0013882642015232705,0.00019356953599999996,0.7857935627081021,5.46816685795784,224,0.9694089900110988,0.14494975999999998,0.47617191076278687,21.77474594116211,2.7108728885650635,0.0016687493,0.76,36.25,0.9694089900110988,0.02978515625,,,
+37405,1900544,50,908,58,-0.2598719475790858,-0.0011074304493376985,0.000191668992,0.788546255506608,5.354870647192001,228,0.9701954845814978,0.14396672,0.47299128770828247,21.925195693969727,2.692593812942505,0.001727124,0.77,35.8,0.9701954845814978,0.0288543701171875,,,
+37422,1933312,51,928,59,-0.259869153611362,-0.0012945417693117633,0.000189768448,0.7898706896551724,5.351239696145058,232,0.9697602370689655,0.14298368,0.47422879934310913,21.285707473754883,2.7440242767333984,0.002096021,0.73,35.29,0.9697602370689655,0.03514862060546875,,,
+,1966080,,,,-0.2542733894661069,-0.0005488547903951257,0.00018786790399999997,,5.441597789525986,236,,0.14200063999999998,0.47965049743652344,,2.784128189086914,0.0025275627,,,,0.046661376953125,23.537508010864258,0.89,33.49
+37159,1966080,52,893,60,,,,0.7928331466965286,,,0.9722844344904815,,,22.345224380493164,,,0.8,35.77,0.9722844344904815,,,,
+37167,1998848,53,932,61,-0.2542557967826724,-0.0009152193997579161,0.00018596736,0.7650214592274678,4.982875511050224,240,0.9678782188841202,0.1410176,0.49386364221572876,22.275468826293945,2.2919163703918457,0.0015691933,0.8,35.53,0.9678782188841202,0.02332305908203125,,,
+37202,2031616,54,904,62,-0.25214730808511376,-0.0010700906204874627,0.00018406681600000003,0.8086283185840708,5.70005589723587,244,0.9738661504424779,0.14003456,0.4857938289642334,22.714597702026367,2.8633246421813965,0.0018208413,0.83,36.4,0.9738661504424779,0.03487396240234375,,,
+37228,2064384,55,915,63,-0.2487419149838388,-0.0010104253815370612,0.000182166272,0.7967213114754098,4.794042870402336,248,0.9756147540983606,0.13905152,0.506373405456543,22.295654296875,2.3883578777313232,0.0019842295,0.8,35.34,0.9756147540983606,0.0284881591796875,,,
+37254,2097152,56,918,64,-0.2500462266616523,-0.0007910212698334362,0.000180265728,0.789760348583878,4.864208519458771,252,0.9738562091503268,0.13806848,0.5165666341781616,21.594388961791992,2.392334222793579,0.0017296392,0.75,36.61,0.9738562091503268,0.03488922119140625,,,
+37266,2129920,57,913,65,-0.2461031242273748,-0.0009666746627772227,0.00017836518400000001,0.8192771084337349,5.131673842668533,256,0.975013691128149,0.13708544,0.4931120276451111,22.885366439819336,2.465526580810547,0.0012302643,0.84,35.63,0.975013691128149,0.02147674560546875,,,
+37283,2162688,58,903,66,-0.24242917215451598,-0.0009832765281316824,0.00017646464000000003,0.8250276854928018,4.683474242687225,260,0.9764673311184939,0.1361024,0.49195629358291626,23.005565643310547,2.35469126701355,0.0016122356,0.85,35.43,0.9764673311184939,0.02951812744140625,,,
+37279,2195456,58,948,67,-0.24398114625364542,-0.0008061235639615916,0.000174564096,0.8069620253164557,4.485879555344582,264,0.9757383966244726,0.13511936,0.4999684691429138,22.075204849243164,2.2757976055145264,0.002458454,0.78,35.79,0.9757383966244726,0.03501129150390625,,,
+37305,2228224,59,916,68,-0.23932506889104843,-0.001642452974920161,0.000172663552,0.7729257641921398,4.967893838882446,268,0.9677265283842795,0.13413632,0.4988722801208496,21.875465393066406,2.4825098514556885,0.0015072661,0.76,35.53,0.9677265283842795,0.02912139892578125,,,
+37318,2260992,60,895,69,-0.2397270267829299,-0.00022451301629189402,0.000170763008,0.8111731843575419,5.571376875042915,272,0.9754189944134078,0.13315328,0.4854944348335266,22.364015579223633,3.040872573852539,0.0022479605,0.8,36.98,0.9754189944134078,0.0369415283203125,,,
+,2293760,,,,-0.2375413873232901,-0.0006810268896515481,0.000168862464,,4.657902434468269,276,,0.13217024,0.5184721946716309,,2.2462902069091797,0.0017703219,,,,0.0402374267578125,22.727724075317383,0.83,33.27
+37172,2293760,61,924,70,,,,0.803030303030303,,,0.9744994588744589,,,22.38507652282715,,,0.8,35.92,0.9744994588744589,,,,
+37195,2326528,62,932,71,-0.23697827570140362,-0.0006636827856709715,0.00016696191999999999,0.8111587982832618,4.841425865888596,280,0.974651287553648,0.1311872,0.5074849128723145,22.116426467895508,2.551248550415039,0.001666524,0.78,34.57,0.974651287553648,0.0321807861328125,,,
+37205,2359296,63,926,72,-0.2346678664907813,-0.0010689891205402091,0.000165061376,0.82829373650108,4.7952283918857574,284,0.9766468682505399,0.13020416,0.5116617679595947,22.87514877319336,2.294288158416748,0.0013954106,0.84,35.85,0.9766468682505399,0.0264892578125,,,
+37237,2392064,64,912,73,-0.23228108696639538,-0.0009662099037086591,0.000163160832,0.8300438596491229,4.52078552544117,288,0.9780016447368421,0.12922112000000002,0.5193164944648743,22.994680404663086,2.196552276611328,0.0015645323,0.85,36.32,0.9780016447368421,0.02384185791015625,,,
+37239,2424832,65,901,74,-0.22937063639983535,-0.0009072166940313764,0.00016126028799999997,0.8224195338512763,4.446238562464714,292,0.9768312985571587,0.12823807999999998,0.5307595729827881,21.946178436279297,2.2776031494140625,0.0018997863,0.76,34.82,0.9768312985571587,0.0390625,,,
+37240,2457600,65,926,75,-0.23144899820908904,-0.0008495838956150692,0.00015935974399999999,0.8272138228941684,4.529730349779129,296,0.9765118790496761,0.12725503999999999,0.5314995050430298,22.64508628845215,2.422177314758301,0.0015912973,0.83,35.91,0.9765118790496761,0.02880096435546875,,,
+37260,2490368,66,943,76,-0.22922447184100747,-0.0009519735940557439,0.00015745920000000003,0.8101802757158006,4.464266926050186,300,0.9744167550371156,0.126272,0.533866286277771,21.945802688598633,2.1568589210510254,0.0017249548,0.77,35.19,0.9744167550371156,0.0299530029296875,,,
+37287,2523136,67,926,77,-0.23116772435605526,-0.00038202284849830903,0.000155558656,0.8347732181425486,4.747580364346504,304,0.9797516198704104,0.12528896,0.5232782363891602,22.666078567504883,2.5608606338500977,0.0014027997,0.82,34.92,0.9797516198704104,0.02858734130859375,,,
+37290,2555904,68,938,78,-0.22379813436418772,-0.0005183786997804418,0.000153658112,0.835820895522388,4.232793845236301,308,0.9795442430703625,0.12430591999999999,0.538054347038269,22.885845184326172,2.014514923095703,0.0014950831,0.84,35.15,0.9795442430703625,0.02765655517578125,,,
+37317,2588672,69,916,79,-0.22358473017811775,-0.0006823737057857215,0.000151757568,0.8144104803493449,4.4470571875572205,312,0.974754366812227,0.12332288,0.5396409034729004,22.62496566772461,2.226818323135376,0.0017585177,0.82,36.03,0.974754366812227,0.03737640380859375,,,
+,2621440,,,,-0.22492284048348665,-0.0007482912042178214,0.000149857024,,4.757524445652962,316,,0.12233983999999999,0.531952977180481,,2.4793195724487305,0.0011641049,,,,0.02167510986328125,22.66628646850586,0.82,34.71
+37161,2621440,70,917,80,,,,0.826608505997819,,,0.9775763358778626,,,22.036317825317383,,,0.78,34.68,0.9775763358778626,,,,
+37176,2654208,71,943,81,-0.22234273282811046,-0.00045166079871705733,0.00014795648,0.823966065747614,4.376243934035301,320,0.9781283138918345,0.1213568,0.5391843318939209,22.765914916992188,2.0701229572296143,0.0020707268,0.83,35.08,0.9781283138918345,0.0404205322265625,,,
+37204,2686976,72,928,82,-0.22301172092556953,-0.0006529431993840262,0.000146055936,0.84375,4.555200636386871,324,0.9795258620689655,0.12037376,0.5420545339584351,23.26599884033203,2.1509368419647217,0.0009256944,0.87,35.0,0.9795258620689655,0.01833343505859375,,,
+37249,2719744,73,928,83,-0.21903106337413192,-0.0005686304684786592,0.000144155392,0.8146551724137931,3.9914683401584625,328,0.9770339439655172,0.11939072,0.5566314458847046,22.355314254760742,2.100364923477173,0.0012009785,0.8,35.68,0.9770339439655172,0.02838134765625,,,
+37286,2752512,73,910,84,-0.22186170099303126,-0.000736217798475991,0.000142254848,0.8307692307692308,4.566025942564011,332,0.977815934065934,0.11840768,0.534064769744873,22.355653762817383,2.0721564292907715,0.0011156937,0.8,35.34,0.977815934065934,0.02747344970703125,,,
+37327,2785280,74,927,85,-0.22151248110458255,-0.0007161415123846382,0.000140354304,0.8263214670981661,4.241860099136829,336,0.977953074433657,0.11742464000000001,0.5490875244140625,23.105134963989258,1.874281883239746,0.0015826183,0.86,35.86,0.977953074433657,0.03757476806640625,,,
+37365,2818048,75,921,86,-0.21996401203796268,-0.0008660170788061805,0.00013845376,0.8349619978284474,4.343774184584618,340,0.9779451682953312,0.1164416,0.5532020330429077,22.516277313232422,2.0640206336975098,0.001547968,0.82,34.72,0.9779451682953312,0.03240966796875,,,
+37384,2850816,76,930,87,-0.21835310524329543,-0.0001819595054257661,0.00013655321599999998,0.8247311827956989,4.292394749820232,344,0.9776209677419355,0.11545855999999999,0.5490661859512329,22.645864486694336,2.205852746963501,0.0012306625,0.82,35.13,0.9776209677419355,0.0364532470703125,,,
+37392,2883584,77,935,88,-0.21856612153351307,-0.0005811805931443814,0.000134652672,0.8288770053475936,4.458429336547852,348,0.9749331550802139,0.11447552,0.5487443804740906,22.386056900024414,2.0907559394836426,0.0012084604,0.81,34.94,0.9749331550802139,0.03046417236328125,,,
+37444,2916352,77,942,89,-0.22009099880233407,-0.0006191178072185721,0.00013275212799999998,0.8407643312101911,4.512475803494453,352,0.9785695329087049,0.11349247999999999,0.5422072410583496,22.76553726196289,2.2027816772460938,0.0010802415,0.83,35.46,0.9785695329087049,0.025909423828125,,,
+,2949120,,,,-0.21706996392458677,-0.0008247621663031168,0.00013085158400000002,,4.334071762859821,356,,0.11250944,0.546912431716919,,2.1559994220733643,0.001331354,,,,0.03168487548828125,23.737655639648438,0.91,33.34
+37365,2949120,78,942,90,,,,0.8439490445859873,,,0.9796974522292994,,,23.385717391967773,,,0.88,35.28,0.9796974522292994,,,,
+37400,2981888,79,916,91,-0.21456079743802547,-0.00013107694394420832,0.00012895104,0.8504366812227074,4.1816521137952805,360,0.9813045851528385,0.1115264,0.5541621446609497,23.15585708618164,2.1627395153045654,0.001040586,0.86,35.14,0.9813045851528385,0.0358123779296875,,,
+37449,3014656,80,954,92,-0.215675238519907,-0.0003897248716384638,0.00012705049600000002,0.8270440251572327,3.8367320895195007,364,0.9785115303983228,0.11054336000000001,0.5701626539230347,23.0058536529541,2.2316391468048096,0.0012176302,0.85,35.14,0.9785115303983228,0.0272979736328125,,,
+37485,3047424,81,939,93,-0.21445903088897467,-0.0005144639908394311,0.000125149952,0.8541001064962727,4.510422632098198,368,0.9809637912673056,0.10956032,0.5512410402297974,22.845369338989258,2.02435302734375,0.0006394626,0.83,35.63,0.9809637912673056,0.0178680419921875,,,
+37512,3080192,82,925,94,-0.21541326260194182,-0.00046765691513428465,0.000123249408,0.8324324324324325,3.975008338689804,372,0.9775,0.10857727999999998,0.5707689523696899,22.985368728637695,2.152963161468506,0.0011100133,0.85,35.63,0.9775,0.0314483642578125,,,
+37565,3112960,82,904,95,-0.2146880766376853,-0.00021804586867801845,0.00012134886400000001,0.8285398230088495,4.52867878973484,376,0.9773230088495575,0.10759424,0.546619176864624,21.985595703125,2.0724475383758545,0.0015949016,0.77,35.4,0.9773230088495575,0.037841796875,,,
+37619,3145728,83,929,96,-0.21484856260940433,-0.00013911386122344993,0.00011944832,0.8310010764262648,4.422710090875626,380,0.9772604951560818,0.10661119999999999,0.5570148229598999,23.085918426513672,2.0721826553344727,0.0010901163,0.86,35.08,0.9772604951560818,0.039703369140625,,,
+37649,3178496,84,938,97,-0.21438812790438533,-0.000215442731132498,0.00011754777600000001,0.8432835820895522,4.2784713208675385,384,0.9796775053304904,0.10562816,0.5599733591079712,23.59548568725586,2.0235249996185303,0.000781617,0.9,35.51,0.9796775053304904,0.02379608154296875,,,
+37628,3211264,85,926,98,-0.2142101009376347,-0.0006791243831685279,0.000115647232,0.8563714902807775,4.0679560750722885,388,0.9817089632829373,0.10464512,0.5587557554244995,23.106298446655273,2.015033721923828,0.0011244576,0.86,34.7,0.9817089632829373,0.0279083251953125,,,
+37660,3244032,86,947,99,-0.2117798193357885,-0.0008003368311619852,0.00011374668800000001,0.8447729672650475,3.907840110361576,392,0.9779567053854277,0.10366208,0.5673338174819946,23.205915451049805,1.9381521940231323,0.0011017714,0.87,35.08,0.9779567053854277,0.03328704833984375,,,
+,3276800,,,,-0.20824811048805714,-0.0006546072145283688,0.000111846144,,4.2005132883787155,396,,0.10267904,0.5581036806106567,,2.1699349880218506,0.0009621003,,,,0.03237152099609375,23.037656784057617,0.85,33.34
+37606,3276800,87,921,100,,,,0.8512486427795874,,,0.9788952225841476,,,22.885818481445312,,,0.84,35.18,0.9788952225841476,,,,
+37651,3309568,87,937,101,-0.2078302693553269,-0.0005670127320627216,0.00010994559999999998,0.8537886872998933,4.053633712232113,400,0.9803228388473852,0.101696,0.5614051818847656,24.42589569091797,2.0621728897094727,0.0011285658,0.96,35.1,0.9803228388473852,0.04155731201171875,,,
+37680,3342336,88,940,102,-0.21086797770112753,-0.0006814127518737223,0.00010804505600000002,0.851063829787234,3.911878190934658,404,0.9823803191489362,0.10071296,0.5780146718025208,22.885805130004883,1.9176877737045288,0.0010108375,0.84,35.19,0.9823803191489362,0.02902984619140625,,,
+37718,3375104,89,929,103,-0.21137274522334337,-0.0002845064263965469,0.000106144512,0.8406889128094726,4.088450379669666,408,0.9782023681377826,0.09972991999999999,0.5720782279968262,22.796398162841797,2.0918190479278564,0.00076151435,0.84,34.6,0.9782023681377826,0.0298004150390625,,,
+37753,3407872,90,940,104,-0.2131336466409266,-0.0006174503469082993,0.00010424396800000002,0.8361702127659575,4.293498992919922,412,0.9793882978723404,0.09874688,0.5644934177398682,22.726905822753906,2.25451397895813,0.0005858779,0.83,34.09,0.9793882978723404,0.02093505859375,,,
+37770,3440640,91,926,105,-0.21076701115816832,-0.0005934085456829052,0.000102343424,0.8315334773218143,4.215714432299137,416,0.9778617710583153,0.09776383999999999,0.5725601315498352,23.235437393188477,2.1791470050811768,0.0010222793,0.87,35.56,0.9778617710583153,0.02925872802734375,,,
+37815,3473408,91,936,106,-0.2109595420770347,-0.00032336412914446555,0.00010044288000000002,0.8344017094017094,4.276236414909363,420,0.9788995726495726,0.0967808,0.5616365075111389,22.635087966918945,2.1401689052581787,0.0008907538,0.82,35.91,0.9788995726495726,0.03418731689453125,,,
+37868,3506176,92,917,107,-0.20920431381091475,-0.0005745684138673823,9.8542336e-05,0.8495092693565977,4.271889828145504,424,0.9811205016357688,0.09579776,0.5632666945457458,23.395404815673828,2.1754424571990967,0.0008048236,0.88,35.59,0.9811205016357688,0.02567291259765625,,,
+37901,3538944,93,950,108,-0.20828016940504313,-0.0006146580417407677,9.664179200000002e-05,0.8305263157894737,3.8557565584778786,428,0.9768421052631578,0.09481472,0.5718740224838257,22.966615676879883,2.0368449687957764,0.0007405822,0.85,34.38,0.9768421052631578,0.02681732177734375,,,
+37934,3571712,94,950,109,-0.21083402913063765,-0.0005156116276339162,9.4741248e-05,0.8505263157894737,4.58659990131855,432,0.9805263157894737,0.09383168,0.5481096506118774,22.336355209350586,2.266541004180908,0.00088351493,0.8,34.64,0.9805263157894737,0.02811431884765625,,,
+,3604480,,,,-0.20858247624710202,-0.0002768738122540526,9.284070399999999e-05,,4.113410748541355,436,,0.09284863999999998,0.561133086681366,,1.9095567464828491,0.0013692394,,,,0.03521728515625,23.176746368408203,0.87,34.25
+37867,3604480,95,944,110,,,,0.8188559322033898,,,0.9742452330508474,,,22.985546112060547,,,0.85,35.45,0.9742452330508474,,,,
+37889,3637248,95,926,111,-0.20795931806787848,-0.0004015582744614221,9.094016e-05,0.8218142548596112,4.82213282585144,440,0.9781317494600432,0.09186559999999999,0.5379593968391418,21.66545867919922,2.2512285709381104,0.0006933264,0.74,35.54,0.9781317494600432,0.02849578857421875,,,
+37902,3670016,96,946,112,-0.20806274050846696,-0.00044099943625042215,8.903961599999999e-05,0.8350951374207188,4.63136051595211,444,0.9793208245243129,0.09088255999999999,0.5521971583366394,22.956558227539062,2.262269973754883,0.0007352658,0.85,34.44,0.9793208245243129,0.02654266357421875,,,
+37917,3702784,97,940,113,-0.20895337406545877,-0.0005916637601330876,8.713907200000003e-05,0.8393617021276596,4.3972993940114975,448,0.9779255319148936,0.08989952,0.5563084483146667,23.016498565673828,2.097949981689453,0.0006913919,0.86,34.5,0.9779255319148936,0.02539825439453125,,,
+37932,3735552,98,946,114,-0.2076975773088634,-0.0005389694924815558,8.523852800000002e-05,0.8298097251585623,4.398740828037262,452,0.9785280126849895,0.08891647999999999,0.5470494031906128,22.576461791992188,2.309109926223755,0.0006051827,0.82,34.53,0.9785280126849895,0.02178192138671875,,,
+37957,3768320,99,939,115,-0.2083721519447863,-0.0005439642882265616,8.333798400000003e-05,0.8221512247071352,4.32144570350647,456,0.9763045793397231,0.08793344,0.5506153106689453,22.035367965698242,2.133729934692383,0.00067968067,0.78,35.63,0.9763045793397231,0.0277557373046875,,,
+37976,3801088,100,927,116,-0.20795414550229907,-0.0003581586279324256,8.143744000000002e-05,0.8220064724919094,4.700256511569023,460,0.9736380798274002,0.0869504,0.5321061611175537,22.46576499938965,2.18986177444458,0.00038546333,0.81,35.23,0.9736380798274002,0.01789093017578125,,,
+38011,3833856,100,942,117,-0.2073063151910901,-0.0005837562857777812,7.9536896e-05,0.8174097664543525,4.734115168452263,464,0.9751194267515924,0.08596735999999999,0.5314316749572754,21.87624740600586,2.5806572437286377,0.0008604437,0.76,34.75,0.9751194267515924,0.027801513671875,,,
+38048,3866624,101,925,118,-0.20658550970256329,-0.0006154152324597817,7.763635200000002e-05,0.8583783783783784,4.638432741165161,468,0.981418918918919,0.08498432,0.5389015674591064,22.31586456298828,2.3361880779266357,0.0006266789,0.8,35.13,0.981418918918919,0.02861785888671875,,,
+38086,3899392,102,945,119,-0.20368911512196064,-0.00028421861497918144,7.5735808e-05,0.8582010582010582,3.87612122297287,472,0.9809523809523809,0.08400127999999998,0.5590083599090576,22.846519470214844,1.7249375581741333,0.00045049714,0.84,34.48,0.9809523809523809,0.01937103271484375,,,
+,3932160,,,,-0.20508287893608212,-0.0005081275594420731,7.383526400000002e-05,,3.9391630440950394,476,,0.08301824,0.5568398237228394,,2.0232181549072266,0.00052662136,,,,0.02640533447265625,23.39690399169922,0.88,34.09
+38044,3932160,103,951,120,,,,0.8307045215562566,,,0.9783780231335436,,,23.15605926513672,,,0.86,34.94,0.9783780231335436,,,,
+38078,3964928,104,932,121,-0.20436065457761288,-0.0005006007449992467,7.193472e-05,0.8293991416309013,4.40668898075819,480,0.978473712446352,0.08203519999999999,0.5504130721092224,23.185718536376953,2.211912155151367,0.00037538612,0.86,35.28,0.978473712446352,0.01688385009765625,,,
+38110,3997696,104,925,122,-0.2069886871613562,-0.0004771136991621461,7.003417600000002e-05,0.8508108108108108,4.416568152606487,484,0.9813513513513513,0.08105216,0.5585015416145325,22.285493850708008,2.276430606842041,0.0005324799,0.8,35.5,0.9813513513513513,0.02265167236328125,,,
+38151,4030464,105,949,123,-0.2026463197544217,-0.0004624480352504179,6.8133632e-05,0.8556375131717597,3.89119403809309,488,0.9810326659641728,0.08006912,0.5693919658660889,22.586318969726562,1.834606409072876,0.0004650138,0.82,34.68,0.9810326659641728,0.019989013671875,,,
+38189,4063232,106,946,124,-0.2038549673743546,-0.0005629054066957906,6.623308799999999e-05,0.8329809725158562,4.018536202609539,492,0.9795190274841438,0.07908607999999999,0.5589853525161743,22.696876525878906,2.0951642990112305,0.00058903336,0.83,34.12,0.9795190274841438,0.0277099609375,,,
+38218,4096000,107,952,125,-0.20541651220992208,-0.0005388954050431494,6.433254400000003e-05,0.842436974789916,4.328458800911903,496,0.9811580882352942,0.07810304,0.5530674457550049,23.125795364379883,2.168762445449829,0.00036227726,0.86,35.2,0.9811580882352942,0.01967620849609375,,,
+38247,4128768,107,924,126,-0.20425421558320522,-0.00040518318564863876,6.243200000000001e-05,0.8409090909090909,4.092076160013676,500,0.9781520562770563,0.07711999999999998,0.5684345960617065,23.035505294799805,1.9955803155899048,0.0004168714,0.85,35.49,0.9781520562770563,0.02155303955078125,,,
+38278,4161536,108,915,127,-0.20619440358132124,-0.0003886644153681118,6.053145600000003e-05,0.848087431693989,4.233427204191685,504,0.9811475409836066,0.07613695999999999,0.5607883334159851,23.195688247680664,2.255563735961914,0.0005326313,0.86,35.31,0.9811475409836066,0.027984619140625,,,
+38313,4194304,109,953,128,-0.2033974570222199,-0.0005213953318161657,5.8630912000000014e-05,0.8614900314795383,3.8634163215756416,508,0.9811122770199371,0.07515391999999999,0.5814101099967957,22.487407684326172,1.9515001773834229,0.00042647176,0.82,33.59,0.9811122770199371,0.0222930908203125,,,
+38338,4227072,110,927,129,-0.20557297579944134,-0.00043936191650573164,5.673036800000003e-05,0.8478964401294499,3.910744793713093,512,0.9806499460625674,0.07417088,0.5689505338668823,23.035615921020508,2.200923442840576,0.00034850137,0.85,35.38,0.9806499460625674,0.02045440673828125,,,
+,4259840,,,,-0.20325945364311337,-0.0005634145200019702,5.4829824000000014e-05,,3.9002937227487564,516,,0.07318784,0.5753737688064575,,2.0174720287323,0.0004970577,,,,0.02396392822265625,22.937253952026367,0.84,33.74
+38291,4259840,111,951,130,,,,0.8412197686645636,,,0.9795609884332281,,,23.316267013549805,,,0.87,34.73,0.9795609884332281,,,,
+38311,4292608,112,931,131,-0.20206951024010777,-0.0002462741103954613,5.292928000000003e-05,0.8431793770139635,4.274115413427353,520,0.9806659505907627,0.07220480000000001,0.5672262907028198,23.105257034301758,1.9455938339233398,0.00027810317,0.86,35.74,0.9806659505907627,0.01924896240234375,,,
+38333,4325376,112,933,132,-0.20376398041844368,-0.00047788823940209113,5.102873600000004e-05,0.8510182207931404,3.997874915599823,524,0.9807743837084673,0.07122176,0.5805732011795044,22.995746612548828,1.987708330154419,0.00034817102,0.85,35.25,0.9807743837084673,0.022369384765625,,,
+38372,4358144,113,946,133,-0.20382988452911377,-0.0004380863538244739,4.9128192e-05,0.8350951374207188,4.012746088206768,528,0.9785940803382663,0.07023871999999998,0.5720632076263428,22.606538772583008,2.0346872806549072,0.00030238292,0.82,34.46,0.9785940803382663,0.01697540283203125,,,
+38392,4390912,114,943,134,-0.2046093405224383,-0.00045221889013191685,4.722764800000001e-05,0.8441145281018028,4.4026795625686646,532,0.9783271474019088,0.06925567999999999,0.5586564540863037,22.065540313720703,2.1348867416381836,0.00032150664,0.78,35.46,0.9783271474019088,0.02094268798828125,,,
+38405,4423680,115,930,135,-0.20628277771174908,-0.0003760260733542964,4.5327104000000026e-05,0.8408602150537634,4.3110004514455795,536,0.978494623655914,0.06827264,0.5521165132522583,22.866138458251953,2.285780191421509,0.00031784107,0.85,34.86,0.978494623655914,0.02024078369140625,,,
+38420,4456448,115,954,136,-0.20770439924672246,-0.0004623331951734144,4.342656000000004e-05,0.8354297693920335,4.216419741511345,540,0.9787735849056604,0.0672896,0.5535593032836914,22.545682907104492,2.0701980590820312,0.0002664178,0.81,35.31,0.9787735849056604,0.0147552490234375,,,
+38437,4489216,116,906,137,-0.20378959318622947,-0.00024375375141971745,4.1526016e-05,0.8388520971302428,4.529584005475044,544,0.9788217439293598,0.06630655999999999,0.5489927530288696,23.12563705444336,2.43764591217041,0.0002481754,0.85,35.36,0.9788217439293598,0.0142364501953125,,,
+38450,4521984,117,937,138,-0.203386593144387,-0.0003697856081998907,3.962547200000001e-05,0.8367129135538954,4.036593846976757,548,0.9792556029882604,0.06532352,0.5673583745956421,22.5056209564209,2.008641481399536,0.000306807,0.81,35.38,0.9792556029882604,0.0221099853515625,,,
+38452,4554752,118,918,139,-0.20552404783666134,-0.00043397664558142424,3.7724928000000026e-05,0.8638344226579521,4.301553398370743,552,0.9831835511982571,0.06434047999999998,0.5587401390075684,23.58545684814453,2.1329824924468994,0.00021947606,0.89,35.54,0.9831835511982571,0.0173187255859375,,,
+,4587520,,,,-0.20371130434796214,-0.0004103685532754753,3.5824383999999985e-05,,3.4614615067839622,556,,0.06335743999999999,0.5920901298522949,,1.615607500076294,0.00021943366,,,,0.01454925537109375,22.5773868560791,0.82,33.61
+38395,4587520,119,953,140,,,,0.8363064008394544,,,0.9794727177334732,,,23.895069122314453,,,0.92,35.93,0.9794727177334732,,,,
+38404,4620288,120,923,141,-0.20697811571881175,-0.0003680417976283934,3.392384000000005e-05,0.8364030335861322,4.309607699513435,560,0.9797535211267606,0.062374399999999997,0.5621054172515869,22.55632781982422,2.214186906814575,0.0001716828,0.82,34.67,0.9797535211267606,0.015625,,,
+38419,4653056,121,938,142,-0.20413065934553742,-0.00036814718623645604,3.202329600000001e-05,0.8230277185501066,4.201784513890743,564,0.9769456289978679,0.06139135999999998,0.571344256401062,23.015783309936523,2.123476266860962,0.00015862483,0.85,35.21,0.9769456289978679,0.01303863525390625,,,
+38435,4685824,121,928,143,-0.2032282194122672,-0.000306748494040221,3.0122752000000025e-05,0.8566810344827587,4.526548251509666,568,0.9816810344827587,0.06040831999999999,0.5571602582931519,23.465675354003906,2.454899787902832,0.00015577654,0.88,35.32,0.9816810344827587,0.00946807861328125,,,
+38447,4718592,122,957,144,-0.2025312827900052,-0.00037214502663118765,2.8222208000000038e-05,0.8443051201671892,3.7178857177495956,572,0.9806687565308255,0.05942528,0.586491048336029,23.226425170898438,1.8372563123703003,0.00016989218,0.87,34.57,0.9806687565308255,0.01074981689453125,,,
+38475,4751360,123,941,145,-0.20143762091174722,-0.0004311972043069545,2.632166400000005e-05,0.8331562167906482,4.2190627455711365,576,0.9772848034006376,0.058442240000000006,0.5668383836746216,22.646556854248047,2.3152174949645996,0.00018588582,0.82,34.44,0.9772848034006376,0.01558685302734375,,,
+38494,4784128,124,926,146,-0.20590631803497672,-0.00034813205638783984,2.442112000000001e-05,0.8347732181425486,4.296655707061291,580,0.9795491360691144,0.05745919999999999,0.5601825714111328,22.88674545288086,2.2949440479278564,0.00015240631,0.84,34.25,0.9795491360691144,0.0094451904296875,,,
+38501,4816896,125,938,147,-0.20002181455492973,-0.0003381185706530232,2.2520576000000024e-05,0.8422174840085288,4.373287037014961,584,0.9791444562899787,0.05647615999999997,0.560889482498169,23.395889282226562,2.3237521648406982,0.00012604271,0.88,35.11,0.9791444562899787,0.01004791259765625,,,
+38510,4849664,125,917,148,-0.2020286675542593,-0.0003275425151514355,2.0620032000000037e-05,0.8429661941112323,4.151972681283951,588,0.9774400218102508,0.05549311999999998,0.5637853145599365,23.155921936035156,2.0661566257476807,9.8586555e-05,0.86,35.07,0.9774400218102508,0.0088043212890625,,,
+38534,4882432,126,924,149,-0.20239027356728911,-0.000301118750940077,1.8719487999999996e-05,0.854978354978355,4.225023098289967,592,0.9812635281385281,0.05451007999999999,0.5529452562332153,23.0965576171875,2.140550136566162,0.00011990579,0.86,34.44,0.9812635281385281,0.00919342041015625,,,
+,4915200,,,,-0.20050882548093796,-0.00031225685597746633,1.681894400000001e-05,,3.7636353448033333,596,,0.05352704,0.5773522853851318,,2.0926923751831055,8.859555e-05,,,,0.0069732666015625,23.40715789794922,0.88,33.84
+38489,4915200,127,942,150,,,,0.8481953290870489,,,0.9806926751592356,,,23.235315322875977,,,0.87,35.68,0.9806926751592356,,,,
+38495,4947968,128,940,151,-0.19948635855689645,-0.00024948245845735073,1.4918400000000023e-05,0.8297872340425532,4.011311277747154,600,0.9777260638297872,0.05254399999999998,0.5725947618484497,22.675886154174805,2.116986036300659,6.651277e-05,0.83,35.11,0.9777260638297872,0.00508880615234375,,,
+38517,4980736,129,947,152,-0.20399900106713176,-0.00024179038155125454,1.3017856000000036e-05,0.8299894403379092,4.407725177705288,604,0.9770987328405492,0.05156095999999999,0.5627791881561279,23.035734176635742,2.156193494796753,5.5480006e-05,0.85,35.26,0.9770987328405492,0.00545501708984375,,,
+38526,5013504,130,923,153,-0.20467209303751588,-0.00020742984088428784,1.111731200000005e-05,0.8418201516793066,4.461376294493675,608,0.97988894907909,0.05057792,0.5521476864814758,22.865259170532227,2.205606698989868,5.8747304e-05,0.84,35.74,0.97988894907909,0.0043792724609375,,,

versions.json

@@ -0,0 +1,10 @@
+{
+  "torch": "2.14.0+cu130",
+  "gymnasium": "1.3.0",
+  "stable-baselines3": "2.9.0",
+  "sb3-contrib": "2.9.0",
+  "numpy": "2.5.2",
+  "pygame-ce": "2.5.8",
+  "git_commit": "212b78092dfcae4aa3947fb1106e7c65cc969c7c",
+  "cuda_device": "NVIDIA GeForce RTX 5070 Laptop GPU"
+}