SjohnU commited on
Commit
9fef306
·
verified ·
1 Parent(s): e282b78

Add r16lat_g220 (report-17 leg-gain sweep, measured 0.5/0.8/1.2)

Browse files
r16lat_g220/README.md ADDED
@@ -0,0 +1,48 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # r16lat_g220 — Report 17 leg-gain sweep (gain=220)
2
+
3
+ **SWEET SPOT of the sweep** — fastest (0.981 m/s @ cmd 1.2), nearly upright. Measured **0.981 m/s at command 1.2**.
4
+
5
+ | | |
6
+ |---|---|
7
+ | Task | `ETHRC-humanoidv1-walk-r17-g220-psu-v0` |
8
+ | Branch | `test/SjohnU_remodel_actuators` |
9
+ | Checkpoint | `model_9999.pt` (10,000 iters) |
10
+ | Envs / seed | 4096 / 42 |
11
+ | rsl-rl | 5.0.1 |
12
+ | wandb | `zywda9rf` (project rc_humanoid_rl) |
13
+ | Hardware | AWS us-east-2, 1x L40S (g6e.xlarge) |
14
+
15
+ ## Report-17 leg-gain sweep (r16-latency lineage) — measured across the command sweep
16
+
17
+ Five leg-gain points (g210..g250) off the `r16_latency` walker, each an otherwise-identical clean
18
+ ablation, 10k iters, 4096 envs, seed 42, branch `test/SjohnU_remodel_actuators`. Measured with
19
+ `scripts/rsl_rl/measure_gait.py` (1000 steps x 64 envs) at three forward commands.
20
+ **Physical m/s, not reward-term tvel.**
21
+
22
+ | leg gain | @0.5 | @0.8 | @1.2 | lean@1.2 |
23
+ |---|---|---|---|---|
24
+ | g210 | 0.365 | 0.579 | 0.708 | 3.3 deg fwd |
25
+ | **g220** | 0.414 | 0.691 | **0.981** | 1.8 deg back |
26
+ | g230 | 0.393 | 0.641 | 0.884 | 5.8 deg back |
27
+ | g240 | 0.422 | 0.648 | 0.883 | 3.5 deg back |
28
+ | g250 | 0.397 | 0.655 | 0.760 | 1.3 deg fwd |
29
+
30
+ ### Findings
31
+
32
+ 1. **g220 is the sweet spot: 0.981 m/s @ command 1.2, nearly upright (1.8 deg).** It ties the
33
+ campaign's fastest walker (`final_act`, 0.977) and has the cleanest command scaling
34
+ (0.414 -> 0.691 -> 0.981).
35
+
36
+ 2. **The gain vs speed relationship is an INVERTED-U, not monotonic.** 210 -> 220 (peak) -> 230
37
+ ~= 240 -> 250. Both softer (g210, 0.708) and stiffer (g250, 0.760) legs are slower at the top
38
+ command than g220. Stiffer is not simply better.
39
+
40
+ 3. **The effect is invisible at command 0.5.** All five cluster at 0.37-0.42 m/s there -- the
41
+ 0.5 training cap. The 29% spread (g220 0.981 vs g210 0.708) only appears at command 1.2.
42
+ A single-point measurement at 0.5 would wrongly conclude the gain does not matter; the sweep
43
+ is what surfaces it. (Same lesson as the r16 slate: measure across commands, in physical units.)
44
+
45
+ ## Files
46
+ - `policy.pt`, `policy.onnx` — exported via `scripts/rsl_rl/play_export.py`
47
+ - `deploy.yaml` — deploy config (50 Hz)
48
+ - `model_9999.pt` — raw rsl-rl checkpoint
r16lat_g220/deploy.yaml ADDED
@@ -0,0 +1,425 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ experiment_name: r16lat_g220
2
+ task: ETHRC-humanoidv1-walk-r17-g220-psu-v0
3
+ interface: lo
4
+ sim2sim: true
5
+ msg_type: go
6
+ imu_type: base_link
7
+ lowcmd_topic: rt/lowcmd
8
+ lowstate_topic: rt/lowstate
9
+ policy_path: policy.pt
10
+ num_actions: 26
11
+ action_scale: 0.25
12
+ use_default_offset: true
13
+ control_dt: 0.02
14
+ policy_rate_hz: 50.0
15
+ decimation: 4
16
+ sim_dt: 0.005
17
+ joint_names:
18
+ - waist_upperbody_yaw
19
+ - hip_central_rotation
20
+ - neck_yaw
21
+ - shoulder_flexion_l
22
+ - shoulder_flexion_r
23
+ - leg_flexion_l
24
+ - leg_flexion_r
25
+ - neck_pitch
26
+ - shoulder_abduction_l
27
+ - shoulder_abduction_r
28
+ - leg_abduction_l
29
+ - leg_abduction_r
30
+ - shoulder_rotation_l
31
+ - shoulder_rotation_r
32
+ - hip_yaw_l
33
+ - hip_yaw_r
34
+ - elbow_flexion_l
35
+ - elbow_flexion_r
36
+ - knee_l
37
+ - knee_r
38
+ - wrist_rotation_l
39
+ - wrist_rotation_r
40
+ - foot_pitch_l
41
+ - foot_pitch_r
42
+ - foot_roll_l
43
+ - foot_roll_r
44
+ joint2motor_idx:
45
+ - 0
46
+ - 1
47
+ - 2
48
+ - 3
49
+ - 4
50
+ - 5
51
+ - 6
52
+ - 7
53
+ - 8
54
+ - 9
55
+ - 10
56
+ - 11
57
+ - 12
58
+ - 13
59
+ - 14
60
+ - 15
61
+ - 16
62
+ - 17
63
+ - 18
64
+ - 19
65
+ - 20
66
+ - 21
67
+ - 22
68
+ - 23
69
+ - 24
70
+ - 25
71
+ default_angles:
72
+ - 0.0
73
+ - 0.0
74
+ - 0.0
75
+ - 0.0
76
+ - 0.0
77
+ - 0.18000000715255737
78
+ - -0.18000000715255737
79
+ - 0.0
80
+ - 0.0
81
+ - 0.0
82
+ - 0.0
83
+ - 0.0
84
+ - 0.0
85
+ - 0.0
86
+ - 0.0
87
+ - 0.0
88
+ - 0.0
89
+ - 0.0
90
+ - -0.3499999940395355
91
+ - -0.3499999940395355
92
+ - 0.0
93
+ - 0.0
94
+ - 0.18000000715255737
95
+ - 0.18000000715255737
96
+ - 0.0
97
+ - 0.0
98
+ kps:
99
+ - 213.9212646484375
100
+ - 213.9212646484375
101
+ - 38.95669937133789
102
+ - 71.63602447509766
103
+ - 71.63602447509766
104
+ - 213.9212646484375
105
+ - 213.9212646484375
106
+ - 38.95669937133789
107
+ - 71.63602447509766
108
+ - 71.63602447509766
109
+ - 213.9212646484375
110
+ - 213.9212646484375
111
+ - 38.95669937133789
112
+ - 38.95669937133789
113
+ - 213.9212646484375
114
+ - 213.9212646484375
115
+ - 38.95669937133789
116
+ - 38.95669937133789
117
+ - 213.9212646484375
118
+ - 213.9212646484375
119
+ - 38.95669937133789
120
+ - 38.95669937133789
121
+ - 37.418601989746094
122
+ - 37.418601989746094
123
+ - 37.418601989746094
124
+ - 37.418601989746094
125
+ kds:
126
+ - 25.503498077392578
127
+ - 25.503498077392578
128
+ - 0.9242613315582275
129
+ - 1.665215015411377
130
+ - 1.665215015411377
131
+ - 25.503498077392578
132
+ - 25.503498077392578
133
+ - 0.9242613315582275
134
+ - 1.665215015411377
135
+ - 1.665215015411377
136
+ - 25.503498077392578
137
+ - 25.503498077392578
138
+ - 0.9242613315582275
139
+ - 0.9242613315582275
140
+ - 25.503498077392578
141
+ - 25.503498077392578
142
+ - 0.9242613315582275
143
+ - 0.9242613315582275
144
+ - 25.503498077392578
145
+ - 25.503498077392578
146
+ - 0.9242613315582275
147
+ - 0.9242613315582275
148
+ - 1.0290013551712036
149
+ - 1.0290013551712036
150
+ - 1.0290013551712036
151
+ - 1.0290013551712036
152
+ effort_limits:
153
+ - 128.0
154
+ - 128.0
155
+ - 40.0
156
+ - 80.0
157
+ - 80.0
158
+ - 128.0
159
+ - 128.0
160
+ - 40.0
161
+ - 80.0
162
+ - 80.0
163
+ - 128.0
164
+ - 128.0
165
+ - 40.0
166
+ - 40.0
167
+ - 128.0
168
+ - 128.0
169
+ - 40.0
170
+ - 40.0
171
+ - 128.0
172
+ - 128.0
173
+ - 40.0
174
+ - 40.0
175
+ - 60.0
176
+ - 60.0
177
+ - 60.0
178
+ - 60.0
179
+ articulation_joint_names:
180
+ - waist_upperbody_yaw
181
+ - hip_central_rotation
182
+ - neck_yaw
183
+ - shoulder_flexion_l
184
+ - shoulder_flexion_r
185
+ - leg_flexion_l
186
+ - leg_flexion_r
187
+ - neck_pitch
188
+ - shoulder_abduction_l
189
+ - shoulder_abduction_r
190
+ - leg_abduction_l
191
+ - leg_abduction_r
192
+ - shoulder_rotation_l
193
+ - shoulder_rotation_r
194
+ - hip_yaw_l
195
+ - hip_yaw_r
196
+ - elbow_flexion_l
197
+ - elbow_flexion_r
198
+ - knee_l
199
+ - knee_r
200
+ - wrist_rotation_l
201
+ - wrist_rotation_r
202
+ - foot_pitch_l
203
+ - foot_pitch_r
204
+ - foot_roll_l
205
+ - foot_roll_r
206
+ articulation_default_angles:
207
+ - 0.0
208
+ - 0.0
209
+ - 0.0
210
+ - 0.0
211
+ - 0.0
212
+ - 0.18000000715255737
213
+ - -0.18000000715255737
214
+ - 0.0
215
+ - 0.0
216
+ - 0.0
217
+ - 0.0
218
+ - 0.0
219
+ - 0.0
220
+ - 0.0
221
+ - 0.0
222
+ - 0.0
223
+ - 0.0
224
+ - 0.0
225
+ - -0.3499999940395355
226
+ - -0.3499999940395355
227
+ - 0.0
228
+ - 0.0
229
+ - 0.18000000715255737
230
+ - 0.18000000715255737
231
+ - 0.0
232
+ - 0.0
233
+ pd_per_joint:
234
+ waist_upperbody_yaw:
235
+ kp: 213.9212646484375
236
+ kd: 25.503498077392578
237
+ effort_limit: 128.0
238
+ velocity_limit: 14.65999984741211
239
+ hip_central_rotation:
240
+ kp: 213.9212646484375
241
+ kd: 25.503498077392578
242
+ effort_limit: 128.0
243
+ velocity_limit: 14.65999984741211
244
+ leg_flexion_l:
245
+ kp: 213.9212646484375
246
+ kd: 25.503498077392578
247
+ effort_limit: 128.0
248
+ velocity_limit: 14.65999984741211
249
+ leg_flexion_r:
250
+ kp: 213.9212646484375
251
+ kd: 25.503498077392578
252
+ effort_limit: 128.0
253
+ velocity_limit: 14.65999984741211
254
+ leg_abduction_l:
255
+ kp: 213.9212646484375
256
+ kd: 25.503498077392578
257
+ effort_limit: 128.0
258
+ velocity_limit: 14.65999984741211
259
+ leg_abduction_r:
260
+ kp: 213.9212646484375
261
+ kd: 25.503498077392578
262
+ effort_limit: 128.0
263
+ velocity_limit: 14.65999984741211
264
+ hip_yaw_l:
265
+ kp: 213.9212646484375
266
+ kd: 25.503498077392578
267
+ effort_limit: 128.0
268
+ velocity_limit: 14.65999984741211
269
+ hip_yaw_r:
270
+ kp: 213.9212646484375
271
+ kd: 25.503498077392578
272
+ effort_limit: 128.0
273
+ velocity_limit: 14.65999984741211
274
+ knee_l:
275
+ kp: 213.9212646484375
276
+ kd: 25.503498077392578
277
+ effort_limit: 128.0
278
+ velocity_limit: 14.65999984741211
279
+ knee_r:
280
+ kp: 213.9212646484375
281
+ kd: 25.503498077392578
282
+ effort_limit: 128.0
283
+ velocity_limit: 14.65999984741211
284
+ shoulder_flexion_l:
285
+ kp: 71.63602447509766
286
+ kd: 1.665215015411377
287
+ effort_limit: 80.0
288
+ velocity_limit: 18.0
289
+ shoulder_flexion_r:
290
+ kp: 71.63602447509766
291
+ kd: 1.665215015411377
292
+ effort_limit: 80.0
293
+ velocity_limit: 18.0
294
+ shoulder_abduction_l:
295
+ kp: 71.63602447509766
296
+ kd: 1.665215015411377
297
+ effort_limit: 80.0
298
+ velocity_limit: 18.0
299
+ shoulder_abduction_r:
300
+ kp: 71.63602447509766
301
+ kd: 1.665215015411377
302
+ effort_limit: 80.0
303
+ velocity_limit: 18.0
304
+ neck_yaw:
305
+ kp: 38.95669937133789
306
+ kd: 0.9242613315582275
307
+ effort_limit: 40.0
308
+ velocity_limit: 20.0
309
+ neck_pitch:
310
+ kp: 38.95669937133789
311
+ kd: 0.9242613315582275
312
+ effort_limit: 40.0
313
+ velocity_limit: 20.0
314
+ shoulder_rotation_l:
315
+ kp: 38.95669937133789
316
+ kd: 0.9242613315582275
317
+ effort_limit: 40.0
318
+ velocity_limit: 20.0
319
+ shoulder_rotation_r:
320
+ kp: 38.95669937133789
321
+ kd: 0.9242613315582275
322
+ effort_limit: 40.0
323
+ velocity_limit: 20.0
324
+ elbow_flexion_l:
325
+ kp: 38.95669937133789
326
+ kd: 0.9242613315582275
327
+ effort_limit: 40.0
328
+ velocity_limit: 20.0
329
+ elbow_flexion_r:
330
+ kp: 38.95669937133789
331
+ kd: 0.9242613315582275
332
+ effort_limit: 40.0
333
+ velocity_limit: 20.0
334
+ wrist_rotation_l:
335
+ kp: 38.95669937133789
336
+ kd: 0.9242613315582275
337
+ effort_limit: 40.0
338
+ velocity_limit: 20.0
339
+ wrist_rotation_r:
340
+ kp: 38.95669937133789
341
+ kd: 0.9242613315582275
342
+ effort_limit: 40.0
343
+ velocity_limit: 20.0
344
+ foot_pitch_l:
345
+ kp: 37.418601989746094
346
+ kd: 1.0290013551712036
347
+ effort_limit: 60.0
348
+ velocity_limit: 50.0
349
+ foot_pitch_r:
350
+ kp: 37.418601989746094
351
+ kd: 1.0290013551712036
352
+ effort_limit: 60.0
353
+ velocity_limit: 50.0
354
+ foot_roll_l:
355
+ kp: 37.418601989746094
356
+ kd: 1.0290013551712036
357
+ effort_limit: 60.0
358
+ velocity_limit: 50.0
359
+ foot_roll_r:
360
+ kp: 37.418601989746094
361
+ kd: 1.0290013551712036
362
+ effort_limit: 60.0
363
+ velocity_limit: 50.0
364
+ obs_history_length: 5
365
+ obs_single_frame_dim: 89
366
+ obs_total_dim: 445
367
+ obs_layout:
368
+ - name: base_ang_vel
369
+ start: 0
370
+ end: 15
371
+ base_dim: 3
372
+ block_dim: 15
373
+ scale: 0.2
374
+ - name: projected_gravity
375
+ start: 15
376
+ end: 30
377
+ base_dim: 3
378
+ block_dim: 15
379
+ scale: 1.0
380
+ - name: velocity_commands
381
+ start: 30
382
+ end: 45
383
+ base_dim: 3
384
+ block_dim: 15
385
+ scale: 1.0
386
+ params:
387
+ command_name: base_velocity
388
+ - name: joint_pos_rel
389
+ start: 45
390
+ end: 175
391
+ base_dim: 26
392
+ block_dim: 130
393
+ scale: 1.0
394
+ - name: joint_vel_rel
395
+ start: 175
396
+ end: 305
397
+ base_dim: 26
398
+ block_dim: 130
399
+ scale: 0.05
400
+ - name: last_action
401
+ start: 305
402
+ end: 435
403
+ base_dim: 26
404
+ block_dim: 130
405
+ scale: 1.0
406
+ - name: gait_phase
407
+ start: 435
408
+ end: 445
409
+ base_dim: 2
410
+ block_dim: 10
411
+ scale: 1.0
412
+ params:
413
+ period: 0.6
414
+ command_name: base_velocity
415
+ command_ranges:
416
+ lin_vel_x:
417
+ - -0.1
418
+ - 0.1
419
+ lin_vel_y:
420
+ - 0.1
421
+ - 0.8
422
+ ang_vel_z:
423
+ - -0.1
424
+ - 0.1
425
+ checkpoint: /root/rc/logs/rsl_rl/humanoid_v1_locomotion/r16lat_g220/model_9999.pt
r16lat_g220/model_9999.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a512a3a43b727e4b3afaf4d1b890d07b31a212619b1ccb22edc32d7e1aeb6f7a
3
+ size 7475573
r16lat_g220/policy.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fe72c1637502cc15d906b1682e891a8b243c76e0a4311b0239c30a52d20f1c0d
3
+ size 1584867
r16lat_g220/policy.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:49046a64520152d93587dec5b47b06e3c8a9a64b4e75e0ef485eaba7bf7d11a6
3
+ size 1596822