SjohnU commited on
Commit
14baff8
·
verified ·
1 Parent(s): 47cf2b6

Add ab_baseline_scratch: scratch A/B baseline (MaxonHEJMotor), from-scratch 25k. plateau reward 9.0 (WON from scratch, stable)

Browse files
ab_baseline_scratch/deploy.yaml ADDED
@@ -0,0 +1,425 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ experiment_name: ab_baseline_scratch
2
+ task: ETHRC-humanoidv1-walk26-scratch-psu-v0
3
+ interface: lo
4
+ sim2sim: true
5
+ msg_type: go
6
+ imu_type: base_link
7
+ lowcmd_topic: rt/lowcmd
8
+ lowstate_topic: rt/lowstate
9
+ policy_path: policy.pt
10
+ num_actions: 26
11
+ action_scale: 0.25
12
+ use_default_offset: true
13
+ control_dt: 0.02
14
+ policy_rate_hz: 50.0
15
+ decimation: 4
16
+ sim_dt: 0.005
17
+ joint_names:
18
+ - waist_upperbody_yaw
19
+ - hip_central_rotation
20
+ - neck_yaw
21
+ - shoulder_flexion_l
22
+ - shoulder_flexion_r
23
+ - leg_flexion_l
24
+ - leg_flexion_r
25
+ - neck_pitch
26
+ - shoulder_abduction_l
27
+ - shoulder_abduction_r
28
+ - leg_abduction_l
29
+ - leg_abduction_r
30
+ - shoulder_rotation_l
31
+ - shoulder_rotation_r
32
+ - hip_yaw_l
33
+ - hip_yaw_r
34
+ - elbow_flexion_l
35
+ - elbow_flexion_r
36
+ - knee_l
37
+ - knee_r
38
+ - wrist_rotation_l
39
+ - wrist_rotation_r
40
+ - foot_pitch_l
41
+ - foot_pitch_r
42
+ - foot_roll_l
43
+ - foot_roll_r
44
+ joint2motor_idx:
45
+ - 0
46
+ - 1
47
+ - 2
48
+ - 3
49
+ - 4
50
+ - 5
51
+ - 6
52
+ - 7
53
+ - 8
54
+ - 9
55
+ - 10
56
+ - 11
57
+ - 12
58
+ - 13
59
+ - 14
60
+ - 15
61
+ - 16
62
+ - 17
63
+ - 18
64
+ - 19
65
+ - 20
66
+ - 21
67
+ - 22
68
+ - 23
69
+ - 24
70
+ - 25
71
+ default_angles:
72
+ - 0.0
73
+ - 0.0
74
+ - 0.0
75
+ - 0.0
76
+ - 0.0
77
+ - 0.0
78
+ - 0.0
79
+ - 0.0
80
+ - 0.0
81
+ - 0.0
82
+ - 0.0
83
+ - 0.0
84
+ - 0.0
85
+ - 0.0
86
+ - 0.0
87
+ - 0.0
88
+ - 0.0
89
+ - 0.0
90
+ - 0.0
91
+ - 0.0
92
+ - 0.0
93
+ - 0.0
94
+ - 0.0
95
+ - 0.0
96
+ - 0.0
97
+ - 0.0
98
+ kps:
99
+ - 172.35147094726562
100
+ - 172.35147094726562
101
+ - 35.557220458984375
102
+ - 69.74275207519531
103
+ - 69.74275207519531
104
+ - 172.35147094726562
105
+ - 172.35147094726562
106
+ - 35.557220458984375
107
+ - 69.74275207519531
108
+ - 69.74275207519531
109
+ - 172.35147094726562
110
+ - 172.35147094726562
111
+ - 35.557220458984375
112
+ - 35.557220458984375
113
+ - 172.35147094726562
114
+ - 172.35147094726562
115
+ - 35.557220458984375
116
+ - 35.557220458984375
117
+ - 172.35147094726562
118
+ - 172.35147094726562
119
+ - 35.557220458984375
120
+ - 35.557220458984375
121
+ - 36.63602066040039
122
+ - 36.63602066040039
123
+ - 36.63602066040039
124
+ - 36.63602066040039
125
+ kds:
126
+ - 5.072013854980469
127
+ - 5.072013854980469
128
+ - 0.8349924683570862
129
+ - 1.7447954416275024
130
+ - 1.7447954416275024
131
+ - 5.072013854980469
132
+ - 5.072013854980469
133
+ - 0.8349924683570862
134
+ - 1.7447954416275024
135
+ - 1.7447954416275024
136
+ - 5.072013854980469
137
+ - 5.072013854980469
138
+ - 0.8349924683570862
139
+ - 0.8349924683570862
140
+ - 5.072013854980469
141
+ - 5.072013854980469
142
+ - 0.8349924683570862
143
+ - 0.8349924683570862
144
+ - 5.072013854980469
145
+ - 5.072013854980469
146
+ - 0.8349924683570862
147
+ - 0.8349924683570862
148
+ - 0.9277009963989258
149
+ - 0.9277009963989258
150
+ - 0.9277009963989258
151
+ - 0.9277009963989258
152
+ effort_limits:
153
+ - 128.0
154
+ - 128.0
155
+ - 40.0
156
+ - 80.0
157
+ - 80.0
158
+ - 128.0
159
+ - 128.0
160
+ - 40.0
161
+ - 80.0
162
+ - 80.0
163
+ - 128.0
164
+ - 128.0
165
+ - 40.0
166
+ - 40.0
167
+ - 128.0
168
+ - 128.0
169
+ - 40.0
170
+ - 40.0
171
+ - 128.0
172
+ - 128.0
173
+ - 40.0
174
+ - 40.0
175
+ - 60.0
176
+ - 60.0
177
+ - 60.0
178
+ - 60.0
179
+ articulation_joint_names:
180
+ - waist_upperbody_yaw
181
+ - hip_central_rotation
182
+ - neck_yaw
183
+ - shoulder_flexion_l
184
+ - shoulder_flexion_r
185
+ - leg_flexion_l
186
+ - leg_flexion_r
187
+ - neck_pitch
188
+ - shoulder_abduction_l
189
+ - shoulder_abduction_r
190
+ - leg_abduction_l
191
+ - leg_abduction_r
192
+ - shoulder_rotation_l
193
+ - shoulder_rotation_r
194
+ - hip_yaw_l
195
+ - hip_yaw_r
196
+ - elbow_flexion_l
197
+ - elbow_flexion_r
198
+ - knee_l
199
+ - knee_r
200
+ - wrist_rotation_l
201
+ - wrist_rotation_r
202
+ - foot_pitch_l
203
+ - foot_pitch_r
204
+ - foot_roll_l
205
+ - foot_roll_r
206
+ articulation_default_angles:
207
+ - 0.0
208
+ - 0.0
209
+ - 0.0
210
+ - 0.0
211
+ - 0.0
212
+ - 0.0
213
+ - 0.0
214
+ - 0.0
215
+ - 0.0
216
+ - 0.0
217
+ - 0.0
218
+ - 0.0
219
+ - 0.0
220
+ - 0.0
221
+ - 0.0
222
+ - 0.0
223
+ - 0.0
224
+ - 0.0
225
+ - 0.0
226
+ - 0.0
227
+ - 0.0
228
+ - 0.0
229
+ - 0.0
230
+ - 0.0
231
+ - 0.0
232
+ - 0.0
233
+ pd_per_joint:
234
+ waist_upperbody_yaw:
235
+ kp: 172.35147094726562
236
+ kd: 5.072013854980469
237
+ effort_limit: 128.0
238
+ velocity_limit: 14.65999984741211
239
+ hip_central_rotation:
240
+ kp: 172.35147094726562
241
+ kd: 5.072013854980469
242
+ effort_limit: 128.0
243
+ velocity_limit: 14.65999984741211
244
+ leg_flexion_l:
245
+ kp: 172.35147094726562
246
+ kd: 5.072013854980469
247
+ effort_limit: 128.0
248
+ velocity_limit: 14.65999984741211
249
+ leg_flexion_r:
250
+ kp: 172.35147094726562
251
+ kd: 5.072013854980469
252
+ effort_limit: 128.0
253
+ velocity_limit: 14.65999984741211
254
+ leg_abduction_l:
255
+ kp: 172.35147094726562
256
+ kd: 5.072013854980469
257
+ effort_limit: 128.0
258
+ velocity_limit: 14.65999984741211
259
+ leg_abduction_r:
260
+ kp: 172.35147094726562
261
+ kd: 5.072013854980469
262
+ effort_limit: 128.0
263
+ velocity_limit: 14.65999984741211
264
+ hip_yaw_l:
265
+ kp: 172.35147094726562
266
+ kd: 5.072013854980469
267
+ effort_limit: 128.0
268
+ velocity_limit: 14.65999984741211
269
+ hip_yaw_r:
270
+ kp: 172.35147094726562
271
+ kd: 5.072013854980469
272
+ effort_limit: 128.0
273
+ velocity_limit: 14.65999984741211
274
+ knee_l:
275
+ kp: 172.35147094726562
276
+ kd: 5.072013854980469
277
+ effort_limit: 128.0
278
+ velocity_limit: 14.65999984741211
279
+ knee_r:
280
+ kp: 172.35147094726562
281
+ kd: 5.072013854980469
282
+ effort_limit: 128.0
283
+ velocity_limit: 14.65999984741211
284
+ shoulder_flexion_l:
285
+ kp: 69.74275207519531
286
+ kd: 1.7447954416275024
287
+ effort_limit: 80.0
288
+ velocity_limit: 18.0
289
+ shoulder_flexion_r:
290
+ kp: 69.74275207519531
291
+ kd: 1.7447954416275024
292
+ effort_limit: 80.0
293
+ velocity_limit: 18.0
294
+ shoulder_abduction_l:
295
+ kp: 69.74275207519531
296
+ kd: 1.7447954416275024
297
+ effort_limit: 80.0
298
+ velocity_limit: 18.0
299
+ shoulder_abduction_r:
300
+ kp: 69.74275207519531
301
+ kd: 1.7447954416275024
302
+ effort_limit: 80.0
303
+ velocity_limit: 18.0
304
+ neck_yaw:
305
+ kp: 35.557220458984375
306
+ kd: 0.8349924683570862
307
+ effort_limit: 40.0
308
+ velocity_limit: 20.0
309
+ neck_pitch:
310
+ kp: 35.557220458984375
311
+ kd: 0.8349924683570862
312
+ effort_limit: 40.0
313
+ velocity_limit: 20.0
314
+ shoulder_rotation_l:
315
+ kp: 35.557220458984375
316
+ kd: 0.8349924683570862
317
+ effort_limit: 40.0
318
+ velocity_limit: 20.0
319
+ shoulder_rotation_r:
320
+ kp: 35.557220458984375
321
+ kd: 0.8349924683570862
322
+ effort_limit: 40.0
323
+ velocity_limit: 20.0
324
+ elbow_flexion_l:
325
+ kp: 35.557220458984375
326
+ kd: 0.8349924683570862
327
+ effort_limit: 40.0
328
+ velocity_limit: 20.0
329
+ elbow_flexion_r:
330
+ kp: 35.557220458984375
331
+ kd: 0.8349924683570862
332
+ effort_limit: 40.0
333
+ velocity_limit: 20.0
334
+ wrist_rotation_l:
335
+ kp: 35.557220458984375
336
+ kd: 0.8349924683570862
337
+ effort_limit: 40.0
338
+ velocity_limit: 20.0
339
+ wrist_rotation_r:
340
+ kp: 35.557220458984375
341
+ kd: 0.8349924683570862
342
+ effort_limit: 40.0
343
+ velocity_limit: 20.0
344
+ foot_pitch_l:
345
+ kp: 36.63602066040039
346
+ kd: 0.9277009963989258
347
+ effort_limit: 60.0
348
+ velocity_limit: 50.0
349
+ foot_pitch_r:
350
+ kp: 36.63602066040039
351
+ kd: 0.9277009963989258
352
+ effort_limit: 60.0
353
+ velocity_limit: 50.0
354
+ foot_roll_l:
355
+ kp: 36.63602066040039
356
+ kd: 0.9277009963989258
357
+ effort_limit: 60.0
358
+ velocity_limit: 50.0
359
+ foot_roll_r:
360
+ kp: 36.63602066040039
361
+ kd: 0.9277009963989258
362
+ effort_limit: 60.0
363
+ velocity_limit: 50.0
364
+ obs_history_length: 5
365
+ obs_single_frame_dim: 89
366
+ obs_total_dim: 445
367
+ obs_layout:
368
+ - name: base_ang_vel
369
+ start: 0
370
+ end: 15
371
+ base_dim: 3
372
+ block_dim: 15
373
+ scale: 0.2
374
+ - name: projected_gravity
375
+ start: 15
376
+ end: 30
377
+ base_dim: 3
378
+ block_dim: 15
379
+ scale: 1.0
380
+ - name: velocity_commands
381
+ start: 30
382
+ end: 45
383
+ base_dim: 3
384
+ block_dim: 15
385
+ scale: 1.0
386
+ params:
387
+ command_name: base_velocity
388
+ - name: joint_pos_rel
389
+ start: 45
390
+ end: 175
391
+ base_dim: 26
392
+ block_dim: 130
393
+ scale: 1.0
394
+ - name: joint_vel_rel
395
+ start: 175
396
+ end: 305
397
+ base_dim: 26
398
+ block_dim: 130
399
+ scale: 0.05
400
+ - name: last_action
401
+ start: 305
402
+ end: 435
403
+ base_dim: 26
404
+ block_dim: 130
405
+ scale: 1.0
406
+ - name: gait_phase
407
+ start: 435
408
+ end: 445
409
+ base_dim: 2
410
+ block_dim: 10
411
+ scale: 1.0
412
+ params:
413
+ period: 0.6
414
+ command_name: base_velocity
415
+ command_ranges:
416
+ lin_vel_x:
417
+ - -0.1
418
+ - 0.1
419
+ lin_vel_y:
420
+ - 0.1
421
+ - 0.8
422
+ ang_vel_z:
423
+ - -0.1
424
+ - 0.1
425
+ checkpoint: /home/sjohn/Documents/project/rc_humanoid_rl_lab/logs/rsl_rl/humanoid_v1_locomotion/ab_baseline_scratch/model_24999.pt
ab_baseline_scratch/policy.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dbffa5043e1b6c19dcce330814abe8d5fd86d9f18fe52c115af490facc56a5a8
3
+ size 1584867
ab_baseline_scratch/policy.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:87c9f2a7ac6185dff2cb1bf8c0a98f162fa8bf2fbeae1c64f412eb9f55841f86
3
+ size 1596886