deformable-bench/grasp_bag_strap_dr_v1
PiPER • Updated • 200 episodes • 459
How to use deformable-bench/lingbot-grasp-bag-strap-dr-v1 with Diffusers:
pip install -U diffusers transformers accelerate
import torch
from diffusers import DiffusionPipeline
# switch to "mps" for apple devices
pipe = DiffusionPipeline.from_pretrained("deformable-bench/lingbot-grasp-bag-strap-dr-v1", dtype=torch.bfloat16, device_map="cuda")
prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k"
image = pipe(prompt).images[0]LingBot-VA transformer fine-tuned on the
deformable-bench/grasp_bag_strap_dr_v1 dataset.
robbyant/lingbot-va-base239700e0cc56136cdc03a1d3625c1064e6fd48b9The run completed normally at step 30,000. Mean logged losses over selected windows were:
| Window | Latent | Action |
|---|---|---|
| Steps 10-100 | 0.202769 | 0.024912 |
| Steps 14,901-15,000 | 0.025104 | 0.000480 |
| Final 200 steps | 0.010343 | 0.000362 |
| Final logged step | 0.008182 | 0.000339 |
Both latent and action losses converged steadily without a late rebound.
transformer/diffusion_pytorch_model.safetensors: final transformer at step 30,000transformer/config.json: transformer architecture configurationtrain.log: complete training logOnly the fine-tuned transformer is included. The tokenizer, text encoder, and
VAE should be loaded from robbyant/lingbot-va-base.
This checkpoint is intended for research and evaluation with the matching
LingBot-VA codebase and the grasp_bag_strap_dr_v1 observation/action schema.
It has not been validated for safety-critical or out-of-distribution
deployment.
Base model
robbyant/lingbot-va-base