Robotics
Diffusers
Safetensors
LeRobot
lingbot-va
world-model
video-action
galaxea-a1
mango-placement
eef-control
Instructions to use pengyue-polaron/lingbot-va-galaxea-a1-mango-plate-eef-step-100 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use pengyue-polaron/lingbot-va-galaxea-a1-mango-plate-eef-step-100 with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("pengyue-polaron/lingbot-va-galaxea-a1-mango-plate-eef-step-100", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - LeRobot
How to use pengyue-polaron/lingbot-va-galaxea-a1-mango-plate-eef-step-100 with LeRobot:
- Notebooks
- Google Colab
- Kaggle
|
Download TRAINING.md from pengyue-polaron/lingbot-va-galaxea-a1-mango-plate-eef-step-100: direct link, hf CLI and curl.
- Browser
- Download file 752 Bytes
-
https://huggingface.co/pengyue-polaron/lingbot-va-galaxea-a1-mango-plate-eef-step-100/resolve/main/TRAINING.md
- Command line
-
hf download hf://pengyue-polaron/lingbot-va-galaxea-a1-mango-plate-eef-step-100/TRAINING.md
-
curl -L -o TRAINING.md https://huggingface.co/pengyue-polaron/lingbot-va-galaxea-a1-mango-plate-eef-step-100/resolve/main/TRAINING.md
752 Bytes
Training
| Setting | Value |
|---|---|
| Optimizer steps | 100 |
| Hardware | 2 × NVIDIA A100 |
| Distributed strategy | Full-parameter FSDP |
| Precision | bfloat16 |
| Effective global batch size | 16 |
| Optimizer | Fused AdamW |
| Learning rate | 1e-5 with 10-step warmup, then constant |
| Adam betas / weight decay | (0.9, 0.95) / 0.1 |
| Objective | Video latent loss + action loss |
Across the 100 optimizer steps, the mean video-latent loss was 0.161962 and
the mean action loss was 0.020129.
The eight source action values are mapped to LingBot-VA action channels
[0, 1, 2, 3, 4, 5, 6, 28]; channel 28 carries the gripper command. The exact
normalization statistics and model settings are included in
configs/va_a1_cfg.py.