Robotics
Diffusers
Safetensors
LeRobot
lingbot-va
world-model
video-action
galaxea-a1
mango-placement
eef-control
Instructions to use pengyue-polaron/lingbot-va-galaxea-a1-mango-plate-eef-step-100 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use pengyue-polaron/lingbot-va-galaxea-a1-mango-plate-eef-step-100 with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("pengyue-polaron/lingbot-va-galaxea-a1-mango-plate-eef-step-100", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - LeRobot
How to use pengyue-polaron/lingbot-va-galaxea-a1-mango-plate-eef-step-100 with LeRobot:
- Notebooks
- Google Colab
- Kaggle
|
Download TRAINING.md from pengyue-polaron/lingbot-va-galaxea-a1-mango-plate-eef-step-100: direct link, hf CLI and curl.
- Browser
- Download file 752 Bytes
-
https://huggingface.co/pengyue-polaron/lingbot-va-galaxea-a1-mango-plate-eef-step-100/resolve/main/TRAINING.md
- Command line
-
hf download hf://pengyue-polaron/lingbot-va-galaxea-a1-mango-plate-eef-step-100/TRAINING.md
-
curl -L -o TRAINING.md https://huggingface.co/pengyue-polaron/lingbot-va-galaxea-a1-mango-plate-eef-step-100/resolve/main/TRAINING.md
752 Bytes
| # Training | |
| | Setting | Value | | |
| | --- | --- | | |
| | Optimizer steps | 100 | | |
| | Hardware | 2 × NVIDIA A100 | | |
| | Distributed strategy | Full-parameter FSDP | | |
| | Precision | bfloat16 | | |
| | Effective global batch size | 16 | | |
| | Optimizer | Fused AdamW | | |
| | Learning rate | 1e-5 with 10-step warmup, then constant | | |
| | Adam betas / weight decay | (0.9, 0.95) / 0.1 | | |
| | Objective | Video latent loss + action loss | | |
| Across the 100 optimizer steps, the mean video-latent loss was `0.161962` and | |
| the mean action loss was `0.020129`. | |
| The eight source action values are mapped to LingBot-VA action channels | |
| `[0, 1, 2, 3, 4, 5, 6, 28]`; channel 28 carries the gripper command. The exact | |
| normalization statistics and model settings are included in | |
| `configs/va_a1_cfg.py`. | |