godqhr1421's picture
Upload GRANT_DEPLOY.md
de31aa2 verified
|
Raw
History Blame Contribute Delete
1.24 kB

ZeroGPU activation

The full Gradio implementation is already in app.py. Once ZeroGPU is attached to this Space:

  1. Change the README frontmatter from sdk: static to sdk: gradio.
  2. Set sdk_version: 6.26.0, app_file: app.py, python_version: "3.12", and startup_duration_timeout: 1h.
  3. Keep the hardware flavor set to zero-a10g. The handler requests size="xlarge" because the BF16 model is well over 56 GB.
  4. Upload the changed README and inspect build/runtime logs before calling the API.

Suggested community grant discussion title:

Apply for a GPU community grant: Personal project

Suggested description:

This public open-source research demo lets visitors explore the tool-use and stopping behavior of vcruz305/Muse-Glimmer-30B-Hermes-Agentic. It safely displays proposed tool calls without executing commands, file operations, web requests, or destructive actions, and exposes a documented Gradio API/MCP endpoint for reproducible evaluation.

The 30B BF16 checkpoint needs more than 56 GB of device memory, so the app requires a ZeroGPU xlarge allocation. The demo is educational and non-commercial, and I cannot currently cover dedicated GPU hosting costs. I am happy to provide more context if helpful.