Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Hardware
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up

nbzy1995
/
Qwen2-0-5B-GRPO-vllm-trl

Transformers
Safetensors
Generated from Trainer
trl
grpo
Model card Files Files and versions
xet
Community

Instructions to use nbzy1995/Qwen2-0-5B-GRPO-vllm-trl with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

  • Libraries
  • Transformers

    How to use nbzy1995/Qwen2-0-5B-GRPO-vllm-trl with Transformers:

    # Load model directly
    from transformers import AutoModel
    model = AutoModel.from_pretrained("nbzy1995/Qwen2-0-5B-GRPO-vllm-trl", device_map="auto")
  • Notebooks
  • Google Colab
  • Kaggle
Qwen2-0-5B-GRPO-vllm-trl
18.1 MB
Ctrl+K
Ctrl+K
  • 1 contributor
History: 245 commits
nbzy1995's picture
nbzy1995
End of training
172b9af verified 10 months ago
  • .gitattributes
    1.57 kB
    Training in progress, step 1 10 months ago
  • README.md
    2.39 kB
    End of training 10 months ago
  • adapter_config.json
    857 Bytes
    Training in progress, step 1 10 months ago
  • adapter_model.safetensors
    2.18 MB
    xet
    Training in progress, step 452 10 months ago
  • added_tokens.json
    80 Bytes
    Training in progress, step 1 10 months ago
  • chat_template.jinja
    328 Bytes
    Training in progress, step 1 10 months ago
  • merges.txt
    1.67 MB
    Training in progress, step 1 10 months ago
  • special_tokens_map.json
    367 Bytes
    Training in progress, step 1 10 months ago
  • tokenizer.json
    11.4 MB
    xet
    Training in progress, step 1 10 months ago
  • tokenizer_config.json
    973 Bytes
    Training in progress, step 1 10 months ago
  • training_args.bin

    Detected Pickle imports (10)

    • "accelerate.utils.dataclasses.DistributedType",
    • "transformers.trainer_pt_utils.AcceleratorConfig",
    • "transformers.trainer_utils.SchedulerType",
    • "trl.trainer.grpo_config.GRPOConfig",
    • "transformers.training_args.OptimizerNames",
    • "torch.device",
    • "transformers.trainer_utils.SaveStrategy",
    • "accelerate.state.PartialState",
    • "transformers.trainer_utils.HubStrategy",
    • "transformers.trainer_utils.IntervalStrategy"

    How to fix it?

    7.19 kB
    xet
    Training in progress, step 1 10 months ago
  • vocab.json
    2.78 MB
    Training in progress, step 1 10 months ago