Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Hardware
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up
YuvrajSingh9886 's Collections
Non-reasoning models
Bonsai (1-bit) models
smolperfleaderboard
AndroidLife: Can LLM agents Survive a Day in your Life?
NVIDIA Jetson Orin Nano Super 8GB
GRPO Reddit Posts Summarization(LFM & Qwen)
smolcluster/ios-coreml-models
Quantized-models
Translation
SmolHub-ZeroSpaces
Fineweb Pretrained Models
TinyStories Pretrained Models
SmolLlama
SportsOri-Fine-Tuned Models

smolperfleaderboard

updated 4 days ago

Local inference benchmarks by device: tok/s, tok/J, TTFT and power under locked power modes. doi.org/10.5281/zenodo.23196838

Upvote
-

  • NVIDIA Jetson Orin Nano Super 8GB

    Collection
    Jetson Orin Nano Super 8GB. Results grouped by model family, measured at 7W / 15W / 25W / MAXN_SUPER. • 2 items • Updated 4 days ago • 1

  • Apple Mac Mini M4

    Collection
    Apple Mac Mini M4 results, MLX and llama.cpp backends. Datasets land here as they are published. • 0 items • Updated 4 days ago

  • Raspberry Pi 5

    Collection
    Raspberry Pi 5 CPU inference results. Datasets land here as they are published. • 0 items • Updated 4 days ago

  • Mobile (Android)

    Collection
    Android on-device inference results. Datasets land here as they are published. • 0 items • Updated 4 days ago

  • Tablets

    Collection
    Tablet inference results, including model-parallel sharding. Datasets land here as published. • 0 items • Updated 4 days ago
Upvote
-
  • Collection guide
  • Browse collections
Company
TOS Privacy About Careers
Website
Models Datasets Spaces Pricing Docs