Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Hardware
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up
Abhishek Shakya's picture

Abhishek Shakya

EngineerReversed
4

AI & ML interests

None yet

Recent Activity

new activity 30 days ago
prism-ml/Ternary-Bonsai-27B-gguf:Prefix reuse works with the mmproj loaded - the launcher flags disable it (102s -> 0.14s on a 178k prompt, upstream llama.cpp)
new activity 30 days ago
prism-ml/Ternary-Bonsai-27B-gguf:Documenting what each GGUF file does
new activity 30 days ago
prism-ml/Ternary-Bonsai-27B-gguf:how to partially fix t/s speed generation and partially unlock Dspark full speed capabilities
View all activity

Organizations

None yet

New activity in prism-ml/Ternary-Bonsai-27B-gguf 30 days ago

Prefix reuse works with the mmproj loaded - the launcher flags disable it (102s -> 0.14s on a 178k prompt, upstream llama.cpp)

#49 opened 30 days ago by
EngineerReversed

Documenting what each GGUF file does

👍 10
2
#10 opened about 2 months ago by
croqaz

how to partially fix t/s speed generation and partially unlock Dspark full speed capabilities

2
#40 opened about 2 months ago by
LinkuStarto

Unable to get D-Spark Q4_1 working with Q2_0 Model file

9
#11 opened about 2 months ago by
AceTheUnfazed
Company
TOS Privacy About Careers
Website
Models Datasets Spaces Pricing Docs