Can you make a version for sglang?

#3
by sczhengyabin - opened

Thanks for thie very good solution for a single rtx pro 6000!!
But unfortunately the hicache support for qwen3.8 architecture on vllm is not as good as sglang.
If there is a version of SSD PLE quant for sglang would be so nice !

Sign up or log in to comment