Hugging Face's logo

CelesteImperia
/
Phi-3.5-mini-instruct-GGUF

GGUF
phi-3.5
logic-reasoning
edge-ai
celeste-imperia
conversational
Model card Files
xet
 Community
itsabhishek19 commited on
Commit
1644dfe
·
verified ·
1 Parent(s): c2a6b4a

Upload folder using huggingface_hub

Browse files
Files changed (6) hide show
  1. .gitattributes +3 -0
  2. LICENSE +22 -0
  3. Phi-3.5-mini-instruct-Q4_K_M.gguf +3 -0
  4. Phi-3.5-mini-instruct-Q8_0.gguf +3 -0
  5. Phi-3.5-mini-instruct-fp16.gguf +3 -0
  6. README.md +21 -0
.gitattributes CHANGED
@@ -33,3 +33,6 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ Phi-3.5-mini-instruct-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
37
+ Phi-3.5-mini-instruct-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Phi-3.5-mini-instruct-fp16.gguf filter=lfs diff=lfs merge=lfs -text
LICENSE ADDED
@@ -0,0 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ Microsoft.
2
+ Copyright (c) Microsoft Corporation.
3
+
4
+ MIT License
5
+
6
+ Permission is hereby granted, free of charge, to any person obtaining a copy
7
+ of this software and associated documentation files (the "Software"), to deal
8
+ in the Software without restriction, including without limitation the rights
9
+ to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
10
+ copies of the Software, and to permit persons to whom the Software is
11
+ furnished to do so, subject to the following conditions:
12
+
13
+ The above copyright notice and this permission notice shall be included in all
14
+ copies or substantial portions of the Software.
15
+
16
+ THE SOFTWARE IS PROVIDED *AS IS*, WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
17
+ IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
18
+ FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
19
+ AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
20
+ LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
21
+ OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
22
+ SOFTWARE.
Phi-3.5-mini-instruct-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9c547fc0b8ecc2ff64f11e3180e00f8ba0e823a56c591efd9f1773fe7537a526
3
+ size 2393232384
Phi-3.5-mini-instruct-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bfe6b9881e856dcb0fb33fede9b4b24c88f6a07592aa4f66568aa38d29a14153
3
+ size 4061222400
Phi-3.5-mini-instruct-fp16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dfb7f35ff9b60e406728c99bf6247454ebe51218766371e9381a995547cffba3
3
+ size 7643297280
README.md ADDED
@@ -0,0 +1,21 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ tags:
4
+ - phi-3.5
5
+ - logic-reasoning
6
+ - gguf
7
+ - edge-ai
8
+ - celeste-imperia
9
+ ---
10
+ # Celeste Imperia | Phi-3.5-mini-instruct (Optimized GGUF)
11
+
12
+ Highly-optimized GGUF weights for Microsoft's **Phi-3.5-mini**, specifically forged for high-reasoning tasks on edge hardware.
13
+
14
+ ## 🛠️ The Forge
15
+ - **Rig:** i5-11400 / RTX A4000 / 40GB RAM
16
+ - **Context:** Validated for 128k long-context execution.
17
+
18
+ ## 📂 Available Precisions
19
+ * **FP16 Master:** The full-fidelity reference file.
20
+ * **Q8_0 Professional:** Recommended for complex coding and math.
21
+ * **Q4_K_M Mobile:** Balanced performance for local agentic workflows.