Instructions to use agentsea/internlm-xcomposer2-4khd-7b-4bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use agentsea/internlm-xcomposer2-4khd-7b-4bit with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("feature-extraction", model="agentsea/internlm-xcomposer2-4khd-7b-4bit", trust_remote_code=True)# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("agentsea/internlm-xcomposer2-4khd-7b-4bit", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
Adding `safetensors` variant of this model
Browse filesThis is an automated PR created with https://huggingface.co/spaces/safetensors/convert
This new file is equivalent to `pytorch_model.bin` but safe in the sense that
no arbitrary code can be put into it.
These files also happen to load much faster than their pytorch counterpart:
https://colab.research.google.com/github/huggingface/notebooks/blob/main/safetensors_doc/en/speed.ipynb
The widgets on your model page will run using this model even if this is not merged
making sure the file actually works.
If you find any issues: please report here: https://huggingface.co/spaces/safetensors/convert/discussions
Feel free to ignore this PR.
model-00001-of-00004.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:0085011cb4e5680b039a40dcd3f6996bd2d79b46666e3c80d5c400dec1ac30e0
|
| 3 |
+
size 1992239240
|
model-00002-of-00004.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5b7295dea9b2709a513cd0fb8eed7fc41693007d7cbb12aaec6c30763d5cc160
|
| 3 |
+
size 1999874056
|
model-00003-of-00004.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3aba6880b7c1d5caa313b7d731e3febefcba0fd121f3d37a97b7b08951f9a026
|
| 3 |
+
size 1438062360
|
model-00004-of-00004.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:18fb85ad9b9159dd723a1c7fcb285a704f6cc04d18559d85f5275f700d777a4f
|
| 3 |
+
size 1432316008
|
model.safetensors.index.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|