Instructions to use shazzadulimun/FunctionGemma-ndp with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use shazzadulimun/FunctionGemma-ndp with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("shazzadulimun/FunctionGemma-ndp", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Unsloth Desktop
Update card refs to grc-iit/FunctionGemma-ndp
Browse files
README.md
CHANGED
|
@@ -27,7 +27,7 @@ Supports three tools: `list_organizations`, `search_datasets`,
|
|
| 27 |
```python
|
| 28 |
from transformers import AutoModelForCausalLM, AutoTokenizer
|
| 29 |
|
| 30 |
-
mid = "
|
| 31 |
tok = AutoTokenizer.from_pretrained(mid, subfolder="merged_16bit")
|
| 32 |
mdl = AutoModelForCausalLM.from_pretrained(
|
| 33 |
mid, subfolder="merged_16bit", device_map="auto",
|
|
@@ -67,7 +67,7 @@ from transformers import AutoModelForCausalLM, AutoTokenizer
|
|
| 67 |
from mcp import ClientSession, StdioServerParameters
|
| 68 |
from mcp.client.stdio import stdio_client
|
| 69 |
|
| 70 |
-
MID = "
|
| 71 |
PROMPT = "List all organizations on the NDP global server"
|
| 72 |
|
| 73 |
# 14-tool NDP catalog reshaped as OpenAI function specs (truncated here).
|
|
|
|
| 27 |
```python
|
| 28 |
from transformers import AutoModelForCausalLM, AutoTokenizer
|
| 29 |
|
| 30 |
+
mid = "grc-iit/FunctionGemma-ndp"
|
| 31 |
tok = AutoTokenizer.from_pretrained(mid, subfolder="merged_16bit")
|
| 32 |
mdl = AutoModelForCausalLM.from_pretrained(
|
| 33 |
mid, subfolder="merged_16bit", device_map="auto",
|
|
|
|
| 67 |
from mcp import ClientSession, StdioServerParameters
|
| 68 |
from mcp.client.stdio import stdio_client
|
| 69 |
|
| 70 |
+
MID = "grc-iit/FunctionGemma-ndp"
|
| 71 |
PROMPT = "List all organizations on the NDP global server"
|
| 72 |
|
| 73 |
# 14-tool NDP catalog reshaped as OpenAI function specs (truncated here).
|