Instructions to use Polygl0t/Tucano2-qwen-1.5B-Think with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use Polygl0t/Tucano2-qwen-1.5B-Think with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="Polygl0t/Tucano2-qwen-1.5B-Think")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("Polygl0t/Tucano2-qwen-1.5B-Think")
model = AutoModelForCausalLM.from_pretrained("Polygl0t/Tucano2-qwen-1.5B-Think", device_map="auto")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Inference
Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use Polygl0t/Tucano2-qwen-1.5B-Think with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "Polygl0t/Tucano2-qwen-1.5B-Think"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Polygl0t/Tucano2-qwen-1.5B-Think",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/Polygl0t/Tucano2-qwen-1.5B-Think

SGLang

How to use Polygl0t/Tucano2-qwen-1.5B-Think with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "Polygl0t/Tucano2-qwen-1.5B-Think" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Polygl0t/Tucano2-qwen-1.5B-Think",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "Polygl0t/Tucano2-qwen-1.5B-Think" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Polygl0t/Tucano2-qwen-1.5B-Think",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use Polygl0t/Tucano2-qwen-1.5B-Think with Docker Model Runner:
```
docker model run hf.co/Polygl0t/Tucano2-qwen-1.5B-Think
```

nicholasKluge commited on Feb 7

Commit

4070029

verified ·

1 Parent(s): a4546d6

Update README.md

Browse files

Files changed (1) hide show

README.md +22 -22

README.md CHANGED Viewed

@@ -524,28 +524,28 @@ The table below compares the Tucano2 series against other base models of similar
 </details>
-|                            | Aggregate NPM | NPM Easy | NPM Hard | NPM Instruction | BLUEX  | ENEM   | OAB    | ARC Challenge | BELEBELE | CALAME | Global PIQA | HellaSwag | LAMBADA | MMLU   | IFEval-PT (prompt) | IFEval-PT (instruction) | GSM8K-PT (flex) |
-| -------------------------- | ------------- | -------- | -------- | --------------- | ------ | ------ | ------ | ------------- | -------- | ------ | ----------- | --------- | ------- | ------ | ------------------ | ----------------------- | --------------- |
-| Qwen2.5-7B-Instruct        | 58.9618       | 50.3498  | 59.372   | 72.6316         | 0.6579 | 0.739  | 0.5276 | 0.4957        | 0.88     | 0.4976 | 0.78        | 0.6419    | 0.6097  | 0.6447 | 0.7533             | 0.8023                  | 0.6233          |
-| Jurema-7B                  | 54.6559       | 58.1519  | 57.5188  | 44.0576         | 0.6342 | 0.7096 | 0.6497 | 0.5256        | 0.8844   | 0.6469 | 0.79        | 0.6732    | 0.7489  | 0.4991 | 0.47               | 0.5488                  | 0.3029          |
-| Gemma-3-Gaia-PT-BR-4b-it   | 51.6711       | 49.6677  | 44.8169  | 66.4338         | 0.509  | 0.6452 | 0.4346 | 0.547         | 0.7889   | 0.5188 | 0.77        | 0.6221    | 0.5325  | 0.5149 | 0.7033             | 0.7767                  | 0.5129          |
-| SmolLM3-3B                 | 50.9191       | 51.1554  | 43.3707  | 63.1058         | 0.4868 | 0.6088 | 0.4223 | 0.5282        | 0.7844   | 0.604  | 0.71        | 0.6316    | 0.654   | 0.533  | 0.69               | 0.7488                  | 0.4543          |
-| Tucano2-qwen-3.7B-Think    | 49.9686       | 52.8665  | 51.8393  | 42.0208         | 0.5341 | 0.6298 | 0.5376 | 0.547         | 0.8433   | 0.5467 | 0.81        | 0.6568    | 0.5381  | 0.611  | 0.3033             | 0.4116                  | 0.5457          |
-| Qwen2.5-3B-Instruct        | 47.913        | 36.0891  | 51.4375  | 61.7453         | 0.5688 | 0.6865 | 0.4679 | 0.4171        | 0.84     | 0.4576 | 0.67        | 0.5844    | 0.3382  | 0.5822 | 0.6333             | 0.7                     | 0.519           |
-| Qwen2.5-1.5B-Instruct      | 43.2133       | 41.4916  | 43.9841  | 44.798          | 0.5202 | 0.6179 | 0.4428 | 0.3974        | 0.76     | 0.5674 | 0.69        | 0.5021    | 0.5944  | 0.5191 | 0.42               | 0.5023                  | 0.4216          |
-| Tucano2-qwen-1.5B-Instruct | 42.6073       | 45.8889  | 44.779   | 33.5186         | 0.5285 | 0.627  | 0.4342 | 0.5026        | 0.7756   | 0.5438 | 0.71        | 0.5525    | 0.5905  | 0.5254 | 0.3433             | 0.4651                  | 0.1971          |
-| Llama-3.2-3B-Instruct      | 39.8516       | 21.7714  | 44.243   | 62.6661         | 0.5202 | 0.5913 | 0.4497 | 0.4393        | 0.7856   | 0.0039 | 0.71        | 0.5583    | 0.0012  | 0.5214 | 0.6267             | 0.7023                  | 0.551           |
-| Tucano2-qwen-1.5B-Think    | 30.0924       | 29.9038  | 28.0136  | 33.8713         | 0.3922 | 0.3989 | 0.3426 | 0.4282        | 0.6767   | 0.1113 | 0.74        | 0.5495    | 0.267   | 0.433  | 0.3367             | 0.4512                  | 0.2283          |
-| Qwen3-1.7B                 | 29.8345       | 9.679    | 34.8513  | 55.0655         | 0.541  | 0.606  | 0.4159 | 0.3667        | 0.6489   | 0.0014 | 0.56        | 0.4045    | 0.001   | 0.3056 | 0.65               | 0.7326                  | 0.2694          |
-| Tucano2-qwen-0.5B-Instruct | 29.7779       | 27.8097  | 31.5423  | 30.1179         | 0.4033 | 0.536  | 0.4073 | 0.3863        | 0.6233   | 0.3001 | 0.62        | 0.4783    | 0.3643  | 0.4146 | 0.3                | 0.4186                  | 0.1849          |
-| Qwen3-0.6B                 | 29.6678       | 19.0508  | 27.963   | 50.2042         | 0.4061 | 0.4591 | 0.3604 | 0.3239        | 0.6089   | 0.3931 | 0.49        | 0.372     | 0.3183  | 0.4112 | 0.55               | 0.6395                  | 0.3166          |
-| Qwen3-4B                   | 23.1764       | 16.489   | 2.3256   | 69.0736         | 0.0682 | 0.0602 | 0.0141 | 0.4308        | 0.8367   | 0.0048 | 0.65        | 0.4587    | 0.0004  | 0.2693 | 0.81               | 0.8558                  | 0.4064          |
-| Qwen2.5-0.5B-Instruct      | 21.4918       | 20.9421  | 17.3804  | 29.2603         | 0.3018 | 0.3408 | 0.2934 | 0.2744        | 0.5067   | 0.4576 | 0.5         | 0.3774    | 0.3872  | 0.3954 | 0.31               | 0.4209                  | 0.1469          |
-| Tucano2-qwen-0.5B-Think    | 19.2755       | 21.2555  | 12.5445  | 27.1936         | 0.3449 | 0.3198 | 0.2702 | 0.3274        | 0.3611   | 0.0949 | 0.68        | 0.4721    | 0.2086  | 0.3608 | 0.2767             | 0.393                   | 0.1461          |
-| Llama-3.2-1B-Instruct      | 17.9105       | 6.8658   | 14.1275  | 42.6234         | 0.3004 | 0.3401 | 0.3084 | 0.3282        | 0.4156   | 0.0092 | 0.49        | 0.4362    | 0.0016  | 0.3515 | 0.4433             | 0.5698                  | 0.2656          |
-| Tucano-2b4-Instruct        | 9.3564        | 14.456   | 1.5293   | 13.902          | 0.2587 | 0.2001 | 0.2674 | 0.3197        | 0.24     | 0.0048 | 0.67        | 0.4635    | 0.0004  | 0.2672 | 0.15               | 0.2465                  | 0.0205          |
-| Tucano-1b1-Instruct        | 7.7272        | 12.0267  | 0.3183   | 12.9095         | 0.2295 | 0.1994 | 0.2533 | 0.3           | 0.2489   | 0      | 0.64        | 0.441     | 0       | 0.2559 | 0.1333             | 0.2372                  | 0.0167          |
-| TeenyTinyLlama-460m-Chat   | 3.9618        | 6.58     | -3.25    | 11.6177         | 0.1725 | 0.1819 | 0.1973 | 0.2684        | 0.2289   | 0      | 0.59        | 0.3434    | 0       | 0.2697 | 0.1233             | 0.2047                  | 0.0205          |
 <details>
 <summary><b>Performance Comparison</b></summary>

 </details>
+|                            | Aggregate NPM | NPM Easy | NPM Hard | NPM Instruction | BLUEX | ENEM  | OAB   | ARC Challenge | BELEBELE | CALAME | Global PIQA | HellaSwag | LAMBADA | MMLU  | IFEval-PT (prompt) | IFEval-PT (instruction) | GSM8K-PT (flex) |
+| -------------------------- | ------------- | -------- | -------- | --------------- | ----- | ----- | ----- | ------------- | -------- | ------ | ----------- | --------- | ------- | ----- | ------------------ | ----------------------- | --------------- |
+| Qwen2.5-7B-Instruct        | 58.96         | 50.35    | 59.37    | 72.63           | 65.79 | 73.9  | 52.76 | 49.57         | 88       | 49.76  | 78          | 64.19     | 60.97   | 64.47 | 75.33              | 80.23                   | 62.33           |
+| Jurema-7B                  | 54.66         | 58.15    | 57.52    | 44.06           | 63.42 | 70.96 | 64.97 | 52.56         | 88.44    | 64.69  | 79          | 67.32     | 74.89   | 49.91 | 47                 | 54.88                   | 30.29           |
+| Tucano2-qwen-3.7B-Think    | 52.62         | 54.31    | 56.26    | 43.72           | 63    | 71.52 | 53.76 | 55.38         | 83.56    | 56.45  | 82          | 65.21     | 56.96   | 61.18 | 31.67              | 42.79                   | 56.7            |
+| Gemma-3-Gaia-PT-BR-4b-it   | 51.67         | 49.67    | 44.82    | 66.43           | 50.9  | 64.52 | 43.46 | 54.7          | 78.89    | 51.88  | 77          | 62.21     | 53.25   | 51.49 | 70.33              | 77.67                   | 51.29           |
+| SmolLM3-3B                 | 50.92         | 51.16    | 43.37    | 63.11           | 48.68 | 60.88 | 42.23 | 52.82         | 78.44    | 60.4   | 71          | 63.16     | 65.4    | 53.3  | 69                 | 74.88                   | 45.43           |
+| Qwen2.5-3B-Instruct        | 47.91         | 36.09    | 51.44    | 61.75           | 56.88 | 68.65 | 46.79 | 41.71         | 84       | 45.76  | 67          | 58.44     | 33.82   | 58.22 | 63.33              | 70                      | 51.9            |
+| Qwen2.5-1.5B-Instruct      | 43.21         | 41.49    | 43.98    | 44.8            | 52.02 | 61.79 | 44.28 | 39.74         | 76       | 56.74  | 69          | 50.21     | 59.44   | 51.91 | 42                 | 50.23                   | 42.16           |
+| Tucano2-qwen-1.5B-Instruct | 42.61         | 45.89    | 44.78    | 33.52           | 52.85 | 62.7  | 43.42 | 50.26         | 77.56    | 54.38  | 71          | 55.25     | 59.05   | 52.54 | 34.33              | 46.51                   | 19.71           |
+| Llama-3.2-3B-Instruct      | 39.85         | 21.77    | 44.24    | 62.67           | 52.02 | 59.13 | 44.97 | 43.93         | 78.56    | 0.39   | 71          | 55.83     | 0.12    | 52.14 | 62.67              | 70.23                   | 55.1            |
+| Tucano2-qwen-1.5B-Think    | 30.09         | 29.9     | 28.01    | 33.87           | 39.22 | 39.89 | 34.26 | 42.82         | 67.67    | 11.13  | 74          | 54.95     | 26.7    | 43.3  | 33.67              | 45.12                   | 22.83           |
+| Qwen3-1.7B                 | 29.83         | 9.68     | 34.85    | 55.07           | 54.1  | 60.6  | 41.59 | 36.67         | 64.89    | 0.14   | 56          | 40.45     | 0.1     | 30.56 | 65                 | 73.26                   | 26.94           |
+| Tucano2-qwen-0.5B-Instruct | 29.78         | 27.81    | 31.54    | 30.12           | 40.33 | 53.6  | 40.73 | 38.63         | 62.33    | 30.01  | 62          | 47.83     | 36.43   | 41.46 | 30                 | 41.86                   | 18.49           |
+| Qwen3-0.6B                 | 29.67         | 19.05    | 27.96    | 50.2            | 40.61 | 45.91 | 36.04 | 32.39         | 60.89    | 39.31  | 49          | 37.2      | 31.83   | 41.12 | 55                 | 63.95                   | 31.66           |
+| Qwen3-4B                   | 23.18         | 16.49    | 2.33     | 69.07           | 6.82  | 6.02  | 1.41  | 43.08         | 83.67    | 0.48   | 65          | 45.87     | 0.04    | 26.93 | 81                 | 85.58                   | 40.64           |
+| Qwen2.5-0.5B-Instruct      | 21.49         | 20.94    | 17.38    | 29.26           | 30.18 | 34.08 | 29.34 | 27.44         | 50.67    | 45.76  | 50          | 37.74     | 38.72   | 39.54 | 31                 | 42.09                   | 14.69           |
+| Tucano2-qwen-0.5B-Think    | 19.28         | 21.26    | 12.54    | 27.19           | 34.49 | 31.98 | 27.02 | 32.74         | 36.11    | 9.49   | 68          | 47.21     | 20.86   | 36.08 | 27.67              | 39.3                    | 14.61           |
+| Llama-3.2-1B-Instruct      | 17.91         | 6.87     | 14.13    | 42.62           | 30.04 | 34.01 | 30.84 | 32.82         | 41.56    | 0.92   | 49          | 43.62     | 0.16    | 35.15 | 44.33              | 56.98                   | 26.56           |
+| Tucano-2b4-Instruct        | 9.36          | 14.46    | 1.53     | 13.9            | 25.87 | 20.01 | 26.74 | 31.97         | 24       | 0.48   | 67          | 46.35     | 0.04    | 26.72 | 15                 | 24.65                   | 2.05            |
+| Tucano-1b1-Instruct        | 7.73          | 12.03    | 0.32     | 12.91           | 22.95 | 19.94 | 25.33 | 30            | 24.89    | 0      | 64          | 44.1      | 0       | 25.59 | 13.33              | 23.72                   | 1.67            |
+| TeenyTinyLlama-460m-Chat   | 3.96          | 6.58     | -3.25    | 11.62           | 17.25 | 18.19 | 19.73 | 26.84         | 22.89    | 0      | 59          | 34.34     | 0       | 26.97 | 12.33              | 20.47                   | 2.05            |
 <details>
 <summary><b>Performance Comparison</b></summary>