Text Generation
Transformers
Safetensors
English
llama
raspberry-pi
gpio
embedded
structured-output
json
tiny
Eval Results (legacy)
text-generation-inference
Instructions to use AwaleSagar/gpio-llm-nano-rpi5 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use AwaleSagar/gpio-llm-nano-rpi5 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="AwaleSagar/gpio-llm-nano-rpi5")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("AwaleSagar/gpio-llm-nano-rpi5") model = AutoModelForCausalLM.from_pretrained("AwaleSagar/gpio-llm-nano-rpi5", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use AwaleSagar/gpio-llm-nano-rpi5 with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "AwaleSagar/gpio-llm-nano-rpi5" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "AwaleSagar/gpio-llm-nano-rpi5", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/AwaleSagar/gpio-llm-nano-rpi5
- SGLang
How to use AwaleSagar/gpio-llm-nano-rpi5 with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "AwaleSagar/gpio-llm-nano-rpi5" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "AwaleSagar/gpio-llm-nano-rpi5", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "AwaleSagar/gpio-llm-nano-rpi5" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "AwaleSagar/gpio-llm-nano-rpi5", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use AwaleSagar/gpio-llm-nano-rpi5 with Docker Model Runner:
docker model run hf.co/AwaleSagar/gpio-llm-nano-rpi5
File size: 7,920 Bytes
8579c16 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 | # gpiollm output grammar, built by train/build_grammar.py from 1,678,821 v2 train targets CTX op 1 CTX params@op:gpio_mode 0 CTX params@op:gpio_pwm 0 CTX params@root:ask_clarification 0 CTX params@root:gpio_mode 0 CTX params@root:gpio_pwm 0 CTX params@root:gpio_read 0 CTX params@root:gpio_write 0 CTX params@root:report_error 0 CTX root 1 ROOT root SEQ op gpio_mode action pin mode SEQ op gpio_mode action pin mode parameters SEQ op gpio_pulse action pin value duration_ms SEQ op gpio_pwm action pin duty_cycle parameters SEQ op gpio_read action pin SEQ op gpio_write action pin value SEQ op wait action duration_ms SEQ params@op:gpio_mode - drive_strength_ma SEQ params@op:gpio_mode - pull SEQ params@op:gpio_pwm - pwm_type SEQ params@root:ask_clarification - reason SEQ params@root:gpio_mode - drive_strength_ma SEQ params@root:gpio_mode - function SEQ params@root:gpio_mode - header_pin SEQ params@root:gpio_mode - pull SEQ params@root:gpio_pwm - pwm_type SEQ params@root:gpio_pwm - pwm_type frequency_hz SEQ params@root:gpio_read - header_pin SEQ params@root:gpio_write - header_pin SEQ params@root:report_error - reason SEQ params@root:report_error - reason header_pin SEQ params@root:report_error - reason requested SEQ params@root:report_error - reason requested drive_strength_ma SEQ params@root:report_error - reason requested header_pin SEQ root ask_clarification action pin parameters SEQ root gpio_mode action pin mode SEQ root gpio_mode action pin mode parameters SEQ root gpio_pulse action pin value duration_ms SEQ root gpio_pwm action pin duty_cycle parameters SEQ root gpio_read action pin SEQ root gpio_read action pin parameters SEQ root gpio_sequence action operations SEQ root gpio_write action pin value SEQ root gpio_write action pin value parameters SEQ root report_error action pin parameters SEQ root wait action duration_ms VAL op - action s 0 0 - STR op - action gpio_mode STR op - action gpio_pulse STR op - action gpio_pwm STR op - action gpio_read STR op - action gpio_write STR op - action wait VAL op gpio_mode mode s 0 0 - STR op gpio_mode mode INPUT STR op gpio_mode mode OUTPUT VAL op gpio_mode parameters o 0 0 params@op:gpio_mode VAL op gpio_mode pin n 3 0 - VAL op gpio_pulse duration_ms n 6 0 - VAL op gpio_pulse pin n 3 0 - VAL op gpio_pulse value s 0 0 - STR op gpio_pulse value HIGH VAL op gpio_pwm duty_cycle nf 3 2 - VAL op gpio_pwm parameters o 0 0 params@op:gpio_pwm VAL op gpio_pwm pin n 3 0 - VAL op gpio_read pin n 3 0 - VAL op gpio_write pin n 3 0 - VAL op gpio_write value s 0 0 - STR op gpio_write value HIGH STR op gpio_write value LOW VAL op wait duration_ms n 6 0 - VAL params@op:gpio_mode - drive_strength_ma n 3 0 - VAL params@op:gpio_mode - pull s 0 0 - STR params@op:gpio_mode - pull DOWN STR params@op:gpio_mode - pull UP VAL params@op:gpio_pwm - pwm_type s 0 0 - STR params@op:gpio_pwm - pwm_type hardware STR params@op:gpio_pwm - pwm_type software VAL params@root:ask_clarification - reason s 0 0 - STR params@root:ask_clarification - reason ambiguous_device STR params@root:ask_clarification - reason ambiguous_value STR params@root:ask_clarification - reason conflicting_instructions STR params@root:ask_clarification - reason missing_duration STR params@root:ask_clarification - reason missing_duty_cycle STR params@root:ask_clarification - reason missing_pin STR params@root:ask_clarification - reason missing_value STR params@root:ask_clarification - reason unknown_current_state VAL params@root:gpio_mode - drive_strength_ma n 3 0 - VAL params@root:gpio_mode - function s 0 0 - STR params@root:gpio_mode - function I2C1_SCL STR params@root:gpio_mode - function I2C1_SDA STR params@root:gpio_mode - function SPI0_CE0 STR params@root:gpio_mode - function SPI0_CE1 STR params@root:gpio_mode - function SPI0_MISO STR params@root:gpio_mode - function SPI0_MOSI STR params@root:gpio_mode - function SPI0_SCLK STR params@root:gpio_mode - function SPI1_CE0 STR params@root:gpio_mode - function SPI1_CE1 STR params@root:gpio_mode - function SPI1_CE2 STR params@root:gpio_mode - function SPI1_MISO STR params@root:gpio_mode - function SPI1_MOSI STR params@root:gpio_mode - function SPI1_SCLK STR params@root:gpio_mode - function UART0_RX STR params@root:gpio_mode - function UART0_TX VAL params@root:gpio_mode - header_pin n 3 0 - VAL params@root:gpio_mode - pull s 0 0 - STR params@root:gpio_mode - pull DOWN STR params@root:gpio_mode - pull NONE STR params@root:gpio_mode - pull UP VAL params@root:gpio_pwm - frequency_hz n 6 0 - VAL params@root:gpio_pwm - pwm_type s 0 0 - STR params@root:gpio_pwm - pwm_type hardware STR params@root:gpio_pwm - pwm_type software VAL params@root:gpio_read - header_pin n 3 0 - VAL params@root:gpio_write - header_pin n 3 0 - VAL params@root:report_error - drive_strength_ma n 3 0 - VAL params@root:report_error - header_pin n 3 0 - VAL params@root:report_error - reason s 0 0 - STR params@root:report_error - reason invalid_gpio STR params@root:report_error - reason invalid_parameter STR params@root:report_error - reason no_hardware_action STR params@root:report_error - reason not_a_gpio STR params@root:report_error - reason pin_not_available STR params@root:report_error - reason reserved_gpio STR params@root:report_error - reason unsafe_current STR params@root:report_error - reason unsafe_direct_drive STR params@root:report_error - reason unsafe_short_circuit STR params@root:report_error - reason unsafe_voltage STR params@root:report_error - reason unsupported_function STR params@root:report_error - reason unsupported_operation VAL params@root:report_error - requested s 0 0 - STR params@root:report_error - requested analog_input STR params@root:report_error - requested drive_strength STR params@root:report_error - requested duration STR params@root:report_error - requested duty_cycle STR params@root:report_error - requested frequency STR params@root:report_error - requested function_conflict STR params@root:report_error - requested hardware_pwm STR params@root:report_error - requested i2c STR params@root:report_error - requested i2c_scl STR params@root:report_error - requested i2c_sda STR params@root:report_error - requested led_resistor STR params@root:report_error - requested load_current STR params@root:report_error - requested output_voltage STR params@root:report_error - requested pull_down STR params@root:report_error - requested pull_none STR params@root:report_error - requested spi STR params@root:report_error - requested spi_sclk STR params@root:report_error - requested uart_rx STR params@root:report_error - requested uart_tx VAL root - action s 0 0 - STR root - action ask_clarification STR root - action gpio_mode STR root - action gpio_pulse STR root - action gpio_pwm STR root - action gpio_read STR root - action gpio_sequence STR root - action gpio_write STR root - action report_error STR root - action wait VAL root ask_clarification parameters o 0 0 params@root:ask_clarification VAL root ask_clarification pin z 0 0 - VAL root gpio_mode mode s 0 0 - STR root gpio_mode mode ALT STR root gpio_mode mode INPUT STR root gpio_mode mode OUTPUT VAL root gpio_mode parameters o 0 0 params@root:gpio_mode VAL root gpio_mode pin n 3 0 - VAL root gpio_pulse duration_ms n 7 0 - VAL root gpio_pulse pin n 3 0 - VAL root gpio_pulse value s 0 0 - STR root gpio_pulse value HIGH STR root gpio_pulse value LOW VAL root gpio_pwm duty_cycle nf 4 2 - VAL root gpio_pwm parameters o 0 0 params@root:gpio_pwm VAL root gpio_pwm pin n 3 0 - VAL root gpio_read parameters o 0 0 params@root:gpio_read VAL root gpio_read pin n 3 0 - VAL root gpio_sequence operations a 0 0 op VAL root gpio_write parameters o 0 0 params@root:gpio_write VAL root gpio_write pin n 3 0 - VAL root gpio_write value s 0 0 - STR root gpio_write value HIGH STR root gpio_write value LOW VAL root report_error parameters o 0 0 params@root:report_error VAL root report_error pin nmz 5 0 - VAL root wait duration_ms n 7 0 - |