Prince-1 commited on
Commit
9ce6ca1
·
verified ·
1 Parent(s): 5f8f086

Add files using upload-large-folder tool

Browse files
Files changed (3) hide show
  1. .gitattributes +1 -0
  2. Gemma.rkllm +3 -0
  3. README.md +475 -0
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ Gemma.rkllm filter=lfs diff=lfs merge=lfs -text
Gemma.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a7a27e1883f79597f059f613f443c4db8432d6751f1fd3771643f8da149ec452
3
+ size 25589717382
README.md ADDED
@@ -0,0 +1,475 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model:
3
+ - unsloth/gemma-3-12b-pt
4
+ language:
5
+ - en
6
+ library_name: rkllm
7
+ license: gemma
8
+ tags:
9
+ - unsloth
10
+ - transformers
11
+ - gemma3
12
+ - gemma
13
+ - google
14
+ - rkllm
15
+ - rk3588
16
+ ---
17
+ <div>
18
+ <p style="margin-bottom: 0; margin-top: 0;">
19
+ <strong>See <a href="https://huggingface.co/collections/unsloth/gemma-3-67d12b7e8816ec6efa7e4e5b">our collection</a> for all versions of Gemma 3 including GGUF, 4-bit & 16-bit formats.</strong>
20
+ </p>
21
+ <p style="margin-bottom: 0;">
22
+ <em><a href="https://docs.unsloth.ai/basics/tutorial-how-to-run-gemma-3-effectively">Read our Guide</a> to see how to Run Gemma 3 correctly.</em>
23
+ </p>
24
+ <div style="display: flex; gap: 5px; align-items: center; ">
25
+ <a href="https://github.com/unslothai/unsloth/">
26
+ <img src="https://github.com/unslothai/unsloth/raw/main/images/unsloth%20new%20logo.png" width="133">
27
+ </a>
28
+ <a href="https://discord.gg/unsloth">
29
+ <img src="https://github.com/unslothai/unsloth/raw/main/images/Discord%20button.png" width="173">
30
+ </a>
31
+ <a href="https://docs.unsloth.ai/basics/tutorial-how-to-run-deepseek-r1-on-your-own-local-device">
32
+ <img src="https://raw.githubusercontent.com/unslothai/unsloth/refs/heads/main/images/documentation%20green%20button.png" width="143">
33
+ </a>
34
+ </div>
35
+ <h1 style="margin-top: 0rem;">✨ Fine-tune Gemma 3 with Unsloth!</h1>
36
+ </div>
37
+
38
+ - Fine-tune Gemma 3 (12B) for free using our Google [Colab notebook here](https://docs.unsloth.ai/get-started/unsloth-notebooks)!
39
+ - Read our Blog about Gemma 3 support: [unsloth.ai/blog/gemma3](https://unsloth.ai/blog/gemma3)
40
+ - View the rest of our notebooks in our [docs here](https://docs.unsloth.ai/get-started/unsloth-notebooks).
41
+ - Export your fine-tuned model to GGUF, Ollama, llama.cpp or 🤗HF.
42
+
43
+ | Unsloth supports | Free Notebooks | Performance | Memory use |
44
+ |-----------------|--------------------------------------------------------------------------------------------------------------------------|-------------|----------|
45
+ | **GRPO with Gemma 3 (12B)** | [▶️ Start on Colab](https://docs.unsloth.ai/get-started/unsloth-notebooks) | 2x faster | 80% less |
46
+ | **Llama-3.2 (3B)** | [▶️ Start on Colab](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Llama3.2_(1B_and_3B)-Conversational.ipynb) | 2.4x faster | 58% less |
47
+ | **Llama-3.2 (11B vision)** | [▶️ Start on Colab](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Llama3.2_(11B)-Vision.ipynb) | 2x faster | 60% less |
48
+ | **Qwen2.5 (7B)** | [▶️ Start on Colab](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Qwen2.5_(7B)-Alpaca.ipynb) | 2x faster | 60% less |
49
+ | **Phi-4 (14B)** | [▶️ Start on Colab](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Phi_4-Conversational.ipynb) | 2x faster | 50% less |
50
+ | **Mistral (7B)** | [▶️ Start on Colab](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Mistral_v0.3_(7B)-Conversational.ipynb) | 2.2x faster | 62% less |
51
+
52
+ <br>
53
+
54
+ # Gemma 3 model card
55
+
56
+ **Model Page**: [Gemma](https://ai.google.dev/gemma/docs/core)
57
+
58
+ **Resources and Technical Documentation**:
59
+
60
+ * [Gemma 3 Technical Report][g3-tech-report]
61
+ * [Responsible Generative AI Toolkit][rai-toolkit]
62
+ * [Gemma on Kaggle][kaggle-gemma]
63
+ * [Gemma on Vertex Model Garden][vertex-mg-gemma3]
64
+
65
+ **Terms of Use**: [Terms][terms]
66
+
67
+ **Authors**: Google DeepMind
68
+
69
+ ## Model Information
70
+
71
+ Summary description and brief definition of inputs and outputs.
72
+
73
+ ### Description
74
+
75
+ Gemma is a family of lightweight, state-of-the-art open models from Google,
76
+ built from the same research and technology used to create the Gemini models.
77
+ Gemma 3 models are multimodal, handling text and image input and generating text
78
+ output, with open weights for both pre-trained variants and instruction-tuned
79
+ variants. Gemma 3 has a large, 128K context window, multilingual support in over
80
+ 140 languages, and is available in more sizes than previous versions. Gemma 3
81
+ models are well-suited for a variety of text generation and image understanding
82
+ tasks, including question answering, summarization, and reasoning. Their
83
+ relatively small size makes it possible to deploy them in environments with
84
+ limited resources such as laptops, desktops or your own cloud infrastructure,
85
+ democratizing access to state of the art AI models and helping foster innovation
86
+ for everyone.
87
+
88
+ ### Inputs and outputs
89
+
90
+ - **Input:**
91
+ - Text string, such as a question, a prompt, or a document to be summarized
92
+ - Images, normalized to 896 x 896 resolution and encoded to 256 tokens
93
+ each
94
+ - Total input context of 128K tokens for the 4B, 12B, and 27B sizes, and
95
+ 32K tokens for the 1B size
96
+
97
+ - **Output:**
98
+ - Generated text in response to the input, such as an answer to a
99
+ question, analysis of image content, or a summary of a document
100
+ - Total output context of 8192 tokens
101
+
102
+ ### Citation
103
+
104
+ ```none
105
+ @article{gemma_2025,
106
+ title={Gemma 3},
107
+ url={https://goo.gle/Gemma3Report},
108
+ publisher={Kaggle},
109
+ author={Gemma Team},
110
+ year={2025}
111
+ }
112
+ ```
113
+
114
+ ## Model Data
115
+
116
+ Data used for model training and how the data was processed.
117
+
118
+ ### Training Dataset
119
+
120
+ These models were trained on a dataset of text data that includes a wide variety
121
+ of sources. The 27B model was trained with 14 trillion tokens, the 12B model was
122
+ trained with 12 trillion tokens, 4B model was trained with 4 trillion tokens and
123
+ 1B with 2 trillion tokens. Here are the key components:
124
+
125
+ - Web Documents: A diverse collection of web text ensures the model is
126
+ exposed to a broad range of linguistic styles, topics, and vocabulary. The
127
+ training dataset includes content in over 140 languages.
128
+ - Code: Exposing the model to code helps it to learn the syntax and
129
+ patterns of programming languages, which improves its ability to generate
130
+ code and understand code-related questions.
131
+ - Mathematics: Training on mathematical text helps the model learn logical
132
+ reasoning, symbolic representation, and to address mathematical queries.
133
+ - Images: A wide range of images enables the model to perform image
134
+ analysis and visual data extraction tasks.
135
+
136
+ The combination of these diverse data sources is crucial for training a powerful
137
+ multimodal model that can handle a wide variety of different tasks and data
138
+ formats.
139
+
140
+ ### Data Preprocessing
141
+
142
+ Here are the key data cleaning and filtering methods applied to the training
143
+ data:
144
+
145
+ - CSAM Filtering: Rigorous CSAM (Child Sexual Abuse Material) filtering
146
+ was applied at multiple stages in the data preparation process to ensure
147
+ the exclusion of harmful and illegal content.
148
+ - Sensitive Data Filtering: As part of making Gemma pre-trained models
149
+ safe and reliable, automated techniques were used to filter out certain
150
+ personal information and other sensitive data from training sets.
151
+ - Additional methods: Filtering based on content quality and safety in
152
+ line with [our policies][safety-policies].
153
+
154
+ ## Implementation Information
155
+
156
+ Details about the model internals.
157
+
158
+ ### Hardware
159
+
160
+ Gemma was trained using [Tensor Processing Unit (TPU)][tpu] hardware (TPUv4p,
161
+ TPUv5p and TPUv5e). Training vision-language models (VLMS) requires significant
162
+ computational power. TPUs, designed specifically for matrix operations common in
163
+ machine learning, offer several advantages in this domain:
164
+
165
+ - Performance: TPUs are specifically designed to handle the massive
166
+ computations involved in training VLMs. They can speed up training
167
+ considerably compared to CPUs.
168
+ - Memory: TPUs often come with large amounts of high-bandwidth memory,
169
+ allowing for the handling of large models and batch sizes during training.
170
+ This can lead to better model quality.
171
+ - Scalability: TPU Pods (large clusters of TPUs) provide a scalable
172
+ solution for handling the growing complexity of large foundation models.
173
+ You can distribute training across multiple TPU devices for faster and more
174
+ efficient processing.
175
+ - Cost-effectiveness: In many scenarios, TPUs can provide a more
176
+ cost-effective solution for training large models compared to CPU-based
177
+ infrastructure, especially when considering the time and resources saved
178
+ due to faster training.
179
+ - These advantages are aligned with
180
+ [Google's commitments to operate sustainably][sustainability].
181
+
182
+ ### Software
183
+
184
+ Training was done using [JAX][jax] and [ML Pathways][ml-pathways].
185
+
186
+ JAX allows researchers to take advantage of the latest generation of hardware,
187
+ including TPUs, for faster and more efficient training of large models. ML
188
+ Pathways is Google's latest effort to build artificially intelligent systems
189
+ capable of generalizing across multiple tasks. This is specially suitable for
190
+ foundation models, including large language models like these ones.
191
+
192
+ Together, JAX and ML Pathways are used as described in the
193
+ [paper about the Gemini family of models][gemini-2-paper]; *"the 'single
194
+ controller' programming model of Jax and Pathways allows a single Python
195
+ process to orchestrate the entire training run, dramatically simplifying the
196
+ development workflow."*
197
+
198
+ ## Evaluation
199
+
200
+ Model evaluation metrics and results.
201
+
202
+ ### Benchmark Results
203
+
204
+ These models were evaluated against a large collection of different datasets and
205
+ metrics to cover different aspects of text generation:
206
+
207
+ #### Reasoning and factuality
208
+
209
+ | Benchmark | Metric | Gemma 3 PT 1B | Gemma 3 PT 4B | Gemma 3 PT 12B | Gemma 3 PT 27B |
210
+ | ------------------------------ |----------------|:--------------:|:-------------:|:--------------:|:--------------:|
211
+ | [HellaSwag][hellaswag] | 10-shot | 62.3 | 77.2 | 84.2 | 85.6 |
212
+ | [BoolQ][boolq] | 0-shot | 63.2 | 72.3 | 78.8 | 82.4 |
213
+ | [PIQA][piqa] | 0-shot | 73.8 | 79.6 | 81.8 | 83.3 |
214
+ | [SocialIQA][socialiqa] | 0-shot | 48.9 | 51.9 | 53.4 | 54.9 |
215
+ | [TriviaQA][triviaqa] | 5-shot | 39.8 | 65.8 | 78.2 | 85.5 |
216
+ | [Natural Questions][naturalq] | 5-shot | 9.48 | 20.0 | 31.4 | 36.1 |
217
+ | [ARC-c][arc] | 25-shot | 38.4 | 56.2 | 68.9 | 70.6 |
218
+ | [ARC-e][arc] | 0-shot | 73.0 | 82.4 | 88.3 | 89.0 |
219
+ | [WinoGrande][winogrande] | 5-shot | 58.2 | 64.7 | 74.3 | 78.8 |
220
+ | [BIG-Bench Hard][bbh] | few-shot | 28.4 | 50.9 | 72.6 | 77.7 |
221
+ | [DROP][drop] | 1-shot | 42.4 | 60.1 | 72.2 | 77.2 |
222
+
223
+ [hellaswag]: https://arxiv.org/abs/1905.07830
224
+ [boolq]: https://arxiv.org/abs/1905.10044
225
+ [piqa]: https://arxiv.org/abs/1911.11641
226
+ [socialiqa]: https://arxiv.org/abs/1904.09728
227
+ [triviaqa]: https://arxiv.org/abs/1705.03551
228
+ [naturalq]: https://github.com/google-research-datasets/natural-questions
229
+ [arc]: https://arxiv.org/abs/1911.01547
230
+ [winogrande]: https://arxiv.org/abs/1907.10641
231
+ [bbh]: https://paperswithcode.com/dataset/bbh
232
+ [drop]: https://arxiv.org/abs/1903.00161
233
+
234
+ #### STEM and code
235
+
236
+ | Benchmark | Metric | Gemma 3 PT 4B | Gemma 3 PT 12B | Gemma 3 PT 27B |
237
+ | ------------------------------ |----------------|:-------------:|:--------------:|:--------------:|
238
+ | [MMLU][mmlu] | 5-shot | 59.6 | 74.5 | 78.6 |
239
+ | [MMLU][mmlu] (Pro COT) | 5-shot | 29.2 | 45.3 | 52.2 |
240
+ | [AGIEval][agieval] | 3-5-shot | 42.1 | 57.4 | 66.2 |
241
+ | [MATH][math] | 4-shot | 24.2 | 43.3 | 50.0 |
242
+ | [GSM8K][gsm8k] | 8-shot | 38.4 | 71.0 | 82.6 |
243
+ | [GPQA][gpqa] | 5-shot | 15.0 | 25.4 | 24.3 |
244
+ | [MBPP][mbpp] | 3-shot | 46.0 | 60.4 | 65.6 |
245
+ | [HumanEval][humaneval] | 0-shot | 36.0 | 45.7 | 48.8 |
246
+
247
+ [mmlu]: https://arxiv.org/abs/2009.03300
248
+ [agieval]: https://arxiv.org/abs/2304.06364
249
+ [math]: https://arxiv.org/abs/2103.03874
250
+ [gsm8k]: https://arxiv.org/abs/2110.14168
251
+ [gpqa]: https://arxiv.org/abs/2311.12022
252
+ [mbpp]: https://arxiv.org/abs/2108.07732
253
+ [humaneval]: https://arxiv.org/abs/2107.03374
254
+
255
+ #### Multilingual
256
+
257
+ | Benchmark | Gemma 3 PT 1B | Gemma 3 PT 4B | Gemma 3 PT 12B | Gemma 3 PT 27B |
258
+ | ------------------------------------ |:-------------:|:-------------:|:--------------:|:--------------:|
259
+ | [MGSM][mgsm] | 2.04 | 34.7 | 64.3 | 74.3 |
260
+ | [Global-MMLU-Lite][global-mmlu-lite] | 24.9 | 57.0 | 69.4 | 75.7 |
261
+ | [WMT24++][wmt24pp] (ChrF) | 36.7 | 48.4 | 53.9 | 55.7 |
262
+ | [FloRes][flores] | 29.5 | 39.2 | 46.0 | 48.8 |
263
+ | [XQuAD][xquad] (all) | 43.9 | 68.0 | 74.5 | 76.8 |
264
+ | [ECLeKTic][eclektic] | 4.69 | 11.0 | 17.2 | 24.4 |
265
+ | [IndicGenBench][indicgenbench] | 41.4 | 57.2 | 61.7 | 63.4 |
266
+
267
+ [mgsm]: https://arxiv.org/abs/2210.03057
268
+ [flores]: https://arxiv.org/abs/2106.03193
269
+ [xquad]: https://arxiv.org/abs/1910.11856v3
270
+ [global-mmlu-lite]: https://huggingface.co/datasets/CohereForAI/Global-MMLU-Lite
271
+ [wmt24pp]: https://arxiv.org/abs/2502.12404v1
272
+ [eclektic]: https://arxiv.org/abs/2502.21228
273
+ [indicgenbench]: https://arxiv.org/abs/2404.16816
274
+
275
+ #### Multimodal
276
+
277
+ | Benchmark | Gemma 3 PT 4B | Gemma 3 PT 12B | Gemma 3 PT 27B |
278
+ | ------------------------------ |:-------------:|:--------------:|:--------------:|
279
+ | [COCOcap][coco-cap] | 102 | 111 | 116 |
280
+ | [DocVQA][docvqa] (val) | 72.8 | 82.3 | 85.6 |
281
+ | [InfoVQA][info-vqa] (val) | 44.1 | 54.8 | 59.4 |
282
+ | [MMMU][mmmu] (pt) | 39.2 | 50.3 | 56.1 |
283
+ | [TextVQA][textvqa] (val) | 58.9 | 66.5 | 68.6 |
284
+ | [RealWorldQA][realworldqa] | 45.5 | 52.2 | 53.9 |
285
+ | [ReMI][remi] | 27.3 | 38.5 | 44.8 |
286
+ | [AI2D][ai2d] | 63.2 | 75.2 | 79.0 |
287
+ | [ChartQA][chartqa] | 63.6 | 74.7 | 76.3 |
288
+ | [VQAv2][vqav2] | 63.9 | 71.2 | 72.9 |
289
+ | [BLINK][blinkvqa] | 38.0 | 35.9 | 39.6 |
290
+ | [OKVQA][okvqa] | 51.0 | 58.7 | 60.2 |
291
+ | [TallyQA][tallyqa] | 42.5 | 51.8 | 54.3 |
292
+ | [SpatialSense VQA][ss-vqa] | 50.9 | 60.0 | 59.4 |
293
+ | [CountBenchQA][countbenchqa] | 26.1 | 17.8 | 68.0 |
294
+
295
+ [coco-cap]: https://cocodataset.org/#home
296
+ [docvqa]: https://www.docvqa.org/
297
+ [info-vqa]: https://arxiv.org/abs/2104.12756
298
+ [mmmu]: https://arxiv.org/abs/2311.16502
299
+ [textvqa]: https://textvqa.org/
300
+ [realworldqa]: https://paperswithcode.com/dataset/realworldqa
301
+ [remi]: https://arxiv.org/html/2406.09175v1
302
+ [ai2d]: https://allenai.org/data/diagrams
303
+ [chartqa]: https://arxiv.org/abs/2203.10244
304
+ [vqav2]: https://visualqa.org/index.html
305
+ [blinkvqa]: https://arxiv.org/abs/2404.12390
306
+ [okvqa]: https://okvqa.allenai.org/
307
+ [tallyqa]: https://arxiv.org/abs/1810.12440
308
+ [ss-vqa]: https://arxiv.org/abs/1908.02660
309
+ [countbenchqa]: https://github.com/google-research/big_vision/blob/main/big_vision/datasets/countbenchqa/
310
+
311
+ ## Ethics and Safety
312
+
313
+ Ethics and safety evaluation approach and results.
314
+
315
+ ### Evaluation Approach
316
+
317
+ Our evaluation methods include structured evaluations and internal red-teaming
318
+ testing of relevant content policies. Red-teaming was conducted by a number of
319
+ different teams, each with different goals and human evaluation metrics. These
320
+ models were evaluated against a number of different categories relevant to
321
+ ethics and safety, including:
322
+
323
+ - **Child Safety**: Evaluation of text-to-text and image to text prompts
324
+ covering child safety policies, including child sexual abuse and
325
+ exploitation.
326
+ - **Content Safety:** Evaluation of text-to-text and image to text prompts
327
+ covering safety policies including, harassment, violence and gore, and hate
328
+ speech.
329
+ - **Representational Harms**: Evaluation of text-to-text and image to text
330
+ prompts covering safety policies including bias, stereotyping, and harmful
331
+ associations or inaccuracies.
332
+
333
+ In addition to development level evaluations, we conduct "assurance
334
+ evaluations" which are our 'arms-length' internal evaluations for responsibility
335
+ governance decision making. They are conducted separately from the model
336
+ development team, to inform decision making about release. High level findings
337
+ are fed back to the model team, but prompt sets are held-out to prevent
338
+ overfitting and preserve the results' ability to inform decision making.
339
+ Assurance evaluation results are reported to our Responsibility & Safety Council
340
+ as part of release review.
341
+
342
+ ### Evaluation Results
343
+
344
+ For all areas of safety testing, we saw major improvements in the categories of
345
+ child safety, content safety, and representational harms relative to previous
346
+ Gemma models. All testing was conducted without safety filters to evaluate the
347
+ model capabilities and behaviors. For both text-to-text and image-to-text, and
348
+ across all model sizes, the model produced minimal policy violations, and showed
349
+ significant improvements over previous Gemma models' performance with respect
350
+ to ungrounded inferences. A limitation of our evaluations was they included only
351
+ English language prompts.
352
+
353
+ ## Usage and Limitations
354
+
355
+ These models have certain limitations that users should be aware of.
356
+
357
+ ### Intended Usage
358
+
359
+ Open vision-language models (VLMs) models have a wide range of applications
360
+ across various industries and domains. The following list of potential uses is
361
+ not comprehensive. The purpose of this list is to provide contextual information
362
+ about the possible use-cases that the model creators considered as part of model
363
+ training and development.
364
+
365
+ - Content Creation and Communication
366
+ - Text Generation: These models can be used to generate creative text
367
+ formats such as poems, scripts, code, marketing copy, and email drafts.
368
+ - Chatbots and Conversational AI: Power conversational interfaces
369
+ for customer service, virtual assistants, or interactive applications.
370
+ - Text Summarization: Generate concise summaries of a text corpus,
371
+ research papers, or reports.
372
+ - Image Data Extraction: These models can be used to extract,
373
+ interpret, and summarize visual data for text communications.
374
+ - Research and Education
375
+ - Natural Language Processing (NLP) and VLM Research: These
376
+ models can serve as a foundation for researchers to experiment with VLM
377
+ and NLP techniques, develop algorithms, and contribute to the
378
+ advancement of the field.
379
+ - Language Learning Tools: Support interactive language learning
380
+ experiences, aiding in grammar correction or providing writing practice.
381
+ - Knowledge Exploration: Assist researchers in exploring large
382
+ bodies of text by generating summaries or answering questions about
383
+ specific topics.
384
+
385
+ ### Limitations
386
+
387
+ - Training Data
388
+ - The quality and diversity of the training data significantly
389
+ influence the model's capabilities. Biases or gaps in the training data
390
+ can lead to limitations in the model's responses.
391
+ - The scope of the training dataset determines the subject areas
392
+ the model can handle effectively.
393
+ - Context and Task Complexity
394
+ - Models are better at tasks that can be framed with clear
395
+ prompts and instructions. Open-ended or highly complex tasks might be
396
+ challenging.
397
+ - A model's performance can be influenced by the amount of context
398
+ provided (longer context generally leads to better outputs, up to a
399
+ certain point).
400
+ - Language Ambiguity and Nuance
401
+ - Natural language is inherently complex. Models might struggle
402
+ to grasp subtle nuances, sarcasm, or figurative language.
403
+ - Factual Accuracy
404
+ - Models generate responses based on information they learned
405
+ from their training datasets, but they are not knowledge bases. They
406
+ may generate incorrect or outdated factual statements.
407
+ - Common Sense
408
+ - Models rely on statistical patterns in language. They might
409
+ lack the ability to apply common sense reasoning in certain situations.
410
+
411
+ ### Ethical Considerations and Risks
412
+
413
+ The development of vision-language models (VLMs) raises several ethical
414
+ concerns. In creating an open model, we have carefully considered the following:
415
+
416
+ - Bias and Fairness
417
+ - VLMs trained on large-scale, real-world text and image data can
418
+ reflect socio-cultural biases embedded in the training material. These
419
+ models underwent careful scrutiny, input data pre-processing described
420
+ and posterior evaluations reported in this card.
421
+ - Misinformation and Misuse
422
+ - VLMs can be misused to generate text that is false, misleading,
423
+ or harmful.
424
+ - Guidelines are provided for responsible use with the model, see the
425
+ [Responsible Generative AI Toolkit][rai-toolkit].
426
+ - Transparency and Accountability:
427
+ - This model card summarizes details on the models' architecture,
428
+ capabilities, limitations, and evaluation processes.
429
+ - A responsibly developed open model offers the opportunity to
430
+ share innovation by making VLM technology accessible to developers and
431
+ researchers across the AI ecosystem.
432
+
433
+ Risks identified and mitigations:
434
+
435
+ - **Perpetuation of biases**: It's encouraged to perform continuous
436
+ monitoring (using evaluation metrics, human review) and the exploration of
437
+ de-biasing techniques during model training, fine-tuning, and other use
438
+ cases.
439
+ - **Generation of harmful content**: Mechanisms and guidelines for content
440
+ safety are essential. Developers are encouraged to exercise caution and
441
+ implement appropriate content safety safeguards based on their specific
442
+ product policies and application use cases.
443
+ - **Misuse for malicious purposes**: Technical limitations and developer
444
+ and end-user education can help mitigate against malicious applications of
445
+ VLMs. Educational resources and reporting mechanisms for users to flag
446
+ misuse are provided. Prohibited uses of Gemma models are outlined in the
447
+ [Gemma Prohibited Use Policy][prohibited-use].
448
+ - **Privacy violations**: Models were trained on data filtered for removal
449
+ of certain personal information and other sensitive data. Developers are
450
+ encouraged to adhere to privacy regulations with privacy-preserving
451
+ techniques.
452
+
453
+ ### Benefits
454
+
455
+ At the time of release, this family of models provides high-performance open
456
+ vision-language model implementations designed from the ground up for
457
+ responsible AI development compared to similarly sized models.
458
+
459
+ Using the benchmark evaluation metrics described in this document, these models
460
+ have shown to provide superior performance to other, comparably-sized open model
461
+ alternatives.
462
+
463
+ [g3-tech-report]: https://goo.gle/Gemma3Report
464
+ [rai-toolkit]: https://ai.google.dev/responsible
465
+ [kaggle-gemma]: https://www.kaggle.com/models/google/gemma-3
466
+ [vertex-mg-gemma3]: https://console.cloud.google.com/vertex-ai/publishers/google/model-garden/gemma3
467
+ [terms]: https://ai.google.dev/gemma/terms
468
+ [safety-policies]: https://ai.google/static/documents/ai-responsibility-update-published-february-2025.pdf
469
+ [prohibited-use]: https://ai.google.dev/gemma/prohibited_use_policy
470
+ [tpu]: https://cloud.google.com/tpu/docs/intro-to-tpu
471
+ [sustainability]: https://sustainability.google/operating-sustainably/
472
+ [jax]: https://github.com/jax-ml/jax
473
+ [ml-pathways]: https://blog.google/technology/ai/introducing-pathways-next-generation-ai-architecture/
474
+ [sustainability]: https://sustainability.google/operating-sustainably/
475
+ [gemini-2-paper]: https://arxiv.org/abs/2312.11805