Irfanuruchi commited on
Commit
8b012f0
·
verified ·
1 Parent(s): fb43c51

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +113 -0
README.md ADDED
@@ -0,0 +1,113 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ language:
4
+ - en
5
+ library_name: openvino
6
+ tags:
7
+ - openvino
8
+ - qwen2
9
+ - civil-engineering
10
+ - structural-engineering
11
+ - building-engineering
12
+ - text-generation
13
+ - conversational
14
+ datasets:
15
+ - Irfanuruchi/buildeng-v8-1.5b
16
+ base_model:
17
+ - Qwen/Qwen2.5-1.5B-Instruct
18
+ ---
19
+
20
+ # BuildEng 1.5B OpenVINO (INT8)
21
+
22
+ Intel optimized version of BuildEng 1.5B.
23
+
24
+ This INT8 version keeps more precision than INT4 while still staying lightweight and practical for OpenVINO inference on Intel hardware.
25
+
26
+ ## What can it help with?
27
+
28
+ - Building defects and pathology
29
+ - Reinforced concrete and masonry
30
+ - Foundation and settlement issues
31
+ - Structural inspection guidance
32
+ - Construction best practices
33
+ - Civil and building engineering Q&A
34
+
35
+ ## Important
36
+
37
+ BuildEng is an AI assistant. It should not replace professional engineering judgment, real site inspections, licensed structural assessments, or local building codes.
38
+
39
+ Use it as support, not as final authority.
40
+
41
+ ---
42
+
43
+ ## Base Model
44
+
45
+ - Qwen2.5-1.5B-Instruct
46
+
47
+ ## Fine-tuned by
48
+
49
+ - Irfan Uruçi
50
+
51
+ ---
52
+
53
+ ## Why this version?
54
+
55
+ - Higher precision than INT4
56
+ - Still small and efficient
57
+ - Good choice when quality matters more than smallest size
58
+
59
+ ---
60
+
61
+ ## Installation
62
+
63
+ ```bash
64
+ pip install "optimum-intel[openvino]" openvino transformers
65
+ ```
66
+
67
+ ## Usage
68
+
69
+ ```python
70
+ from optimum.intel.openvino import OVModelForCausalLM
71
+ from transformers import AutoTokenizer
72
+
73
+ model_id = "Irfanuruchi/qwen2.5-1.5b-buildeng-openvino-int8"
74
+
75
+ tokenizer = AutoTokenizer.from_pretrained(model_id)
76
+ model = OVModelForCausalLM.from_pretrained(model_id, device="CPU", compile=True)
77
+
78
+ messages = [
79
+ {"role": "system", "content": "You are BuildEng. Give concise, inspection-first building engineering guidance."},
80
+ {"role": "user", "content": "A homeowner reports diagonal cracks near a window corner. What should be inspected first?"}
81
+ ]
82
+
83
+ prompt = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
84
+ inputs = tokenizer(prompt, return_tensors="pt")
85
+
86
+ output = model.generate(**inputs, max_new_tokens=160, do_sample=False)
87
+ new_tokens = output[0][inputs["input_ids"].shape[-1]:]
88
+
89
+ print(tokenizer.decode(new_tokens, skip_special_tokens=True))
90
+ ```
91
+
92
+ ## Devices
93
+
94
+ - CPU
95
+ - GPU
96
+ - NPU, where supported by OpenVINO and the system
97
+
98
+ ---
99
+
100
+ ## Other Formats
101
+
102
+ | Format | Repository |
103
+ |---|---|
104
+ | Hugging Face | `Irfanuruchi/qwen2.5-1.5b-buildeng` |
105
+ | GGUF | `Irfanuruchi/qwen2.5-1.5b-buildeng-GGUF-Q4_K_M` |
106
+ | MLX 4-bit | `Irfanuruchi/qwen2.5-1.5b-buildeng-mlx-4bit` |
107
+ | MLX 8-bit | `Irfanuruchi/qwen2.5-1.5b-buildeng-mlx-8bit` |
108
+ | OpenVINO INT4 | `Irfanuruchi/qwen2.5-1.5b-buildeng-openvino-int4` |
109
+
110
+ ---
111
+
112
+ Built by **Irfan Uruçi**
113
+ Computer Engineer