Joesh1 commited on
Commit
25159d1
·
verified ·
1 Parent(s): f6328a1

Upload README.md

Browse files
Files changed (1) hide show
  1. README.md +58 -3
README.md CHANGED
@@ -34,7 +34,7 @@ For ONCA 1.5, the training emphasis was to improve all four existing task famili
34
  | Base model | `Jackrong/Qwen3.5-9B-Claude-4.6-Opus-Reasoning-Distilled` |
35
  | Architecture | Qwen3.5-class causal LM (`Qwen3_5ForCausalLM`) |
36
  | Context window | 262,144 tokens |
37
- | Training recipe | Continued SFT, no DPO |
38
  | Domain focus | Pancreatic cancer and oncology-adjacent research workflows |
39
 
40
  ## What This Release Is Good At
@@ -44,6 +44,61 @@ For ONCA 1.5, the training emphasis was to improve all four existing task famili
44
  - Structured pathology abstraction with field-oriented prompting.
45
  - Variant evidence interpretation with oncology context and uncertainty signaling.
46
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
47
  ## Release Note
48
 
49
  This is the main reference checkpoint in the ONCA 1.5 family and the best starting point if you want the least altered release.
@@ -53,7 +108,7 @@ This is the main reference checkpoint in the ONCA 1.5 family and the best starti
53
  ```python
54
  from transformers import AutoModelForCausalLM, AutoTokenizer
55
 
56
- model_id = "YOUR_USERNAME/onca-1.5"
57
 
58
  tokenizer = AutoTokenizer.from_pretrained(model_id, trust_remote_code=True)
59
  model = AutoModelForCausalLM.from_pretrained(
@@ -96,7 +151,7 @@ print(tokenizer.decode(answer, skip_special_tokens=True))
96
 
97
  ## Training Scope
98
 
99
- The active ONCA 1.5 continued-SFT stack uses openly available data only and does not use DPO. The data mixture keeps all four task families in play, with weighting geared toward variant evidence repair and trial-screening stability while guarding against pathology regression.
100
 
101
  | Task family | Active rows | Train | Val | Test |
102
  | --- | ---: | ---: | ---: | ---: |
 
34
  | Base model | `Jackrong/Qwen3.5-9B-Claude-4.6-Opus-Reasoning-Distilled` |
35
  | Architecture | Qwen3.5-class causal LM (`Qwen3_5ForCausalLM`) |
36
  | Context window | 262,144 tokens |
37
+ | Training recipe | Continued SFT |
38
  | Domain focus | Pancreatic cancer and oncology-adjacent research workflows |
39
 
40
  ## What This Release Is Good At
 
44
  - Structured pathology abstraction with field-oriented prompting.
45
  - Variant evidence interpretation with oncology context and uncertainty signaling.
46
 
47
+ ## What It Is Specialized For
48
+
49
+ This model is specialized for pancreatic cancer and oncology-adjacent research workflows rather than broad general-purpose medical chat. It works best when the task is tightly scoped and the target output format is explicit, especially for:
50
+
51
+ - pancreatic cancer trial eligibility review
52
+ - pathology report abstraction into structured fields
53
+ - concise oncology reasoning for case discussion
54
+ - variant evidence interpretation with uncertainty signaling
55
+
56
+ Example: pancreatic cancer trial-screening workflow
57
+
58
+ ```python
59
+ prompt = """
60
+ Task: Pancreatic cancer trial screening.
61
+
62
+ Patient summary:
63
+ - 63-year-old with metastatic pancreatic ductal adenocarcinoma
64
+ - ECOG 1
65
+ - Prior gemcitabine plus nab-paclitaxel
66
+ - Bilirubin 0.9 mg/dL
67
+ - No active infection
68
+
69
+ Trial criteria:
70
+ - Histologically confirmed metastatic pancreatic adenocarcinoma
71
+ - ECOG 0-1
72
+ - Progression after 1 prior systemic regimen
73
+ - Adequate marrow and hepatic function
74
+ - Exclude uncontrolled infection
75
+
76
+ Return:
77
+ 1. Eligibility label
78
+ 2. Criterion-by-criterion reasoning
79
+ 3. Missing information
80
+ """
81
+
82
+ messages = [
83
+ {"role": "system", "content": "You are Onca, a pancreatic cancer clinical research assistant."},
84
+ {"role": "user", "content": prompt},
85
+ ]
86
+ text = tokenizer.apply_chat_template(
87
+ messages,
88
+ tokenize=False,
89
+ add_generation_prompt=True,
90
+ )
91
+ inputs = tokenizer(text, return_tensors="pt").to(model.device)
92
+ outputs = model.generate(
93
+ **inputs,
94
+ max_new_tokens=256,
95
+ do_sample=False,
96
+ temperature=0.2,
97
+ )
98
+ answer = outputs[0][inputs["input_ids"].shape[1]:]
99
+ print(tokenizer.decode(answer, skip_special_tokens=True))
100
+ ```
101
+
102
  ## Release Note
103
 
104
  This is the main reference checkpoint in the ONCA 1.5 family and the best starting point if you want the least altered release.
 
108
  ```python
109
  from transformers import AutoModelForCausalLM, AutoTokenizer
110
 
111
+ model_id = "Joesh1/onca-1.5"
112
 
113
  tokenizer = AutoTokenizer.from_pretrained(model_id, trust_remote_code=True)
114
  model = AutoModelForCausalLM.from_pretrained(
 
151
 
152
  ## Training Scope
153
 
154
+ The active ONCA 1.5 continued-SFT stack uses openly available data only. The data mixture keeps all four task families in play, with weighting geared toward variant evidence repair and trial-screening stability while guarding against pathology regression.
155
 
156
  | Task family | Active rows | Train | Val | Test |
157
  | --- | ---: | ---: | ---: | ---: |