Update README.md
Browse files
README.md
CHANGED
|
@@ -8,36 +8,68 @@ tags:
|
|
| 8 |
- aphasia
|
| 9 |
- dna-regression
|
| 10 |
- nvidia-blackwell
|
|
|
|
| 11 |
datasets:
|
| 12 |
- ARC-Aphasia-Genomics
|
| 13 |
metrics:
|
| 14 |
- mse
|
|
|
|
| 15 |
---
|
| 16 |
|
| 17 |
-
#
|
|
|
|
| 18 |
|
| 19 |
[](https://huggingface.co/spaces/assix-research/stroke-recovery-analyser)
|
| 20 |
|
| 21 |
-
|
| 22 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 23 |
|
| 24 |
-
|
| 25 |
-
|
|
|
|
| 26 |
|
| 27 |
-
|
| 28 |
-
|
| 29 |
-
|
| 30 |
-
- **Training Objective:** Mean Squared Error (MSE) loss optimization for predicting WAB-AQ scores (Range: 0-100).
|
| 31 |
-
- **Input:** 1024-nucleotide genomic sequences (focused on neuroplasticity-related markers such as BDNF and COMT).
|
| 32 |
|
| 33 |
-
|
| 34 |
-
|
| 35 |
-
|
| 36 |
-
|
| 37 |
-
- **Optimization:** Gradient accumulation (steps=4) leveraging the 20-core Arm CPU for high-speed dataloading.
|
| 38 |
|
| 39 |
-
|
| 40 |
-
|
|
|
|
| 41 |
|
| 42 |
-
|
| 43 |
-
This system is a biomedical research prototype. Predictions represent statistical probabilities based on a cohort of 902 stroke cases and are intended to assist clinical decision-making, not replace it.
|
|
|
|
| 8 |
- aphasia
|
| 9 |
- dna-regression
|
| 10 |
- nvidia-blackwell
|
| 11 |
+
- neuroplasticity
|
| 12 |
datasets:
|
| 13 |
- ARC-Aphasia-Genomics
|
| 14 |
metrics:
|
| 15 |
- mse
|
| 16 |
+
- mae
|
| 17 |
---
|
| 18 |
|
| 19 |
+
# 🧬 Genomic-Transformer-Aphasia-Recovery (v1.0)
|
| 20 |
+
### *Predicting Clinical Neuroplasticity via Deep Genomic Regression*
|
| 21 |
|
| 22 |
[](https://huggingface.co/spaces/assix-research/stroke-recovery-analyser)
|
| 23 |
|
| 24 |
+
---
|
| 25 |
+
|
| 26 |
+
## 🚀 Project Overview
|
| 27 |
+
This model is a specialized **Sequence-to-Scalar Transformer** designed to predict post-stroke recovery potential. By analyzing 1024-nucleotide windows of genomic data, the model estimates a patient's **Western Aphasia Battery-Aphasia Quotient (WAB-AQ)**, providing a biological "ceiling" for language recovery.
|
| 28 |
+
|
| 29 |
+
The model serves as the **Biological Modality** in a multi-modal fusion pipeline, intended to be integrated with MRI-based lesion volumetry to create personalized 3D recovery forecasts.
|
| 30 |
+
|
| 31 |
+
|
| 32 |
+
|
| 33 |
+
## 🛠 Technical Specifications
|
| 34 |
+
- **Base Backbone:** `InstaDeepAI/nucleotide-transformer-v2-500m-multi-species`
|
| 35 |
+
- **Architecture Head:** Custom Linear Regression Head for continuous score prediction.
|
| 36 |
+
- **Input Context:** 1024 base pairs (bp) tokenized at the single-nucleotide level.
|
| 37 |
+
- **Precision:** BF16 (BFloat16) Mixed-Precision Training.
|
| 38 |
+
- **Hardware:** Fine-tuned on the **NVIDIA DGX Spark** (Grace Blackwell GB10 Architecture).
|
| 39 |
+
|
| 40 |
+
### Training Metadata
|
| 41 |
+
| Parameter | Value |
|
| 42 |
+
| :--- | :--- |
|
| 43 |
+
| **GPU Architecture** | NVIDIA Blackwell (GB10) |
|
| 44 |
+
| **Unified Memory** | 128GB LPDDR5x |
|
| 45 |
+
| **Bandwidth** | 273 GB/s |
|
| 46 |
+
| **Batch Size** | 16 (Gradient Accumulation = 4) |
|
| 47 |
+
| **Optimizer** | AdamW (Weight Decay = 0.01) |
|
| 48 |
+
|
| 49 |
+
## 📊 Dataset: ARC-Aphasia
|
| 50 |
+
The model was fine-tuned on a curated genomic subset of the **Aphasia Recovery Cohort (ARC)**, consisting of 902 subjects. The training focus was localized to genetic regions associated with neural growth factors and neurotransmitter regulation, including:
|
| 51 |
+
- **BDNF** (Brain-Derived Neurotrophic Factor)
|
| 52 |
+
- **COMT** (Catechol-O-methyltransferase)
|
| 53 |
+
- **APOE** (Apolipoprotein E)
|
| 54 |
+
|
| 55 |
+
## 🖥️ Usage & Inference
|
| 56 |
+
To run this model locally on your DGX or a compatible Blackwell environment:
|
| 57 |
|
| 58 |
+
```python
|
| 59 |
+
from transformers import AutoTokenizer, AutoModelForSequenceClassification
|
| 60 |
+
import torch
|
| 61 |
|
| 62 |
+
model_id = "assix-research/genomic-transformer-aphasia-recovery"
|
| 63 |
+
tokenizer = AutoTokenizer.from_pretrained(model_id)
|
| 64 |
+
model = AutoModelForSequenceClassification.from_pretrained(model_id, trust_remote_code=True)
|
|
|
|
|
|
|
| 65 |
|
| 66 |
+
dna_seq = "ATGC..." # 1024bp sequence
|
| 67 |
+
inputs = tokenizer(dna_seq, return_tensors="pt")
|
| 68 |
+
with torch.no_grad():
|
| 69 |
+
prediction = model(**inputs).logits.item()
|
|
|
|
| 70 |
|
| 71 |
+
print(f"Predicted WAB-AQ: {prediction:.2f}/100")
|
| 72 |
+
```
|
| 73 |
+
⚠️ Clinical Disclaimer
|
| 74 |
|
| 75 |
+
This model is a Biomedical Research Tool developed for the study of neuroplasticity. It is not an FDA-cleared diagnostic device. Predicted WAB-AQ scores are statistical estimates based on a specific research cohort and must be interpreted by a neurologist in conjunction with structural neuroimaging (MRI/DTI).
|
|
|