assix-research commited on
Commit
1e385fe
·
verified ·
1 Parent(s): 21ebdff

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +51 -19
README.md CHANGED
@@ -8,36 +8,68 @@ tags:
8
  - aphasia
9
  - dna-regression
10
  - nvidia-blackwell
 
11
  datasets:
12
  - ARC-Aphasia-Genomics
13
  metrics:
14
  - mse
 
15
  ---
16
 
17
- # Aphasia Recovery Potential Model (Genomic Modality v1.0)
 
18
 
19
  [![Hugging Face Spaces](https://img.shields.io/badge/%F0%9F%A4%97%20Hugging%20Face-Spaces-blue)](https://huggingface.co/spaces/assix-research/stroke-recovery-analyser)
20
 
21
- ## 🚀 Live Demo
22
- **Interactive Analysis:** Test genomic sequences and view recovery forecasts at the [Stroke-Recovery-Analyser](https://huggingface.co/spaces/assix-research/stroke-recovery-analyser).
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
23
 
24
- ## Overview
25
- This model is a fine-tuned version of **InstaDeepAI/nucleotide-transformer-v2-500m-multi-species**, specifically adapted for **clinical regression tasks** in neuro-rehabilitation. It predicts the biological plasticity potential of a patient following a stroke, quantified by the **Western Aphasia Battery-Aphasia Quotient (WAB-AQ)** score.
 
26
 
27
- ## Technical Architecture
28
- - **Base Architecture:** Transformer-based Nucleotide Encoder (500M Parameters).
29
- - **Modification:** Replaced the Language Modeling (LM) head with a specialized **Sequence Classification Head**.
30
- - **Training Objective:** Mean Squared Error (MSE) loss optimization for predicting WAB-AQ scores (Range: 0-100).
31
- - **Input:** 1024-nucleotide genomic sequences (focused on neuroplasticity-related markers such as BDNF and COMT).
32
 
33
- ## Hardware & Performance
34
- Fine-tuned on the **NVIDIA DGX Spark** using the **Grace Blackwell (GB10)** architecture.
35
- - **Precision:** BF16 Mixed-Precision.
36
- - **Memory Bandwidth:** 273 GB/s via LPDDR5x Unified Memory.
37
- - **Optimization:** Gradient accumulation (steps=4) leveraging the 20-core Arm CPU for high-speed dataloading.
38
 
39
- ## Intended Use
40
- This model serves as the **Genomic Modality** in a multi-modal fusion pipeline. It is designed to be used alongside MRI lesion maps and DTI tractography to provide a holistic "Recovery Forecast" for aphasia patients.
 
41
 
42
- ## ⚠️ Clinical Disclaimer
43
- This system is a biomedical research prototype. Predictions represent statistical probabilities based on a cohort of 902 stroke cases and are intended to assist clinical decision-making, not replace it.
 
8
  - aphasia
9
  - dna-regression
10
  - nvidia-blackwell
11
+ - neuroplasticity
12
  datasets:
13
  - ARC-Aphasia-Genomics
14
  metrics:
15
  - mse
16
+ - mae
17
  ---
18
 
19
+ # 🧬 Genomic-Transformer-Aphasia-Recovery (v1.0)
20
+ ### *Predicting Clinical Neuroplasticity via Deep Genomic Regression*
21
 
22
  [![Hugging Face Spaces](https://img.shields.io/badge/%F0%9F%A4%97%20Hugging%20Face-Spaces-blue)](https://huggingface.co/spaces/assix-research/stroke-recovery-analyser)
23
 
24
+ ---
25
+
26
+ ## 🚀 Project Overview
27
+ This model is a specialized **Sequence-to-Scalar Transformer** designed to predict post-stroke recovery potential. By analyzing 1024-nucleotide windows of genomic data, the model estimates a patient's **Western Aphasia Battery-Aphasia Quotient (WAB-AQ)**, providing a biological "ceiling" for language recovery.
28
+
29
+ The model serves as the **Biological Modality** in a multi-modal fusion pipeline, intended to be integrated with MRI-based lesion volumetry to create personalized 3D recovery forecasts.
30
+
31
+
32
+
33
+ ## 🛠 Technical Specifications
34
+ - **Base Backbone:** `InstaDeepAI/nucleotide-transformer-v2-500m-multi-species`
35
+ - **Architecture Head:** Custom Linear Regression Head for continuous score prediction.
36
+ - **Input Context:** 1024 base pairs (bp) tokenized at the single-nucleotide level.
37
+ - **Precision:** BF16 (BFloat16) Mixed-Precision Training.
38
+ - **Hardware:** Fine-tuned on the **NVIDIA DGX Spark** (Grace Blackwell GB10 Architecture).
39
+
40
+ ### Training Metadata
41
+ | Parameter | Value |
42
+ | :--- | :--- |
43
+ | **GPU Architecture** | NVIDIA Blackwell (GB10) |
44
+ | **Unified Memory** | 128GB LPDDR5x |
45
+ | **Bandwidth** | 273 GB/s |
46
+ | **Batch Size** | 16 (Gradient Accumulation = 4) |
47
+ | **Optimizer** | AdamW (Weight Decay = 0.01) |
48
+
49
+ ## 📊 Dataset: ARC-Aphasia
50
+ The model was fine-tuned on a curated genomic subset of the **Aphasia Recovery Cohort (ARC)**, consisting of 902 subjects. The training focus was localized to genetic regions associated with neural growth factors and neurotransmitter regulation, including:
51
+ - **BDNF** (Brain-Derived Neurotrophic Factor)
52
+ - **COMT** (Catechol-O-methyltransferase)
53
+ - **APOE** (Apolipoprotein E)
54
+
55
+ ## 🖥️ Usage & Inference
56
+ To run this model locally on your DGX or a compatible Blackwell environment:
57
 
58
+ ```python
59
+ from transformers import AutoTokenizer, AutoModelForSequenceClassification
60
+ import torch
61
 
62
+ model_id = "assix-research/genomic-transformer-aphasia-recovery"
63
+ tokenizer = AutoTokenizer.from_pretrained(model_id)
64
+ model = AutoModelForSequenceClassification.from_pretrained(model_id, trust_remote_code=True)
 
 
65
 
66
+ dna_seq = "ATGC..." # 1024bp sequence
67
+ inputs = tokenizer(dna_seq, return_tensors="pt")
68
+ with torch.no_grad():
69
+ prediction = model(**inputs).logits.item()
 
70
 
71
+ print(f"Predicted WAB-AQ: {prediction:.2f}/100")
72
+ ```
73
+ ⚠️ Clinical Disclaimer
74
 
75
+ This model is a Biomedical Research Tool developed for the study of neuroplasticity. It is not an FDA-cleared diagnostic device. Predicted WAB-AQ scores are statistical estimates based on a specific research cohort and must be interpreted by a neurologist in conjunction with structural neuroimaging (MRI/DTI).