File size: 764 Bytes
04f32ab
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
---
base_model: mlx-community/Mistral-7B-Instruct-v0.3-4bit
library_name: mlx
tags:
  - lora
  - mlx
  - finance
---

# bha6kar/finance-lora-mistral-7b

LoRA adapter fine-tuning [`mlx-community/Mistral-7B-Instruct-v0.3-4bit`](https://huggingface.co/mlx-community/Mistral-7B-Instruct-v0.3-4bit) on the [`gbharti/finance-alpaca`](https://huggingface.co/datasets/gbharti/finance-alpaca) financial instruction dataset with [MLX](https://github.com/ml-explore/mlx).

- Test perplexity: 12.078 (base) to 4.648 (tuned), across 3 seed(s).

## Use

```python
from mlx_lm import load, generate
model, tok = load("mlx-community/Mistral-7B-Instruct-v0.3-4bit", adapter_path="<downloaded-adapter-dir>")
```

Produced by [slm-training](https://github.com/bha6kar/slm-training).