README.md

---
tags:
- matformer
- custom-model
library_name: transformers
---

# Matformer Model

Trained using [Matformer](https://github.com/mrinaldi97/matformer).

## Installation

```bash
pip install git+https://github.com/mrinaldi97/matformer.git
```

## Usage

```python
import torch
from transformers import AutoModelForMaskedLM

model = AutoModelForMaskedLM.from_pretrained(
    "mrinaldi/albertina-micro-posenc-mixed-alibi-rope",
    trust_remote_code=True
)
```