|
|
| ---
|
| language: en
|
| tags:
|
| - scientific-papers
|
| - arxiv
|
| - classification
|
| - scibert
|
| - text-classification
|
| datasets:
|
| - arxiv
|
| license: mit
|
| ---
|
|
|
| # SciBERT Fine-tuned for arXiv Paper Classification
|
|
|
| This model is a fine-tuned version of [allenai/scibert_scivocab_uncased](https://huggingface.co/allenai/scibert_scivocab_uncased) for classifying scientific papers into arXiv categories.
|
|
|
| ## Model Description
|
|
|
| - **Base Model:** SciBERT (Scientific BERT)
|
| - **Task:** Multi-class Text Classification
|
| - **Training Data:** arXiv scientific papers
|
| - **Number of Classes:** 20 arXiv categories
|
|
|
| ## Intended Use
|
|
|
| This model classifies scientific paper abstracts into their primary arXiv subject categories.
|
|
|
| ## Usage
|
|
|
| ```python
|
| from transformers import AutoTokenizer, AutoModelForSequenceClassification
|
| import torch
|
|
|
| tokenizer = AutoTokenizer.from_pretrained("YOUR_USERNAME/scibert-arxiv-classifier")
|
| model = AutoModelForSequenceClassification.from_pretrained("YOUR_USERNAME/scibert-arxiv-classifier")
|
|
|
| text = "Your scientific paper abstract here..."
|
| inputs = tokenizer(text, return_tensors="pt", truncation=True, max_length=512)
|
| outputs = model(**inputs)
|
| predictions = torch.nn.functional.softmax(outputs.logits, dim=-1)
|
| predicted_class = torch.argmax(predictions, dim=-1).item()
|
| ```
|
|
|
| ## Training Details
|
|
|
| - Fine-tuned on arXiv paper dataset
|
| - Optimized for scientific domain text classification
|
|
|
| ## Limitations
|
|
|
| - Best suited for scientific/academic papers
|
| - Performance may vary on non-scientific text
|
|
|
