Instructions to use ESGBERT/GovRoBERTa-base with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use ESGBERT/GovRoBERTa-base with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("fill-mask", model="ESGBERT/GovRoBERTa-base")# Load model directly from transformers import AutoTokenizer, AutoModelForMaskedLM tokenizer = AutoTokenizer.from_pretrained("ESGBERT/GovRoBERTa-base") model = AutoModelForMaskedLM.from_pretrained("ESGBERT/GovRoBERTa-base", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit ·
a6b53e5
1
Parent(s): f0dffdc
Update README.md
Browse files
README.md
CHANGED
|
@@ -14,7 +14,7 @@ tags:
|
|
| 14 |
|
| 15 |
Based on [this paper](https://papers.ssrn.com/sol3/papers.cfm?abstract_id=4622514), this is the GovRoBERTa-base language model. A language model that is trained to better understand governance texts in the ESG domain.
|
| 16 |
|
| 17 |
-
*Note: We generally recommend choosing the [
|
| 18 |
|
| 19 |
Using the [RoBERTa](https://huggingface.co/roberta-base) model as a starting point, the GovRoBERTa-base Language Model is additionally pre-trained on a text corpus comprising governance-related annual reports, sustainability reports, and corporate and general news.
|
| 20 |
|
|
|
|
| 14 |
|
| 15 |
Based on [this paper](https://papers.ssrn.com/sol3/papers.cfm?abstract_id=4622514), this is the GovRoBERTa-base language model. A language model that is trained to better understand governance texts in the ESG domain.
|
| 16 |
|
| 17 |
+
*Note: We generally recommend choosing the [GovernanceBERT-base](https://huggingface.co/ESGBERT/GovernanceBERT-base) model since it is quicker, less resource-intensive and only marginally worse in performance.*
|
| 18 |
|
| 19 |
Using the [RoBERTa](https://huggingface.co/roberta-base) model as a starting point, the GovRoBERTa-base Language Model is additionally pre-trained on a text corpus comprising governance-related annual reports, sustainability reports, and corporate and general news.
|
| 20 |
|