Relex / README.md
FatouSow's picture
Upload README.md
15a3bec verified
|
Raw History Blame Contribute Delete
2.31 kB
metadata
license: mit
language:
  - fr
base_model:
  - almanach/camembert-base
pipeline_tag: text-classification
library_name: transformers
tags:
  - discourse relation
  - discourse connective
  - camembert
  - nlp
model-index:
  - name: Relex
    results:
      - task:
          type: text-classification
        metrics:
          - name: Label Names
            type: list
            value:
              - alternation
              - background
              - commentary
              - concession
              - condition
              - consequence
              - continuation
              - contrast
              - detachment
              - evidence
              - explanation
              - explanation*
              - flashback
              - goal
              - narration
              - parallel
              - result
              - result*
              - summary
          - name: macro-F1
            type: f1
            value: 0.59
          - name: Accuracy
            type: accuracy
            value: 0.63
          - name: Precision
            type: precision
            value: 0.62
          - name: Recall
            type: recall
            value: 0.62

Model description

Relex is a fine-tuned CamemBERT model trained to classify the relation expressed by a connective in context. Given a connective tagged by the tokens [MARKER] and [/MARKER], Relex predicts the relation of this connective.

  • Training data: French newspapers and Wikiconflit comments, automatically annotated in connectives

  • Special tokens: Connectives are wrapped between [MARKER] and [/MARKER] tokens in the training data. These tags signal to the model which word it should focus its attention on for the relation mapping.

  • Context Window: The special tokens must appear within the first 256 tokens of the input. Because these signals are the anchor for the classification, ensuring they are not truncated is crucial for accurate predictions.

  • Predictions: Relex predicts among 19 discourse relations (SDRT) .

  • Example:

  • Input: [MARKER] Peu avant de [/MARKER] mourir, Mio a promis à son mari qu'elle reviendrait à la saison des pluies.

  • Prediction: Narration

Usage

You can use this model directly with a Hugging Face pipeline:

from transformers import pipeline

pipe = pipeline("text-classification", model="FatouSow/Relex")

text ="[MARKER] Peu avant de [/MARKER] mourir, Mio a promis à son mari qu'elle reviendrait à la saison des pluies."

result = pipe(text)
print(result)