README.md

metadata

language: en
license: mit
library_name: transformers
tags:
  - sentiment-analysis
  - classification
  - from-scratch
datasets:
  - imdb
metrics:
  - accuracy
model-index:
  - name: CritiqueCore-v1
    results:
      - task:
          type: text-classification
          name: Sentiment Analysis
        dataset:
          name: imdb
          type: imdb
        metrics:
          - type: accuracy
            value: 0.9
pipeline_tag: text-classification

CritiqueCore v1

CritiqueCore v1 is a compact Transformer model trained from scratch for sentiment analysis. Unlike models that use transfer learning, this model was initialized with random weights and learned the nuances of language (including sarcasm and basic cross-lingual sentiment) exclusively from the IMDb movie reviews dataset.

Model Description

• Architecture: Custom Mini-Transformer (DistilBERT-based configuration)
• Parameters: ~9.06 Million
• Layers: 2
• Attention Heads: 4
• Hidden Dimension: 256
• Training Data: IMDb Movie Reviews (25,000 samples)
• Training Duration: ~10 minutes on NVIDIA T4 GPU

Capabilities

• Sentiment Detection: Strong performance on positive/negative English text.
• Sarcasm Awareness: Recognizes negative intent even when positive words are used (e.g., "CGI vomit").
• Robustness: Handles minor typos and maintains high confidence on structured feedback.

Limitations

• Domain Specificity: Optimized for reviews. May struggle with complex multi-turn dialogues.
• Multilingual: While it shows some intuition for German, it was not explicitly trained on non-English data.

How to use (Inference Script)

Use inference.py from this repos' files list. Have fun :D