mskayacioglu commited on
Commit
e3b68c1
·
verified ·
1 Parent(s): 1e072f9

Add evaluation metrics to model card

Browse files

Adds notebook-derived evaluation protocol and metrics from train/ml-32m-train.ipynb.

Files changed (1) hide show
  1. README.md +38 -0
README.md CHANGED
@@ -9,6 +9,25 @@ tags:
9
  - movielens
10
  - implicit-feedback
11
  - implicit-als
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
12
  ---
13
 
14
  # ml32m-als128-v1
@@ -29,6 +48,25 @@ This repository contains an implicit-feedback ALS recommender artifact trained f
29
  - Saved user factors: false
30
  - Saved at UTC: 2026-07-02T15:18:10.162757+00:00
31
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
32
  ## Repository Files
33
 
34
  - `als_model.npz`: ALS artifact containing saved item factors and training parameters.
 
9
  - movielens
10
  - implicit-feedback
11
  - implicit-als
12
+ metrics:
13
+ - recall
14
+ - ndcg
15
+ model-index:
16
+ - name: ml32m-als128-v1
17
+ results:
18
+ - task:
19
+ type: top-n-recommendation
20
+ name: Top-N recommendation
21
+ dataset:
22
+ name: MovieLens ml-32m
23
+ type: MovieLens
24
+ metrics:
25
+ - type: recall_at_10
26
+ value: 0.08418674438152764
27
+ name: Recall@10
28
+ - type: ndcg_at_10
29
+ value: 0.06680269709374106
30
+ name: NDCG@10
31
  ---
32
 
33
  # ml32m-als128-v1
 
48
  - Saved user factors: false
49
  - Saved at UTC: 2026-07-02T15:18:10.162757+00:00
50
 
51
+ ## Evaluation
52
+
53
+ Evaluation metrics were taken from `train/ml-32m-train.ipynb`.
54
+
55
+ Protocol:
56
+
57
+ - Held-out relevance: test-set ratings `>= 4.0`.
58
+ - Seen-item filtering: movies present in each user's training history were excluded from the ranked list.
59
+ - Ranking sample: 10,000 users sampled with seed `0` from 187,278 users with at least one relevant test item.
60
+ - Cutoff: `K=10`.
61
+
62
+ | Model | Recall@10 | NDCG@10 | Users |
63
+ | --- | ---: | ---: | ---: |
64
+ | ALS implicit | 0.0842 | 0.0668 | 10,000 |
65
+ | Popularity baseline | 0.0489 | 0.0430 | 10,000 |
66
+ | Explicit MF baseline | 0.0005 | 0.0005 | 10,000 |
67
+
68
+ The ALS model is optimized for implicit-feedback ranking, so rating-prediction RMSE/MAE is not reported for this artifact.
69
+
70
  ## Repository Files
71
 
72
  - `als_model.npz`: ALS artifact containing saved item factors and training parameters.