turhancan97 commited on
Commit
6edd245
·
verified ·
1 Parent(s): f4550b1

Add edge probe for dinov2_vitb14

Browse files
Files changed (2) hide show
  1. README.md +64 -0
  2. probe.pt +3 -0
README.md ADDED
@@ -0,0 +1,64 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: visbench
3
+ tags:
4
+ - visbench
5
+ - probing
6
+ - edge
7
+ ---
8
+
9
+ # edge probe for `dinov2_vitb14`
10
+
11
+ A **trained probe head**, not a backbone. It is the small module VisBench fits
12
+ on top of frozen `dinov2_vitb14` features to measure what those features carry.
13
+
14
+ ```python
15
+ import visbench
16
+ from visbench.hub import load_probe_from_hub
17
+
18
+ backbone = visbench.get_backbone("dinov2_vitb14")
19
+ probe = load_probe_from_hub("turhancan97/visbench-edge-dinov2_vitb14", backbone=backbone)
20
+ ```
21
+
22
+ ## It only works with this backbone
23
+
24
+ These weights were fitted on features from `dinov2_vitb14`, taken with
25
+ `pooling=mean` and `feature_mode=dense_only`. Loading them against
26
+ anything else is refused, because the failure is otherwise silent: a head fitted
27
+ on one pooling and fed another has the right shapes and produces a plausible,
28
+ wrong number.
29
+
30
+ | | |
31
+ | --- | --- |
32
+ | backbone | `dinov2_vitb14` |
33
+ | backbone key | `dinov2/dinov2_vitb14/224/7764ea0f912e` |
34
+ | task | `edge` (low_level) |
35
+ | pooling | `mean` (requested `mean`) |
36
+ | feature mode | `dense_only` |
37
+ | layers | `None` |
38
+
39
+ **Reported scores**
40
+
41
+ | metric | value |
42
+ | --- | --- |
43
+ | `edge_correlation` | 0.4580 |
44
+ | `mae` | 0.4930 |
45
+ | `rmse` | 0.9217 |
46
+
47
+ ## Reproducing it
48
+
49
+ Fitted with:
50
+
51
+ - `activation`: `identity`
52
+ - `batch_size`: `8`
53
+ - `epochs`: `10`
54
+ - `head`: `linear`
55
+ - `hidden_dim`: `512`
56
+ - `layers`: `None`
57
+ - `loss`: `l1`
58
+ - `lr`: `0.0005`
59
+ - `optimizer`: `adamw`
60
+ - `protocol`: `visbench_edge_regression`
61
+ - `warmup_epochs`: `1.5`
62
+ - `weight_decay`: `0.0001`
63
+
64
+ Generated by [VisBench](https://github.com/turhancan97/VisBench).
probe.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:580b54493aa4507271cd7fd2c44f7fb13a7208d38462b083e4bc1ce5e37838c9
3
+ size 5653