carmenwijaya's picture
Upload 2 files
dd1e33e verified
|
Raw
History Blame Contribute Delete
748 Bytes
metadata
license: cc-by-4.0
tags:
  - base
  - concat-mlp
  - dino
  - gelu
  - instancenorm
  - kaiming
  - matching
  - multi-query
  - novograd
  - step

model_685856236_dino_base.py

Model Overview

A base-scale implementation of the dino architecture, built for matching tasks.

Architecture

  • Architecture: dino
  • Scale: base
  • Attention: multi query
  • Fusion strategy: concat mlp
  • Task head: matching
  • Activation: gelu
  • Normalization: instancenorm
  • Initialization: kaiming

Training

  • Optimizer: novograd
  • LR scheduler: step

Files

  • model_685856236_dino_base.py — main artifact of this repository

License

See the license field above.