metadata
license: cc-by-4.0
tags:
- base
- instancenorm
- linear-warmup
- low-rank
- multi-query
- orthogonal
- relu
- retrieval
- sgd
- swin-t
model_463304255_swin_t_base.py
Model Overview
A base-scale implementation of the swin t architecture, built for retrieval tasks.
Architecture
- Architecture: swin t
- Scale: base
- Attention: multi query
- Fusion strategy: low rank
- Task head: retrieval
- Activation: relu
- Normalization: instancenorm
- Initialization: orthogonal
Training
- Optimizer: sgd
- LR scheduler: linear warmup
Files
model_463304255_swin_t_base.py— main artifact of this repository
License
See the license field above.