Spaces:

DebasishDhal99
/

Embedding-Visualization

Running on Zero

App Files Files Community

Embedding-Visualization

1.02 MB

Ctrl+K

Ctrl+K

3 contributors

History: 14 commits

DebasishDhal99's picture

feat: add explanation on `hidden_size = num_attention_heads * dim_per_head`

4ed3b70 15 days ago

.github
fix: Fix Hugging Face username in workflow 23 days ago
absolute_sinusoidal_position_embedding
feat: added bare mimimum implementation of absolute sinusoidal positional encoding about 1 month ago
relative_pos_embedding
feat: added bare minimum rel-position embedding 26 days ago
rope_implementation
Added visualization for rope implementation 23 days ago
src
feat: add explanation on `hidden_size = num_attention_heads * dim_per_head` 15 days ago
tests
feat: add rope visualization only with some minor cmparison with sinusoidial positional embedding 15 days ago
.gitignore

4.65 kB
feat: basic setup with docker, no real code has been added for visualization yet 16 days ago
Dockerfile

277 Bytes
feat: basic setup with docker, no real code has been added for visualization yet 16 days ago
README.md

1.83 kB
feat: add explanation on `hidden_size = num_attention_heads * dim_per_head` 15 days ago
app.py

14.9 kB
feat: add explanation on `hidden_size = num_attention_heads * dim_per_head` 15 days ago
compose.yaml

106 Bytes
feat: basic setup with docker, no real code has been added for visualization yet 16 days ago
requirements.txt

113 Bytes
feat: add rope visualization only with some minor cmparison with sinusoidial positional embedding 15 days ago