Spaces:

DebasishDhal99
/

Embedding-Visualization

Running on Zero

App Files Files Community

Embedding-Visualization

1.04 MB

Ctrl+K

Ctrl+K

3 contributors

History: 19 commits

DebasishDhal99's picture

feat: add interactive plot to view rope rotation angle as a function of dimension pair index (d) and token position index (k)

36a72e5 2 days ago

.github
fix: Fix Hugging Face username in workflow 18 days ago
absolute_sinusoidal_position_embedding
feat: added bare mimimum implementation of absolute sinusoidal positional encoding 28 days ago
relative_pos_embedding
feat: added bare minimum rel-position embedding 21 days ago
rope_implementation
Added visualization for rope implementation 18 days ago
src
feat: add interactive plot to view rope rotation angle as a function of dimension pair index (d) and token position index (k) 2 days ago
tests
feat: add rope visualization only with some minor cmparison with sinusoidial positional embedding 10 days ago
.gitignore

4.65 kB
feat: basic setup with docker, no real code has been added for visualization yet 11 days ago
Dockerfile

277 Bytes
feat: basic setup with docker, no real code has been added for visualization yet 11 days ago
README.md

1.83 kB
feat: add explanation on `hidden_size = num_attention_heads * dim_per_head` 10 days ago
app.py

24.5 kB
feat: add interactive plot to view rope rotation angle as a function of dimension pair index (d) and token position index (k) 2 days ago
compose.yaml

106 Bytes
feat: basic setup with docker, no real code has been added for visualization yet 11 days ago
requirements.txt

113 Bytes
feat: add rope visualization only with some minor cmparison with sinusoidial positional embedding 10 days ago