Skip to content

Commit 31f6651

Browse files
committed
Add some addition attention impl, inspired by PR #2048. Add some basic unit tests to cover broader timm pooling options. Make ROPE pooling more flexible with latest RotaryEmbedding impl.
1 parent f5d70c2 commit 31f6651

File tree

6 files changed

+1007
-6
lines changed

6 files changed

+1007
-6
lines changed

0 commit comments

Comments
 (0)