Implementation of Rotary Embeddings, from the Roformer paper, in Pytorch
-
Updated
Nov 27, 2024 - Python
#
positional-encoding
Here are 41 public repositories matching this topic...
PET-NeuS: Positional Encoding Tri-Planes for Neural Surfaces (CVPR 2023)
pytorch surface-reconstruction nerf implicit-surfaces positional-encoding multi-view-reconstruction cvpr2023 tri-planes
-
Updated
May 2, 2024 - Python
Source code for GNN-LSPE (Graph Neural Networks with Learnable Structural and Positional Representations), ICLR 2022
graphs transformers attention representation-learning molecules message-passing lspe geometric-deep-learning graph-neural-networks graph-representation-learning gnn graph-deep-learning positional-encoding graph-transformer transformer-networks gnn-lspe
-
Updated
Feb 10, 2022 - Python
[CVPR 2021] Adversarial Generation of Continuous Images
-
Updated
Nov 10, 2021 - Python
[CVPR 2023] This is the official PyTorch implementation for "Dynamic Focus-aware Positional Queries for Semantic Segmentation".
-
Updated
Mar 4, 2023 - Python
Learnable Fourier Features for Multi-Dimensional Spatial Positional Encoding
deep-neural-networks deep-learning pytorch transformer deeplearning attention-is-all-you-need positional-encoding
-
Updated
Sep 30, 2024 - Python
Continuous Augmented Positional Embeddings (CAPE) implementation for PyTorch
audio text speech pytorch transformer vit cape positional-encoder positional-encoding visual-transformer positional-embedding
-
Updated
Dec 28, 2022 - Python
Trading Positional Complexity vs Deepness in Coordinate Networks
-
Updated
Sep 2, 2023 - Jupyter Notebook
Developed the ViViT model for medical video classification, enhancing 3D organ image analysis using transformer-based architectures.
-
Updated
May 22, 2024 - Jupyter Notebook
"Found in the Middle: How Language Models Use Long Contexts Better via Plug-and-Play Positional Encoding" Zhenyu Zhang, Runjin Chen, Shiwei Liu, Zhewei Yao, Olatunji Ruwase, Beidi Chen, Xiaoxia Wu, Zhangyang Wang.
-
Updated
May 7, 2024 - Python
Multiresolution Graph Transformers and Wavelet Positional Encoding for Learning Long-Range and Hierarchical Structures
density-functional-theory wavelet-transform graph-neural-networks positional-encoding graph-transformer
-
Updated
Oct 27, 2023 - Python
Unofficial pytorch implementation of the paper "Learnable Fourier Features for Multi-Dimensional Spatial Positional Encoding", NeurIPS 2021.
-
Updated
Apr 24, 2024 - Python
Implementation of Rotary Embeddings, from the Roformer paper, in Tensorflow
-
Updated
Sep 12, 2021 - Python
Robust Point Cloud Processing through Positional Embedding
-
Updated
Sep 7, 2023 - HTML
PyTorch implementation of "Attention Is All You Need" by Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, Illia Polosukhin
-
Updated
Aug 26, 2023 - Python
Algebraic Positional Encodings
-
Updated
Dec 11, 2024 - Python
The implementation of transformer as presented in the paper "Attention is all you need" from scratch.
transformers attention-mechanism attention-is-all-you-need multihead-attention self-attention positional-encoding
-
Updated
Mar 4, 2023 - Python
Official code for NeurIPS 2023 paper "Laplacian Canonization: A Minimalist Approach to Sign and Basis Invariant Spectral Embedding".
-
Updated
Jan 20, 2024 - Python
Benchmarking Positional Encodings for GNNs and Graph Transformers
-
Updated
Nov 25, 2024 - Python
Code for "The Locality and Symmetry of Positional Encodings" EMNLP Findings
-
Updated
Dec 18, 2023 - Python
Improve this page
Add a description, image, and links to the positional-encoding topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the positional-encoding topic, visit your repo's landing page and select "manage topics."