Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Feat: RoPE Embeddings #39

Merged
merged 32 commits into from
Mar 12, 2024
Merged

Feat: RoPE Embeddings #39

merged 32 commits into from
Mar 12, 2024

Conversation

mali-git
Copy link
Member

No description provided.

@mali-git mali-git changed the title RoPE Embeddings Feat: RoPE Embeddings Jan 30, 2024
@mali-git mali-git self-assigned this Jan 30, 2024
@mali-git mali-git requested a review from le1nux January 31, 2024 14:14
@mali-git mali-git marked this pull request as ready for review February 26, 2024 14:45
BlueCrescent
BlueCrescent reviewed Mar 11, 2024
View reviewed changes
src/modalities/models/gpt2/gpt2_model.py Outdated Show resolved Hide resolved
src/modalities/models/gpt2/gpt2_model.py Show resolved Hide resolved
src/modalities/models/gpt2/gpt2_model.py Outdated Show resolved Hide resolved
src/modalities/models/gpt2/gpt2_model.py Outdated Show resolved Hide resolved
tests/test_rotary_qkv_transform.py Outdated Show resolved Hide resolved
tests/test_evaluation.py Outdated Show resolved Hide resolved
.devcontainer/devcontainer.json Outdated Show resolved Hide resolved
src/modalities/config/look_up_enum.py Outdated Show resolved Hide resolved
src/modalities/config/utils.py Outdated Show resolved Hide resolved
src/modalities/models/gpt2/gpt2_model.py Show resolved Hide resolved
@mali-git mali-git merged commit 14f4f2e into main Mar 12, 2024
le1nux pushed a commit that referenced this pull request Mar 13, 2024
@mali-git
Merge pull request #39 from Modalities/rope_embeddings
bcabfb8 
Feat: RoPE Embeddings
le1nux pushed a commit that referenced this pull request Mar 13, 2024
@mali-git
Merge pull request #39 from Modalities/rope_embeddings
963a0d0 
Feat: RoPE Embeddings
le1nux pushed a commit that referenced this pull request Mar 13, 2024
@mali-git
Merge pull request #39 from Modalities/rope_embeddings
7054b5b 
Feat: RoPE Embeddings
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@BlueCrescent BlueCrescent BlueCrescent left review comments

@fromm-m fromm-m fromm-m approved these changes

@le1nux le1nux Awaiting requested review from le1nux

Assignees

@mali-git mali-git

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@mali-git @BlueCrescent @fromm-m