vshmyhlo / transformer-pytorch Public

Notifications You must be signed in to change notification settings
Fork 0
Star 5

Implementation of Transformer from "Attention Is All You Need" paper in PyTorch

5 stars 0 forks Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 283 Commits
data		data
.gitignore		.gitignore
README.md		README.md
attention.py		attention.py
dataset.py		dataset.py
download_iwslt15.sh		download_iwslt15.sh
requirements.txt		requirements.txt
scheduler.py		scheduler.py
sublayers.py		sublayers.py
train-en-vi-gpu.sh		train-en-vi-gpu.sh
train.py		train.py
transformer.py		transformer.py

Repository files navigation

Implementation of Transformer from Attention Is All You Need paper in PyTorch

TODO

byte-pair encoding
label smoothing
beam search
more tests
batch bucketing
visualize attention

About

Implementation of Transformer from "Attention Is All You Need" paper in PyTorch

nlp machine-learning deep-learning pytorch seq2seq

Report repository

Releases

No releases published

Packages

No packages published

Languages