Skip to content

Pull requests: Vatican-X-Formers/trax

New pull request New
Clear current search query, filters, and sorts
0 Open 38 Closed
0 Open 38 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Internal review
#38 by syzymon was closed Aug 15, 2021 • Draft
3
Rotary positional embedding
#37 by syzymon was closed Aug 15, 2021 • Draft
[DNM] Configurable funnel transformer internal review
#36 by syzymon was closed Sep 24, 2021 • Draft
Add C4 pretraining config for Relformer and update scientific_papers
#35 by syzymon was merged May 9, 2021 Loading…
Add bidirectional attention mask for inputs
#34 by syzymon was merged May 9, 2021 Loading…
Update relformer_imagenet64.gin and add sweep
#33 by syzymon was merged Apr 19, 2021 Loading…
Scientific papers vanilla
#32 by mtyrolski was merged Apr 18, 2021 Loading…
Pnawrot reversible
#31 by PiotrNawrot was merged Apr 18, 2021 Loading…
1
Relformer gins upgrade
#30 by mtyrolski was merged Apr 18, 2021 Loading…
relformer gins
#29 by mtyrolski was merged Apr 17, 2021 Loading…
Use SelfAttention in relformer_imagenet64.gin
#28 by syzymon was merged Mar 19, 2021 Loading…
Predict fix
#27 by PiotrNawrot was merged Mar 19, 2021 Loading…
1
Implementation of 'predict' mode to Relformer
#26 by PiotrNawrot was merged Mar 17, 2021 Loading…
7
Pnawrot predict pr
#25 by PiotrNawrot was closed Mar 17, 2021 Loading…
Add experimental version of RelformerLM
#24 by syzymon was merged Mar 11, 2021 Loading…
Add a note about 'predict' mode
#23 by syzymon was merged Mar 2, 2021 Loading…
Add comment about imagenet32
#22 by syzymon was merged Mar 1, 2021 Loading…
Remove synthetic tasks from the PR
#21 by syzymon was merged Feb 15, 2021 Loading…
Remove synthetic tasks from the PR
#20 by syzymon was closed Feb 15, 2021 Loading…
Add autoregressive property (future leakage) unit test
#19 by syzymon was merged Feb 14, 2021 Loading…
Rebase with the latest master
#18 by syzymon was closed Feb 13, 2021 Loading…
Change resampler_fn interface in _FunnelRelativeDecoderBlock
#17 by syzymon was merged Feb 13, 2021 Loading…
1
Update with more current training params
#16 by syzymon was merged Feb 9, 2021 Loading…
Fix batch_size (variable_shapes bug)
#15 by syzymon was merged Feb 5, 2021 Loading…
Fix pooling factor in causal conv
#14 by syzymon was merged Jan 28, 2021 Loading…
ProTip! Mix and match filters to narrow down what you’re looking for.