Skip to content

Issues: ReaLLMASIC/nanoGPT

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

50 Open 11 Closed
50 Open 11 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Relumax seems better than consmax
#326 opened Dec 18, 2024 by purejomo
Dataset: Fineweb 2
#324 opened Dec 14, 2024 by gkielian
Experiment: pdmx training midi with lsv and dataset/style embeddings
#323 opened Dec 14, 2024 by gkielian
Experiment: Byte-Fallback IPA Tokenization vs Tiktoken for translation
#322 opened Dec 14, 2024 by gkielian
Add HellaSwag Benchmarking Benchmarks
#321 opened Dec 11, 2024 by gkielian
1
@mmoffatt2
Add folder for open source compression algorithms
#317 opened Dec 10, 2024 by gkielian
1
@klei22
Create PR for DXLS to PPA (or add to PR)
#307 opened Nov 22, 2024 by gkielian
Add additional models for Validation Loss and Benchmarking
#306 opened Nov 21, 2024 by gkielian
3 tasks
@mmoffatt2
Refactor activations so that we can have config parameters and different activations per layer
#293 opened Nov 8, 2024 by gkielian
Experiments: Rotary Position Embedding Swapping/Finetuning for HW Effiiciency
#228 opened Aug 14, 2024 by gkielian
4 tasks
Quest: Add Benchmarks and Pretokenized JSON for training epic Epic level contrib
#222 opened Aug 9, 2024 by gkielian
Exploration Augmentation: Add means to pause and resume search
#221 opened Aug 8, 2024 by gkielian
Exploration Augmentation: Run_experiments Best Results Log
#220 opened Aug 8, 2024 by gkielian
Exploration Automation: Obtain Dataset, Select Tokenization, and Cache results
#219 opened Aug 8, 2024 by gkielian
Sample.py: fix inference for p50k_base and cl100k_base bug Something isn't working
#213 opened Jul 31, 2024 by gkielian
Quest: Add compatibilty with a Simple-Wikipedia dataset
#207 opened Jul 30, 2024 by gkielian
Quest: Add SAM Preprocessing for Videos
#206 opened Jul 29, 2024 by gkielian
Add nan handling strategy for run_vizier.py
#193 opened Jun 24, 2024 by klei22
@gkielian @klei22
Quest: Add a Rough draft for Mixture of Experts enhancement New feature or request epic Epic level contrib good first issue Good for newcomers help wanted Extra attention is needed
#140 opened Apr 9, 2024 by gkielian
Quest: Create a training efficient version of windowed attention for experimenting with long contexts enhancement New feature or request epic Epic level contrib good first issue Good for newcomers
#139 opened Apr 9, 2024 by gkielian
Quest: Curriculum and Preprocessing for Translation Targets enhancement New feature or request epic Epic level contrib good first issue Good for newcomers help wanted Extra attention is needed
#129 opened Mar 18, 2024 by gkielian
4 tasks
Start Translation Training
Quest: Have run experiments print a number of combinations and optional printing of all options to file enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed
#126 opened Mar 17, 2024 by gkielian
Quest: Add Quantization Aware Training and Inference enhancement New feature or request epic Epic level contrib help wanted Extra attention is needed
#125 opened Mar 17, 2024 by gkielian Model Quantization
OpenFASoC PPA Analyzer
#122 opened Mar 14, 2024 by harshkhandeparkar
6 tasks
Quests: Add Weather Dataset
#121 opened Mar 14, 2024 by gkielian
ProTip! Type g i on any issue or pull request to go back to the issue listing page.