Skip to content

Issues: princeton-nlp/LLM-Shearing

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

20 Open 52 Closed
20 Open 52 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

The pruned model does not match target structred config
#74 opened Sep 21, 2024 by dat-browny
Request for Fine-tuning Data for Continued Pre-training
#73 opened Sep 5, 2024 by pupumao
About the NQ EM Score in Table 2
#72 opened Aug 24, 2024 by chuhac
Default Initialization of Lambda Parameters to Zero
#71 opened Jun 6, 2024 by lpyhdzx
3
Can LLM-Shearing be used on ViT models?
#68 opened Apr 22, 2024 by n9s8a
1
about shearing params config
#67 opened Apr 19, 2024 by LoverLost
1
Why the rope params are ignored while converting hf checkpoint to composer checkpoint?
#66 opened Mar 22, 2024 by ZhiYuanZeng
3
composer model trans to pythia problem
#64 opened Mar 19, 2024 by rzr002
The Project is not implemented for 70B llama?
#62 opened Mar 8, 2024 by zhangzhenyu13
7
Start training but only output config information
#61 opened Mar 2, 2024 by Beatlesso
3
save model meet problem
#56 opened Feb 23, 2024 by 18140663659
1
TypeError: buffer is too small for requested array
#54 opened Feb 21, 2024 by 18140663659
Could you provide tokenized continue-pretraining dataset for reproduction?
#51 opened Jan 23, 2024 by gywlssww
3
KeyError: 'state'
#49 opened Jan 22, 2024 by changheecho
2
Avoid OOM using deepspeed zero-stage
#47 opened Jan 16, 2024 by gywlssww
3
在进行Building trainer时，训练会卡住；
#46 opened Jan 11, 2024 by coderchem
1
model.prune_params() NotImplementedError: Could not run 'aten::nonzero'
#43 opened Dec 25, 2023 by YanxiZSQ
3
The implementation of dynamic batch loading code seems inconsistent with the pseudo-code in the paper
#42 opened Dec 25, 2023 by YWMditto
1
LanguageCrossEntropy logs nan when bash pruning.sh
#34 opened Dec 6, 2023 by YanxiZSQ
6
Pruning crash at iteration 592.
#32 opened Dec 6, 2023 by lippman1125
6
ProTip! Add no:assignee to see everything that’s not assigned.