Skip to content

Issues: Lightning-AI/litdata

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

37 Open 31 Closed
37 Open 31 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Using a streaming dataloader with an unbalanced dataset yields unexpected batch sizes. bug Something isn't working help wanted Extra attention is needed
#199 opened Jun 29, 2024 by esivonxay-cognitiv
1
Add support for encrypting / decrypting the chunks + API Keys enhancement New feature or request help wanted Extra attention is needed
#197 opened Jun 29, 2024 by tchaton
Add support for Mosaic Streaming WDS data format enhancement New feature or request help wanted Extra attention is needed
#195 opened Jun 28, 2024 by tchaton
When providing a local path to the optimize method, make it work in a distributed settings for Jobs enhancement New feature or request help wanted Extra attention is needed
#193 opened Jun 27, 2024 by tchaton
Add support for parquet files for storing the chunks bug Something isn't working help wanted Extra attention is needed
#191 opened Jun 27, 2024 by tchaton
LitData doesn't support s3 bucket connection outside server enhancement New feature or request help wanted Extra attention is needed
#183 opened Jun 25, 2024 by sanyalsunny111
11
Using fsspec to download files enhancement New feature or request help wanted Extra attention is needed
#181 opened Jun 23, 2024 by samsja
3
Batch size beginning to vary half way through epoch bug Something isn't working help wanted Extra attention is needed
#179 opened Jun 21, 2024 by MarcoForte
6
Magic FileSerializer is causing issues bug Something isn't working help wanted Extra attention is needed
#178 opened Jun 21, 2024 by tchaton
1
AttributeError: np.sctypes was removed in the NumPy 2.0 release. bug Something isn't working help wanted Extra attention is needed
#175 opened Jun 17, 2024 by bhimrazy
8
Warning Message When Using StreamingDataset with DDP bug Something isn't working help wanted Extra attention is needed
#172 opened Jun 14, 2024 by taemincho
2
LitData leaves a status.json in current working dir bug Something isn't working help wanted Extra attention is needed
#159 opened Jun 7, 2024 by awaelchli
2
ValueError: The provided None isn't supported. bug Something isn't working help wanted Extra attention is needed
#158 opened Jun 7, 2024 by awaelchli
1
Error: All weights must be positive bug Something isn't working help wanted Extra attention is needed
#157 opened Jun 7, 2024 by awaelchli
2
Ram increasing during first epoch of training bug Something isn't working help wanted Extra attention is needed
#141 opened May 24, 2024 by rakro101
4
Data shard delation with multi GPU does not work bug Something isn't working help wanted Extra attention is needed
#140 opened May 24, 2024 by rakro101
4
Training slowed down as time progress with litdata streaming dataset bug Something isn't working help wanted Extra attention is needed
#138 opened May 22, 2024 by ouj
3
Make optimize continue from last checkpoint after crash enhancement New feature or request help wanted Extra attention is needed
#137 opened May 22, 2024 by cgebbe
3
Adding breakpoint in random_images function crashes pdb bug Something isn't working help wanted Extra attention is needed
#134 opened May 21, 2024 by cgebbe
4
DataChunkRecipe is not working when used in litgpt's TinyLlama pretraining example bug Something isn't working help wanted Extra attention is needed
#130 opened May 15, 2024 by wen020
5
Pytorch lighting Fabric + lit data + DDP hangs when finishing epoch bug Something isn't working help wanted Extra attention is needed
#129 opened May 13, 2024 by miguelalba96
3
Stream selected channels enhancement New feature or request help wanted Extra attention is needed
#128 opened May 13, 2024 by robmarkcole
Optimizing dictionary data structures fails when using a partially initialized function
#120 opened May 6, 2024 by enrico-stauss
2
Slow Dataset Preprocessing due to CPU affinity (?) issues bug Something isn't working help wanted Extra attention is needed
#118 opened May 2, 2024 by mgolub2
5
optimize function on multiple machine writing to local pathes enhancement New feature or request help wanted Extra attention is needed
#105 opened Apr 22, 2024 by rakro101
ProTip! Add no:assignee to see everything that’s not assigned.