Skip to content

Issues: mosaicml/streaming

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

50 Open 125 Closed
50 Open 125 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

write to S3 is very slow bug Something isn't working
#812 opened Oct 25, 2024 by charliedream1
Choose JPEG compression level enhancement New feature or request
#811 opened Oct 24, 2024 by cabreraalex
Running into "FileExistsError: [Errno 17] File exists: '/000000_epoch_shape'" even with single GPU bug Something isn't working
#802 opened Oct 13, 2024 by deepanshu-a2z
6
MosaicML-Streaming on Databricks
#801 opened Oct 10, 2024 by gtmdotme
9
Support for on-the-fly filtering enhancement New feature or request
#800 opened Oct 9, 2024 by ColinToft
Make epoch_sample_ids cachable enhancement New feature or request
#792 opened Sep 28, 2024 by janEbert
2
Dataset does not work after stopping training bug Something isn't working
#781 opened Sep 15, 2024 by AugustDev
1
Sparse Numpy Arrays enhancement New feature or request
#780 opened Sep 10, 2024 by Matagi1996
JointWriter: Allow shard file appending bug Something isn't working
#775 opened Sep 5, 2024 by janEbert
2
MemoryError: Unable to allocate bug Something isn't working
#771 opened Sep 2, 2024 by AugustDev
1
File exists: '/000000_epoch_shape' when using the ddp strategy from pytorch lightning bug Something isn't working
#767 opened Aug 25, 2024 by elbamos
23
Estimate total shards at the beginning of data conversion enhancement New feature or request
#742 opened Aug 3, 2024 by abhijithneilabraham
1
huge temp files while uploading data using MDS writer bug Something isn't working
#734 opened Jul 24, 2024 by MaxxP0
2
GCS: Mosiacml-streaming overloads the GCP metadata service when too many processes are used. bug Something isn't working
#728 opened Jul 18, 2024 by smspillaz
2
Download optimal for device_per_stream batching method.
#726 opened Jul 16, 2024 by huxuan
4
Replication changes sample order bug Something isn't working
#725 opened Jul 15, 2024 by CodeCreator
3
'File exists: "/00000_locals"' when integrated with deepspeed training scripts bug Something isn't working
#717 opened Jul 8, 2024 by Clement25
4
All processes allocate memory on rank 0 during StreamingDataset initialization in a distributed setting bug Something isn't working
#716 opened Jul 2, 2024 by ohallstrom
4
Optional dependency for different storages? enhancement New feature or request
#709 opened Jun 24, 2024 by huxuan
2
Suboptimal usage of 8xH100 GPUs - Streaming dataloader speed significantly fluctuates across batches bug Something isn't working
#686 opened May 25, 2024 by VSehwag
7
Last entry in the dataset is causing "Relative sample index $x is not present" error bug Something isn't working
#677 opened May 20, 2024 by isidentical
3
clean_stale_shared_memory duplicating the master process when called in a train.py script bug Something isn't working
#663 opened Apr 26, 2024 by antoinedandi
2
Support large size index.json (20GB +) enhancement New feature or request
#662 opened Apr 25, 2024 by andreamad8
2
Does it support Preference data (for training Reward / DPO)? enhancement New feature or request
#656 opened Apr 17, 2024 by ericxsun
4
Azure Databricks MDS write ops in error: MapInPandas write_mds gives message Spark higher-order functions are not supported in Unity Catalog bug Something isn't working
#655 opened Apr 15, 2024 by wolliq
2
ProTip! Exclude everything labeled bug with -label:bug.