New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Use peewee iterator in loaders #1495

Draft

pylipp wants to merge 2 commits into master from use-peewee-iterator-in-loaders

Contributor

pylipp commented Aug 29, 2024

cf. http://docs.peewee-orm.com/en/latest/peewee/querying.html#iterating-over-large-result-sets

To reduce the amount of memory used by peewee when iterating over a
query, use the iterator() method. This method allows you to iterate
without caching each model returned, using much less memory when
iterating over large result sets.

pylipp added 2 commits

August 29, 2024 15:50


          Use peewee iterator in loaders

01c6ee3

cf. http://docs.peewee-orm.com/en/latest/peewee/querying.html#iterating-over-large-result-sets

> To reduce the amount of memory used by peewee when iterating over a
> query, use the iterator() method. This method allows you to iterate
> without caching each model returned, using much less memory when
> iterating over large result sets.


          Mention iterator() trick in README

48300fd

[skip ci]

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet