Skip to content

Commit

Permalink
Update best_practices/datasets.md: Polars description
Browse files Browse the repository at this point in the history
  • Loading branch information
suvayu authored Sep 14, 2024
1 parent 0501b63 commit 5da4240
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion best_practices/datasets.md
Original file line number Diff line number Diff line change
Expand Up @@ -46,7 +46,7 @@ SQLite is a transactional database, so if you have a dataset that is changing wi
- Vaex
- Vaex is an alternative that focuses on out-of-core processing (larger than memory), and has some lazy evaluation capabilities.
- Polars
- This is a much newer library, mostly written in Rust. Compared to pandas, it is multi-threaded and does lazy evaluation with query optimisation, so much more performant. However since it is newer, documentation is not as complete. It also allows you to write your own custom extensions in Rust.
- An alternative to Pandas (started in 2020), which is primarily written in Rust. Compared to pandas, it is multi-threaded and does lazy evaluation with query optimisation, so much more performant. However since it is newer, documentation is not as complete. It also allows you to write your own custom extensions in Rust.

## Distributed/multi-node data processing libraries
- Dask
Expand Down

0 comments on commit 5da4240

Please sign in to comment.