Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Expand the input buffer in dt_read_csv #104

Open
Kiyoshika opened this issue Jun 16, 2023 · 1 comment
Open

Expand the input buffer in dt_read_csv #104

Kiyoshika opened this issue Jun 16, 2023 · 1 comment
Labels
enhancement New feature or request priority: low

Comments

@Kiyoshika
Copy link
Owner

Right now the input buffer when reading a line from file is 4096 bytes (including null term), but this is limiting for larger files. Will need to maintain one heap-allocated buffer and keep reusing per line (resizing if necessary) to support larger input files.
@Kiyoshika Kiyoshika added enhancement New feature or request priority: low labels Jun 16, 2023
@Kiyoshika Kiyoshika modified the milestone: v0.1.0 Jun 17, 2023
@Kiyoshika
Copy link
Owner Author

NOTE: As of fc20acc this now also applies to dt_table_to_csv

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request priority: low
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@Kiyoshika