Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

SNOW-1490507: Improve file encryption/compression handling #887

Open
sfc-gh-dszmolka opened this issue Aug 18, 2023 · 1 comment
Open

SNOW-1490507: Improve file encryption/compression handling #887

sfc-gh-dszmolka opened this issue Aug 18, 2023 · 1 comment
Assignees
@sfc-gh-snow-drivers-warsaw-dl
Labels
enhancement The issue is a request for improvement or a new feature status-triage_done Initial triage done, will be further handled by the driver team

Comments

@sfc-gh-dszmolka
Copy link
Contributor

What is the current behaviour?

For operations like (including, but not exclusive to) PUT and GET, when reading from file, the temporary file is needed to verify, even if we may perform operation in memory.

While due to recent improvements the temp directory is now customizable, there still might be improvements considered.

What is the desired behavior?

Reviewing and improving the scenarios where we use temp files today. For example, use streams instead, without requiring temp files.

How would this improve gosnowflake?

Would improve usability in environments where the local filesystem is read-only.

References, Other Background

Started as a child issue of #832 to track the second request.

What is your Snowflake account identifier, if any?

N/A
@sfc-gh-dszmolka sfc-gh-dszmolka added the enhancement The issue is a request for improvement or a new feature label Aug 18, 2023
@sfc-gh-dszmolka sfc-gh-dszmolka changed the title SNOW-895589 Improve file encryption/compression handling Improve file encryption/compression handling Aug 18, 2023
@sfc-gh-dszmolka
Copy link
Contributor Author

Q3 is fully booked for now, so we'll consider this for later quarters.

@sfc-gh-dszmolka sfc-gh-dszmolka mentioned this issue Aug 18, 2023
Closed
@sfc-gh-dszmolka sfc-gh-dszmolka added the status-triage_done Initial triage done, will be further handled by the driver team label Mar 12, 2024
@sfc-gh-dprzybysz sfc-gh-dprzybysz changed the title Improve file encryption/compression handling SNOW-1490507: Improve file encryption/compression handling Dec 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@sfc-gh-snow-drivers-warsaw-dl sfc-gh-snow-drivers-warsaw-dl

Labels
enhancement The issue is a request for improvement or a new feature status-triage_done Initial triage done, will be further handled by the driver team
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@sfc-gh-dszmolka @sfc-gh-anugupta @sfc-gh-snow-drivers-warsaw-dl