[BUG] dcc.Upload errors with big files

[celia-lm]

Context

• Creating an app where end users can upload files >1GB with dcc.Upload.
• The app code is the same as the first sample app of the doc page: https://dash.plotly.com/dash-core-components/upload
• max_size is set to -1

Issues

• If I run the app with gunicorn or in my local env, some time after I upload the file the tab freezes or I get an internal server error (NOT a timeout because dcc.Upload has some kind of async functionality). > This is similar to what this issue describes: How should I solve with the error 500 when using dcc.Upload() #1728

- If I run the app with Python in a Dash Enterprise workspace, I get a callback error which is kind of weird. If you look at the callback code and the print statements in the terminal, we only get two values despite having three Inputs. The first one is probably an empty string or list, which causes the if statement to “fail” (since list_of_contents is not None), so the error we see is related to code after the if statement. The real problem is that, even if the filenames and dates get passed correctly, the content is empty > This issue has been described before in the forum: (https://community.plotly.com/t/upload-500mb-csv-but-content-is-empty/83297.

Additional context

• I've tried dash-uploader (link) and it works okay but I’m concerned about (1) privacy (all files are accessible by all users by default, as opposed to session-specific storage) and (2) memory (how does saving many big files affect the app memory/performance)
• dash-uploader is not an official component and it’s not maintained, which raises some concerns regarding production environment.

Request

• dcc.Upload being able to handle big files (500MB, >1GB, etc).
• If the file is not been processed correctly (list_of_contents is empty) show a more helpful error.

[CNFeffery]

@celia-lm I suggest you use other upload components with rich features, cooperate with flask or fastapi streaming file upload service to achieve more efficient file upload function:

https://fac.feffery.tech/AntdUpload
https://fac.feffery.tech/AntdDraggerUpload

[Coding-with-Adam]

@CNFeffery
I see you promoting the feffery-antd-components fairly often.

Are you able to translate those docs to English?

For example, in the comment above you suggest Celia use the AntdUpload, but it's all in a different language, which will make it very hard to understand how to use.

[CNFeffery]

@Coding-with-Adam That would be a huge project to translate so many documents, I suggest to use some browser translate extensions in current stage(such as https://immersivetranslate.com/ or other AI-driven tools), which we often use to translate English to other language.