Cant download the datasets

[9Cirno9]

The progress has always been 0%，my env is：

Do you have any suggestions？Thanks a lot！

[manuel-lincbiotech]

Same problem here, Just followed the instruction as in the readme also tried with a different python version 3.9. But since @9Cirno9 seems to have the same problem I don´t think it's related to python version. After a while in 0% in just ends up with the error:

Found 489 cases to download
Dowloading case_00000...: 0%| | 0/489 [00:00<?, ?it/s]
Failed to download case_00000. Retrying...
Dowloading case_00000...: 0%| | 0/489 [10:36<?, ?it/s]
Traceback (most recent call last):
File "c:\users\user\desktop\minerva projects\kidney_dataset\kits23\kits23\download.py", line 38, in download_case
urllib.request.urlretrieve(url, str(tmp_pth))
File "C:\Users\User\AppData\Local\Programs\Python\Python39\lib\urllib\request.py", line 278, in urlretrieve
raise ContentTooShortError(
urllib.error.ContentTooShortError: <urlopen error retrieval incomplete: got only 225683164 out of 225959569 bytes>

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "C:\Users\User\Desktop\minerva projects\kidney_dataset\venv\Scripts\kits23_download_data-script.py", line 33, in
sys.exit(load_entry_point('kits23', 'console_scripts', 'kits23_download_data')())
File "c:\users\user\desktop\minerva projects\kidney_dataset\kits23\kits23\entrypoints.py", line 9, in download_data_entrypoint
download_dataset()
File "c:\users\user\desktop\minerva projects\kidney_dataset\kits23\kits23\download.py", line 77, in download_dataset
download_case(case_num, pbar)
File "c:\users\user\desktop\minerva projects\kidney_dataset\kits23\kits23\download.py", line 52, in download_case
download_case(case_num, pbar, retry=False)
File "c:\users\user\desktop\minerva projects\kidney_dataset\kits23\kits23\download.py", line 56, in download_case
cleanup(tmp_pth, e)
File "c:\users\user\desktop\minerva projects\kidney_dataset\kits23\kits23\download.py", line 29, in cleanup
raise(e)
File "c:\users\user\desktop\minerva projects\kidney_dataset\kits23\kits23\download.py", line 38, in download_case
urllib.request.urlretrieve(url, str(tmp_pth))
File "C:\Users\User\AppData\Local\Programs\Python\Python39\lib\urllib\request.py", line 278, in urlretrieve
raise ContentTooShortError(
urllib.error.ContentTooShortError: <urlopen error retrieval incomplete: got only 225720172 out of 225959569 bytes>

Any suggestions or alternatives appreciated
Thanks in advance.

[buni-alex]

Same problem. When they work, the downloads are very very slow, but most of them fail anyway after a long period of waiting. It also always seems like only a few bytes off the total fail to download.

[dt-yuhui]

@neheller Same question. Any suggestion?

[loijilai]

Same here

[YongchengYAO]

same

[4lparslan]

Same problem here, Just followed the instruction as in the readme also tried with a different python version 3.9. But since @9Cirno9 seems to have the same problem I don´t think it's related to python version. After a while in 0% in just ends up with the error:

Found 489 cases to download
Dowloading case_00000...: 0%| | 0/489 [00:00<?, ?it/s]
Failed to download case_00000. Retrying...
Dowloading case_00000...: 0%| | 0/489 [10:36<?, ?it/s]
Traceback (most recent call last):
File "c:\users\user\desktop\minerva projects\kidney_dataset\kits23\kits23\download.py", line 38, in download_case
urllib.request.urlretrieve(url, str(tmp_pth))
File "C:\Users\User\AppData\Local\Programs\Python\Python39\lib\urllib\request.py", line 278, in urlretrieve
raise ContentTooShortError(
urllib.error.ContentTooShortError: <urlopen error retrieval incomplete: got only 225683164 out of 225959569 bytes>
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "C:\Users\User\Desktop\minerva projects\kidney_dataset\venv\Scripts\kits23_download_data-script.py", line 33, in
sys.exit(load_entry_point('kits23', 'console_scripts', 'kits23_download_data')())
File "c:\users\user\desktop\minerva projects\kidney_dataset\kits23\kits23\entrypoints.py", line 9, in download_data_entrypoint
download_dataset()
File "c:\users\user\desktop\minerva projects\kidney_dataset\kits23\kits23\download.py", line 77, in download_dataset
download_case(case_num, pbar)
File "c:\users\user\desktop\minerva projects\kidney_dataset\kits23\kits23\download.py", line 52, in download_case
download_case(case_num, pbar, retry=False)
File "c:\users\user\desktop\minerva projects\kidney_dataset\kits23\kits23\download.py", line 56, in download_case
cleanup(tmp_pth, e)
File "c:\users\user\desktop\minerva projects\kidney_dataset\kits23\kits23\download.py", line 29, in cleanup
raise(e)
File "c:\users\user\desktop\minerva projects\kidney_dataset\kits23\kits23\download.py", line 38, in download_case
urllib.request.urlretrieve(url, str(tmp_pth))
File "C:\Users\User\AppData\Local\Programs\Python\Python39\lib\urllib\request.py", line 278, in urlretrieve
raise ContentTooShortError(
urllib.error.ContentTooShortError: <urlopen error retrieval incomplete: got only 225720172 out of 225959569 bytes>

Any suggestions or alternatives appreciated Thanks in advance.

I was facing the same issue and i had to restart the download process multiple times. If you have some time, the solution is simple. Create a .bat file and automate the retry process:

@echo off
echo Venv activating
call "D:\Projects\Kits23\.venv\Scripts\activate.bat"

:loop
echo [%time%] Downloading starting...
call kits23_download_data

if %ERRORLEVEL% neq 0 (
    echo.
    echo [%time%] !!! ERROR !!! 
    echo Waiting for 5 seconds and retrying...
    echo.
    timeout /t 5
    goto loop
)

echo.
echo [%time%] Downloading completed successfully.
pause