Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

crash with Julia >= 1.8.4 under Windows 11 #153

Closed
mlesnoff opened this issue Jan 5, 2023 · 15 comments
Closed

crash with Julia >= 1.8.4 under Windows 11 #153

mlesnoff opened this issue Jan 5, 2023 · 15 comments

Comments

@mlesnoff
Copy link

mlesnoff commented Jan 5, 2023

Another point. I am using XGBoost.jl v2.2.0, under Windows 11.

It works fine with Julia 1.8.3:

julia> versioninfo()
Julia Version 1.8.3
Commit 0434deb161 (2022-11-14 20:14 UTC)
Platform Info:
OS: Windows (x86_64-w64-mingw32)
CPU: 16 × Intel(R) Core(TM) i9-10885H CPU @ 2.40GHz
WORD_SIZE: 64
LIBM: libopenlibm
LLVM: libLLVM-13.0.1 (ORCJIT, skylake)
Threads: 8 on 16 virtual cores
Environment:
JULIA_EDITOR = code
JULIA_NUM_THREADS = 8

But when I uses Julia 1.8.4:

julia> versioninfo()
Julia Version 1.8.4
Commit 00177ebc4f (2022-12-23 21:32 UTC)
Platform Info:
OS: Windows (x86_64-w64-mingw32)
CPU: 16 × Intel(R) Core(TM) i9-10885H CPU @ 2.40GHz
WORD_SIZE: 64
LIBM: libopenlibm
LLVM: libLLVM-13.0.1 (ORCJIT, skylake)
Threads: 8 on 16 virtual cores
Environment:
JULIA_EDITOR = code
JULIA_NUM_THREADS = 8

running any function of XGBoost.jl kills my Julia session, for instance after doing:

using XGBoost
(X, y) = (randn(100,4), randn(100))

then the command below;
bst = xgboost((X, y))
kills the process and closes directly Julia without any printed error in the terminal.

I created a thread at Discourse, but got no answer. I have the same problem with LIBSVM.jl (that also uses an external library, as does XGBoost; this may be linked). I created an issue there but the problem was not solved.

Did somebody observe the same problem and know what is happening?

@ExpandingMan
Copy link
Collaborator

Haven't seen anything like this on linux.

We are also seeing an unexplained error in windows in CI/CD right now. Last time a PR was merged windows was passing CI/CD, so it might be a dependency causing the issue, or it might be a Julia bug.

Help from somebody with windows would be appreciated, there's nothing I can do here.

@devmotion
Copy link
Contributor

We are also seeing an unexplained error in windows in CI/CD right now. Last time a PR was merged windows was passing CI/CD, so it might be a dependency causing the issue, or it might be a Julia bug.

The passing tests in the PR (I assume you were referring to #142) used Julia 1.8.3: https://github.com/dmlc/XGBoost.jl/actions/runs/3742381823/jobs/6353253840#step:3:12 Whereas the merge commit on master failed on Julia 1.8.4 (https://github.com/dmlc/XGBoost.jl/actions/runs/3794879068/jobs/6453416312#step:3:12). Based on the OP the Julia version alone might explain the test failure on the master branch.

@mlesnoff
Copy link
Author

The issue is still observed on v1.9.0-beta3 under Windows11: Julia crashes when using any function of XGBoost.jl (same for LIBSVM.jl, which is also a C/C++ wrapper)

See Discourse

@mlesnoff mlesnoff changed the title crash with Julia 1.8.4 under Windows 11 crash with Julia >= 1.8.4 under Windows 11 Jan 23, 2023
@OkonSamuel
Copy link

OkonSamuel commented Jan 25, 2023

Another point. I am using XGBoost.jl v2.2.0, under Windows 11.

It works fine with Julia 1.8.3:

julia> versioninfo()
Julia Version 1.8.3
Commit 0434deb161 (2022-11-14 20:14 UTC)
Platform Info:
OS: Windows (x86_64-w64-mingw32)
CPU: 16 × Intel(R) Core(TM) i9-10885H CPU @ 2.40GHz
WORD_SIZE: 64
LIBM: libopenlibm
LLVM: libLLVM-13.0.1 (ORCJIT, skylake)
Threads: 8 on 16 virtual cores
Environment:
JULIA_EDITOR = code
JULIA_NUM_THREADS = 8

But when I uses Julia 1.8.4:

julia> versioninfo()
Julia Version 1.8.4
Commit 00177ebc4f (2022-12-23 21:32 UTC)
Platform Info:
OS: Windows (x86_64-w64-mingw32)
CPU: 16 × Intel(R) Core(TM) i9-10885H CPU @ 2.40GHz
WORD_SIZE: 64
LIBM: libopenlibm
LLVM: libLLVM-13.0.1 (ORCJIT, skylake)
Threads: 8 on 16 virtual cores
Environment:
JULIA_EDITOR = code
JULIA_NUM_THREADS = 8

running any function of XGBoost.jl kills my Julia session, for instance after doing:

using XGBoost
(X, y) = (randn(100,4), randn(100))

then the command below; bst = xgboost((X, y)) kills the process and closes directly Julia without any printed error in the terminal.

I created a thread at Discourse, but got no answer. I have the same problem with LIBSVM.jl (that also uses an external library, as does XGBoost; this may be linked). I created an issue there but the problem was not solved.

Did somebody observe the same problem and know what is happening?

I just experienced this error on my Windows PC running Julia 1.8.4

@mlesnoff
Copy link
Author

I just experienced this error on my Windows PC running Julia 1.8.4

Do you also observe this problem with LIBSVM.jl?

@OkonSamuel
Copy link

I just experienced this error on my Windows PC running Julia 1.8.4

Do you also observe this problem with LIBSVM.jl?

Yes, it's a similar problem with LIBSVM.jl

@mlesnoff
Copy link
Author

mlesnoff commented Feb 2, 2023

Yes, it's a similar problem with LIBSVM.jl

Under Windows11, both packages do not work even with v1.9.0-beta3.
At present, to use XGboost.jl or LIBSVM.jl, I don't see other solution than staying on Julia 1.8.3

@tylerjthomas9
Copy link
Contributor

The issue is on the Julia side. I know that it's being actively investigated, but it's quite difficult to debug the exact cause and fix it, so it could take a while before it's resolved.

@mlesnoff
Copy link
Author

mlesnoff commented Feb 2, 2023

The issue is on the Julia side. I know that it's being actively investigated, but it's quite difficult to debug the exact cause and fix it, so it could take a while before it's resolved.

Thanks for the info. Good news it is investigated

@mlesnoff
Copy link
Author

mlesnoff commented Mar 20, 2023

The issue is on the Julia side. I know that it's being actively investigated, but it's quite difficult to debug the exact cause and fix it, so it could take a while before it's resolved.

If I well understood, it seems that the issue is not exactly on the Julia side, as explained by @mkitti here

@ExpandingMan
Copy link
Collaborator

I have zero ability to diagnose or test windows issues, so I should state for posterity that we could use a windows maintainer.

@mkitti
Copy link

mkitti commented Mar 20, 2023

To summarize findings, there is an extraneous free somewhere. Mose is wondering if this is because we disabled TLS on Windows for gcc 12.

@giordano
Copy link

Fixed in Julia master by JuliaLang/julia#50135

@ExpandingMan
Copy link
Collaborator

My understanding is that this was fixed with Julia 1.9.2, so I'm going to close this issue. Of course, please re-open if I'm mistaken.

@mlesnoff
Copy link
Author

My understanding is that this was fixed with Julia 1.9.2, so I'm going to close this issue. Of course, please re-open if I'm mistaken.

yes, on my side, it works now
Thanks for your help

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

7 participants