"__nv_bfloat162" has already been defined

[wolfljj]

system:windows 11
build deepspeed use build_win.bat

error: class "__nv_bfloat162" has already been defined (previous definition at line 4787 of C:/Program Files/NVIDIA GPU Computing Toolkit/CUDA/v12.6/include\cuda_bf16.h)
using __nv_bfloat162 = __half2;
^
1 error detected in the compilation of "csrc/transformer/inference/csrc/gelu.cu".
error: command 'C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.6\bin\nvcc' failed with exit code 4294967295

[loadams]

Hi @wolfljj - can you share more information about your system? Python version, orch version, pip list, nvcc version, msvc version?