What's the minimal GPU memory requirement?

[bigcat26]

OS: Windows 10
onnxruntime version: 1.12.1
GPU: GTX 760TI, 2GB

When I use prebuild onnxruntime-gpu for inferencing:

session = onnxruntime.InferenceSession(path, providers=['CUDAExecutionProvider'])

I got an error:

File d:\condaenv\torch-cpu\lib\site-packages\onnxruntime\capi\onnxruntime_inference_collection.py:347, in InferenceSession.__init__(self, path_or_bytes, sess_options, providers, provider_options, **kwargs)
    344 disabled_optimizers = kwargs["disabled_optimizers"] if "disabled_optimizers" in kwargs else None
    346 try:
--> 347     self._create_inference_session(providers, provider_options, disabled_optimizers)
    348 except ValueError:
    349     if self._enable_fallback:

File d:\condaenv\torch-cpu\lib\site-packages\onnxruntime\capi\onnxruntime_inference_collection.py:395, in InferenceSession._create_inference_session(self, providers, provider_options, disabled_optimizers)
    392     disabled_optimizers = set(disabled_optimizers)
    394 # initialize the C++ InferenceSession
--> 395 sess.initialize_session(providers, provider_options, disabled_optimizers)
    397 self._sess = sess
    398 self._sess_options = self._sess.session_options

RuntimeException: [ONNXRuntimeError] : 6 : RUNTIME_EXCEPTION : Exception during initialization: D:\a\_work\1\s\onnxruntime\core\providers\cuda\cuda_call.cc:122 onnxruntime::CudaCall D:\a\_work\1\s\onnxruntime\core\providers\cuda\cuda_call.cc:116 onnxruntime::CudaCall CUBLAS failure 3: CUBLAS_STATUS_ALLOC_FAILED ; GPU=0 ; hostname=BIGCAT-PC ; expr=cublasCreate(&cublas_handle_);

When I build onnxruntime, I also got an error while testing:

1: [ RUN      ] CApiTest.AllocateInitializersFromNonArenaMemory
1: 2022-10-03 13:18:36.5274685 [E:onnxruntime:, inference_session.cc:1500 onnxruntime::InferenceSession::Initialize::<lambda_8adf38287c1b7f850a0dee0855633093>::operator ()] Exception during initialization: D:\code\onnxruntime\onnxruntime\core\providers\cuda\cuda_call.cc:124 onnxruntime::CudaCall D:\code\onnxruntime\onnxruntime\core\providers\cuda\cuda_call.cc:117 onnxruntime::CudaCall CUBLAS failure 3: CUBLAS_STATUS_ALLOC_FAILED ; GPU=0 ; hostname=BIGCAT-PC ; expr=cublasCreate(&cublas_handle_);
1:
1:
1: unknown file: error: C++ exception with description "Exception during initialization: D:\code\onnxruntime\onnxruntime\core\providers\cuda\cuda_call.cc:124 onnxruntime::CudaCall D:\code\onnxruntime\onnxruntime\core\providers\cuda\cuda_call.cc:117 onnxruntime::CudaCall CUBLAS failure 3: CUBLAS_STATUS_ALLOC_FAILED ; GPU=0 ; hostname=BIGCAT-PC ; expr=cublasCreate(&cublas_handle_);
1:
1: " thrown in the test body.
1: [  FAILED  ] CApiTest.AllocateInitializersFromNonArenaMemory (4 ms)
1: [ RUN      ] CApiTest.ConfigureCudaArenaAndDemonstrateMemoryArenaShrinkage
1: 2022-10-03 13:18:36.5327963 [E:onnxruntime:, inference_session.cc:1500 onnxruntime::InferenceSession::Initialize::<lambda_8adf38287c1b7f850a0dee0855633093>::operator ()] Exception during initialization: D:\code\onnxruntime\onnxruntime\core\providers\cuda\cuda_call.cc:124 onnxruntime::CudaCall D:\code\onnxruntime\onnxruntime\core\providers\cuda\cuda_call.cc:117 onnxruntime::CudaCall CUBLAS failure 3: CUBLAS_STATUS_ALLOC_FAILED ; GPU=0 ; hostname=BIGCAT-PC ; expr=cublasCreate(&cublas_handle_);
1:
1:
1: unknown file: error: C++ exception with description "Exception during initialization: D:\code\onnxruntime\onnxruntime\core\providers\cuda\cuda_call.cc:124 onnxruntime::CudaCall D:\code\onnxruntime\onnxruntime\core\providers\cuda\cuda_call.cc:117 onnxruntime::CudaCall CUBLAS failure 3: CUBLAS_STATUS_ALLOC_FAILED ; GPU=0 ; hostname=BIGCAT-PC ; expr=cublasCreate(&cublas_handle_);
1:
1: " thrown in the test body.
1: [  FAILED  ] CApiTest.ConfigureCudaArenaAndDemonstrateMemoryArenaShrinkage (6 ms)
1: [ RUN      ] CApiTest.TestConfigureCUDAProviderOptions
1: 2022-10-03 13:18:36.5413395 [E:onnxruntime:, inference_session.cc:1500 onnxruntime::InferenceSession::Initialize::<lambda_8adf38287c1b7f850a0dee0855633093>::operator ()] Exception during initialization: D:\code\onnxruntime\onnxruntime\core\providers\cuda\cuda_call.cc:124 onnxruntime::CudaCall D:\code\onnxruntime\onnxruntime\core\providers\cuda\cuda_call.cc:117 onnxruntime::CudaCall CUBLAS failure 3: CUBLAS_STATUS_ALLOC_FAILED ; GPU=0 ; hostname=BIGCAT-PC ; expr=cublasCreate(&cublas_handle_);
1:
1:
1: unknown file: error: C++ exception with description "Exception during initialization: D:\code\onnxruntime\onnxruntime\core\providers\cuda\cuda_call.cc:124 onnxruntime::CudaCall D:\code\onnxruntime\onnxruntime\core\providers\cuda\cuda_call.cc:117 onnxruntime::CudaCall CUBLAS failure 3: CUBLAS_STATUS_ALLOC_FAILED ; GPU=0 ; hostname=BIGCAT-PC ; expr=cublasCreate(&cublas_handle_);
1:

[ytaous]

Do u have all required libs in place? https://onnxruntime.ai/docs/execution-providers/CUDA-ExecutionProvider.html#requirements