Skip to content

Conversation

QueensGambit
Copy link
Owner

@QueensGambit QueensGambit commented Sep 18, 2024

This PR updates the TensorrtAPI to TensorRT 10.

  • delete retrieve_indices_by_name()
  • add member SampleUniquePtr runtime
  • replace getBindingDimensions() by getTensorShape()
  • replace setBindingDimensions() by setInputShape()
  • add link_libraries(stdc++fs) to CMakeLists.txt
  • add include_directories("$ENV{TENSORRT_PATH}/samples/") to CMakeLists.txt

Unfortunately, TensorRT 10 is no longer working on older GPUs like GTX 1080ti.

* delete retrieve_indices_by_name()
* add member SampleUniquePtr<IRuntime> runtime
* replace getBindingDimensions() by getTensorShape()
* replace setBindingDimensions() by setInputShape()
* add link_libraries(stdc++fs) to CMakeLists.txt
* add include_directories("$ENV{TENSORRT_PATH}/samples/") to
CMakeLists.txt
@QueensGambit
Copy link
Owner Author

Update: Also added BACKEND_TENSORRT_8 mode for older GPUs.

@QueensGambit QueensGambit merged commit 025793a into master Jan 21, 2025
0 of 3 checks passed
@QueensGambit QueensGambit deleted the tensorrt_10 branch January 21, 2025 16:23
@QueensGambit QueensGambit restored the tensorrt_10 branch January 30, 2025 17:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant