Code

feat: Support weight streaming#3111

Code

Merged

peri044 merged 19 commits intopytorch:mainpytorch/TensorRT:mainfrom keehyuna:feat_weight_streamingkeehyuna/TensorRT:feat_weight_streamingCopy head branch name to clipboardOct 23, 2024

+680-6

Commits

Commits on Oct 18, 2024

• feat: Support weight streaming

  keehyuna

  committed
  2e8b563

  Copy full SHA for 2e8b563

• chore: seperated compile options and runtime option for ws

  keehyuna

  committed
  79c3c3a

  Copy full SHA for 79c3c3a

• chore: reset context in rt module

  keehyuna

  committed
  b81949e

  Copy full SHA for b81949e

• chore: recreate context decorator

  keehyuna

  committed
  9db1561

  Copy full SHA for 9db1561

• chore: Move context decorator into rt module

  keehyuna

  committed
  8ab068d

  Copy full SHA for 8ab068d

• chore: context manager for weight streaming

  keehyuna

  committed
  af79f76

  Copy full SHA for af79f76

• chore: Rename functions

  keehyuna

  committed
  d2bda5e

  Copy full SHA for d2bda5e

• chore: rebase and update

  keehyuna

  committed
  46a8ea5

  Copy full SHA for 46a8ea5

• chore: changed to min budget + streamable budget

  keehyuna

  committed
  4df7ea5

  Copy full SHA for 4df7ea5

• chore: cpp runtime update for min + streamable budget

  keehyuna

  committed
  7356fcb

  Copy full SHA for 7356fcb

• chore: promoted type in cat ops for only multiple input

  keehyuna

  committed
  8d06793

  Copy full SHA for 8d06793

• chore: import converter_utils from dynamo

  keehyuna

  committed
  eb7cad6

  Copy full SHA for eb7cad6

• chore: reset context in weight budget setting

  keehyuna

  committed
  82f6528

  Copy full SHA for 82f6528

• chore: changed to budget range in [0, streamable budget]

  keehyuna

  committed
  0bcd264

  Copy full SHA for 0bcd264

• chore: rebase and update weight streaming context

  keehyuna

  committed
  2439df9

  Copy full SHA for 2439df9

• chore: add document

  keehyuna

  committed
  665089d

  Copy full SHA for 665089d

• chore: uniform name using *device_memory_budget

  keehyuna

  committed
  5a59471

  Copy full SHA for 5a59471

• chore: rebase and update

  keehyuna

  committed
  fa407bc

  Copy full SHA for fa407bc

• chore: rebase and update doc

  keehyuna

  committed
  c12f76f

  Copy full SHA for c12f76f