Skip to content

Commit

Permalink
excluding remote models from max node per node setting (#2732) (#2738) (
Browse files Browse the repository at this point in the history
#3048)

Signed-off-by: Dhrubo Saha <[email protected]>
(cherry picked from commit 9ea79d0)

Co-authored-by: Dhrubo Saha <[email protected]>
(cherry picked from commit ab60081)

Co-authored-by: opensearch-trigger-bot[bot] <98922864+opensearch-trigger-bot[bot]@users.noreply.github.com>
  • Loading branch information
opensearch-trigger-bot[bot] authored Oct 2, 2024
1 parent dc04a3b commit 97cf307
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -1084,7 +1084,7 @@ public void deployModel(
listener.onResponse("successful");
return;
}
if (modelCacheHelper.getLocalDeployedModels().length >= maxModelPerNode) {
if (functionName != FunctionName.REMOTE && modelCacheHelper.getLocalDeployedModels().length >= maxModelPerNode) {
listener.onFailure(new IllegalArgumentException("Exceed max local model per node limit"));
return;
}
Expand Down

0 comments on commit 97cf307

Please sign in to comment.