Skip to content

Commit

Permalink
Update inference endpoint code to not use private method removed
Browse files Browse the repository at this point in the history
  • Loading branch information
plaguss committed Feb 3, 2025
1 parent 47578f7 commit 2d32585
Showing 1 changed file with 1 addition and 3 deletions.
4 changes: 1 addition & 3 deletions src/distilabel/models/base_clients/inference_endpoints.py
Original file line number Diff line number Diff line change
Expand Up @@ -108,9 +108,7 @@ def load(self) -> None: # noqa: C901
f"Model {self.model_id} is not currently deployed or is not running the TGI framework"
)

self.base_url = client._resolve_url(
model=self.model_id, task="text-generation"
)
self._base_url = client.base_url

if self.endpoint_name is not None:
client = get_inference_endpoint(
Expand Down

0 comments on commit 2d32585

Please sign in to comment.