You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Document Microsoft Foundry Local setup and usage (#461)
* Document Microsoft Foundry Local setup and usage
Added section for Microsoft Foundry Local with installation and usage instructions.
* Update docs/auth/byok.md
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
---------
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
| Ollama |`"openai"`| Local models via OpenAI-compatible API |
13
+
| Microsoft Foundry Local |`"openai"`| Run AI models locally on your device via OpenAI-compatible API |
13
14
| Other OpenAI-compatible |`"openai"`| vLLM, LiteLLM, etc. |
14
15
15
16
## Quick Start: Azure AI Foundry
@@ -250,6 +251,37 @@ provider: {
250
251
}
251
252
```
252
253
254
+
### Microsoft Foundry Local
255
+
256
+
[Microsoft Foundry Local](https://foundrylocal.ai) lets you run AI models locally on your own device with an OpenAI-compatible API. Install it via the Foundry Local CLI, then point the SDK at your local endpoint:
257
+
258
+
```typescript
259
+
provider: {
260
+
type: "openai",
261
+
baseUrl: "http://localhost:<PORT>/v1",
262
+
// No apiKey needed for local Foundry Local
263
+
}
264
+
```
265
+
266
+
> **Note:** Foundry Local starts on a **dynamic port** — the port is not fixed. Use `foundry service status` to confirm the port the service is currently listening on, then use that port in your `baseUrl`.
267
+
268
+
To get started with Foundry Local:
269
+
270
+
```bash
271
+
# Windows: Install Foundry Local CLI (requires winget)
272
+
winget install Microsoft.FoundryLocal
273
+
274
+
# macOS / Linux: see https://foundrylocal.ai for installation instructions
275
+
# List available models
276
+
foundry model list
277
+
278
+
# Run a model (starts the local server automatically)
279
+
foundry model run phi-4-mini
280
+
281
+
# Check the port the service is running on
282
+
foundry service status
283
+
```
284
+
253
285
### Anthropic
254
286
255
287
```typescript
@@ -305,6 +337,7 @@ Some Copilot features may behave differently with BYOK:
305
337
|----------|-------------|
306
338
| Azure AI Foundry | No Entra ID auth; must use API keys |
307
339
| Ollama | No API key; local only; model support varies |
340
+
|[Microsoft Foundry Local](https://foundrylocal.ai)| Local only; model availability depends on device hardware; no API key required |
308
341
| OpenAI | Subject to OpenAI rate limits and quotas |
0 commit comments