Microsoft.AI.Foundry.Local
0.8.2.1
Prefix Reserved
dotnet add package Microsoft.AI.Foundry.Local --version 0.8.2.1
NuGet\Install-Package Microsoft.AI.Foundry.Local -Version 0.8.2.1
<PackageReference Include="Microsoft.AI.Foundry.Local" Version="0.8.2.1" />
<PackageVersion Include="Microsoft.AI.Foundry.Local" Version="0.8.2.1" />
<PackageReference Include="Microsoft.AI.Foundry.Local" />
paket add Microsoft.AI.Foundry.Local --version 0.8.2.1
#r "nuget: Microsoft.AI.Foundry.Local, 0.8.2.1"
#:package Microsoft.AI.Foundry.Local@0.8.2.1
#addin nuget:?package=Microsoft.AI.Foundry.Local&version=0.8.2.1
#tool nuget:?package=Microsoft.AI.Foundry.Local&version=0.8.2.1
Foundry Local C# SDK
Installation
To use the Foundry Local C# SDK, you need to install the NuGet package:
dotnet add package Microsoft.AI.Foundry.Local
Building from source
To build the SDK, run the following command in your terminal:
cd sdk/cs
dotnet build
You can also load FoundryLocal.sln in Visual Studio 2022 or VSCode. Update your
nuget.config to include the local path to the generated NuGet package:
<configuration>
<packageSources>
<add key="foundry-local" value="C:\path\to\foundry-local\sdk\cs\bin\Debug" />
</packageSources>
</configuration>
Then, install the package using the following command:
dotnet add package FoundryLocal --source foundry-local
Usage
For this example, you'll need the OpenAI Nuget package installed as well:
dotnet add package OpenAI
using Microsoft.AI.Foundry.Local;
using OpenAI;
using OpenAI.Chat;
using System.ClientModel;
using System.Diagnostics.Metrics;
var alias = "phi-3.5-mini";
var manager = await FoundryLocalManager.StartModelAsync(aliasOrModelId: alias);
var model = await manager.GetModelInfoAsync(aliasOrModelId: alias);
ApiKeyCredential key = new ApiKeyCredential(manager.ApiKey);
OpenAIClient client = new OpenAIClient(key, new OpenAIClientOptions
{
Endpoint = manager.Endpoint
});
var chatClient = client.GetChatClient(model?.ModelId);
var completionUpdates = chatClient.CompleteChatStreaming("Why is the sky blue'");
Console.Write($"[ASSISTANT]: ");
foreach (var completionUpdate in completionUpdates)
{
if (completionUpdate.ContentUpdate.Count > 0)
{
Console.Write(completionUpdate.ContentUpdate[0].Text);
}
}
| Product | Versions Compatible and additional computed target framework versions. |
|---|---|
| .NET | net8.0 is compatible. net8.0-android was computed. net8.0-browser was computed. net8.0-ios was computed. net8.0-maccatalyst was computed. net8.0-macos was computed. net8.0-tvos was computed. net8.0-windows was computed. net9.0 was computed. net9.0-android was computed. net9.0-browser was computed. net9.0-ios was computed. net9.0-maccatalyst was computed. net9.0-macos was computed. net9.0-tvos was computed. net9.0-windows was computed. net10.0 was computed. net10.0-android was computed. net10.0-browser was computed. net10.0-ios was computed. net10.0-maccatalyst was computed. net10.0-macos was computed. net10.0-tvos was computed. net10.0-windows was computed. |
-
net8.0
- Betalgo.Ranul.OpenAI (>= 9.1.0)
- IDisposableAnalyzers (>= 4.0.8)
- Microsoft.AI.Foundry.Local.Core (>= 0.8.2.2)
- Microsoft.Extensions.Logging (>= 9.0.9)
NuGet packages (1)
Showing the top 1 NuGet packages that depend on Microsoft.AI.Foundry.Local:
| Package | Downloads |
|---|---|
|
Aspire.Hosting.Azure.AIFoundry
Azure AI Foundry resource types for Aspire. |
GitHub repositories (1)
Showing the top 1 popular GitHub repositories that depend on Microsoft.AI.Foundry.Local:
| Repository | Stars |
|---|---|
|
dotnet/aspire
Aspire is the tool for code-first, extensible, observable dev and deploy.
|