Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[C#] feat: Streaming + Sample #2078

Merged
merged 14 commits into from
Oct 9, 2024
Merged

[C#] feat: Streaming + Sample #2078

merged 14 commits into from
Oct 9, 2024

Conversation

lilyydu
Copy link
Contributor

@lilyydu lilyydu commented Oct 2, 2024

Linked issues

closes: #1968

Details

Added streaming support for C# with an associated sample bot.

Change details

  • created a separate IPromptCompletionStreamingModel (not possible to have optional members for an interface). As a result, OpenAIModel declaration had to be updated.
  • converted StreamingChannelData into a class

Attestation Checklist

  • My code follows the style guidelines of this project

  • I have checked for/fixed spelling, linting, and other errors

  • I have commented my code for clarity

  • I have made corresponding changes to the documentation (updating the doc strings in the code is sufficient)

  • My changes generate no new warnings

  • I have added tests that validates my changes, and provides sufficient test coverage. I have tested with:

    • Local testing
    • E2E testing in Teams
  • New and existing unit tests pass locally with my changes

@lilyydu lilyydu changed the title [C#] feat: Streaming [C#] feat: Streaming + Sample Oct 8, 2024
Copy link
Collaborator

@singhk97 singhk97 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

Copy link
Collaborator

@aacebo aacebo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

is there a way for us to update the existing chefbot and make streaming configurable? My thought is that instead of having samples for streaming and non streaming, we should treat it like we do with OpenAI/AzureOpenAI, where every samples supports it but its a configuration

@lilyydu lilyydu merged commit 8b28322 into main Oct 9, 2024
12 checks passed
@lilyydu lilyydu deleted the lilyydu/streaming-dotnet branch October 9, 2024 18:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[C#] Streaming + Sample
3 participants