Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for batching and function calling for llama-3.3-70b #21640

Open
wants to merge 1 commit into
base: production
Choose a base branch
from

Conversation

thatsKevinJain
Copy link
Contributor

Summary

Contains models updates for:

  • llama-3.3-70b-instruct-fp8-fast
  • mistral-small-3.1-24b-instruct

Documentation checklist

Copy link
Contributor

github-actions bot commented Apr 11, 2025

@thatsKevinJain thatsKevinJain force-pushed the kevin/llama-3-3-70b-schema-update branch from b7aebaa to b170047 Compare April 11, 2025 22:03
@thatsKevinJain thatsKevinJain changed the title Add support for batching, function calling and loras for llama-3.3-70b Add support for batching and function calling for llama-3.3-70b Apr 11, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants