Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add llm and embeddings support for together api #4

Open
furlat opened this issue Feb 12, 2024 · 3 comments
Open

Add llm and embeddings support for together api #4

furlat opened this issue Feb 12, 2024 · 3 comments
Labels
enhancement New feature or request

Comments

@furlat
Copy link
Contributor

furlat commented Feb 12, 2024

https://www.together.ai/

it should work trivially with the same open ai classes, just need to change endpoint

@furlat furlat added the enhancement New feature or request label Feb 12, 2024
@furlat
Copy link
Contributor Author

furlat commented Feb 26, 2024

also mistral https://docs.mistral.ai/

@pszemraj
Copy link

as a TODO/additional item: support for voyage

import voyageai

vo = voyageai.Client()
# This will automatically use the environment variable VOYAGE_API_KEY.
# Alternatively, you can use vo = voyageai.Client(api_key="<your secret key>")

texts = [
    "The Mediterranean diet emphasizes fish, olive oil, ...",
    "Photosynthesis in plants converts light energy into ...",
    "20th-century innovations, from radios to smartphones ...",
    "Rivers provide water, irrigation, and habitat for ...",
    "Apple’s conference call to discuss fourth fiscal ...",
    "Shakespeare's works, like 'Hamlet' and ...",
]

# Embed the documents
result = vo.embed(texts, model="voyage-2", input_type="document")
print(result.embeddings)

@furlat
Copy link
Contributor Author

furlat commented Mar 12, 2024

https://github.com/BerriAI/litellm

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants