Skip to content

Add RAG support to llamastack implementation in ai lab #3571

@bmahabirbu

Description

@bmahabirbu

Is your feature request related to a problem? Please describe

RAG with Llama Stack on MacBook with Podman AI Lab.
But it is failing with following error:
podman_ai_lab.py: NotImplementedError: embeddings endpoint is not implemented

Describe the solution you'd like

Edit the .yaml file to add the inline provider sentence transformer if not already there and register all-MiniLM-L6-v2

Describe alternatives you've considered

No response

Additional context

No response

Metadata

Metadata

Assignees

Labels

kind/feature 💡Issue for requesting a new feature

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions