Skip to content

[LCORE-1331] Add Solr filter and update doc #1178

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
tisnik merged 2 commits into from
Feb 19, 2026
Merged

[LCORE-1331] Add Solr filter and update doc #1178

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
ba46aca
add filtering to solr and update doc
Anxhela21 Feb 19, 2026
c087345
small fix
Anxhela21 Feb 19, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
29 changes: 29 additions & 0 deletions docs/rag_guide.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -282,6 +282,14 @@ providers:
content_field: chunk
embedding_dimension: 384
embedding_model: ${env.EMBEDDING_MODEL_DIR}
chunk_window_config:
chunk_parent_id_field: "parent_id"
chunk_content_field: "chunk_field"
chunk_index_field: "chunk_index"
chunk_token_count_field: "num_tokens"
parent_total_chunks_field: "total_chunks"
parent_total_tokens_field: "total_tokens"
chunk_filter_query: "is_chunk:true"
persistence:
namespace: portal-rag
backend: kv_default
Expand All @@ -294,6 +302,19 @@ registered_resources:
embedding_dimension: 384
```

Note: if the vector database (portal-rag) is not in the persistent data store within the vector_io provider
(e.g. after deleting the llama stack cache) you will need to register the vector database under registered resources:


```yaml
vector_stores:
- embedding_dimension: 384
embedding_model: sentence-transformers/${env.EMBEDDING_MODEL_DIR}
provider_id: solr-vector
vector_store_id: portal-rag
```
Comment on lines +305 to +315
Copy link
Contributor

@coderabbitai coderabbitai bot Feb 19, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Potential issue | 🟡 Minor

embedding_model in the note snippet is inconsistent with the primary Solr example above and will mislead users.

Line 301 (the main Solr provider YAML block, six lines above) correctly shows embedding_model: granite-embedding-30m — the registered model's model_id. The note snippet at line 312 reverts to sentence-transformers/${env.EMBEDDING_MODEL_DIR}, which will not resolve correctly (see the corresponding run.yaml issue).

Additionally, the plain Note: prefix is inconsistent with the GFM alert style used throughout the rest of this document.

📝 Proposed fix 
-Note: if the vector database (portal-rag) is not in the persistent data store within the vector_io provider
-(e.g. after deleting the llama stack cache) you will need to register the vector database under registered resources:
+> [!NOTE]
+> If the vector database (portal-rag) is not in the persistent data store (e.g. after clearing the llama-stack cache), register it under `registered_resources`:

 ```yaml
   vector_stores:
     - embedding_dimension: 384
-      embedding_model: sentence-transformers/${env.EMBEDDING_MODEL_DIR}
+      embedding_model: granite-embedding-30m
       provider_id: solr-vector
       vector_store_id: portal-rag
</details>

<details>
<summary>🤖 Prompt for AI Agents</summary>

Verify each finding against the current code and only fix it if needed.

In @docs/rag_guide.md around lines 305 - 315, Update the inline YAML snippet
under the explanatory note to match the main Solr example by changing the
vector_stores entry embedding_model from the placeholder
sentence-transformers/${env.EMBEDDING_MODEL_DIR} to granite-embedding-30m
(ensure provider_id: solr-vector and vector_store_id: portal-rag remain), and
replace the plain "Note:" prefix with the repository's standard GFM alert style
used elsewhere in the doc so the warning format is consistent.


</details>

<!-- fingerprinting:phantom:poseidon:churro -->

<!-- This is an auto-generated comment by CodeRabbit -->



**2. Configure Lightspeed Stack (`lightspeed-stack.yaml`):**

```yaml
Expand Down Expand Up @@ -324,6 +345,14 @@ Note: Solr does not currently work with RAG tools. You will need to specify "no_
- **Offline mode**: Uses `parent_id` with Mimir base URL
- **Online mode**: Uses `reference_url` from document metadata

**Query Filtering:**

To filter the Solr context edit the *chunk_filter_query* field in the
Solr **vector_io** provider in the `run.yaml`. Filters should follow the key:value format:
ex. `"product:*openshift*"`

Note: This static filter is a temporary work-around.

**Prerequisites:**

- Solr must be running and accessible at the configured URL
Expand Down
15 changes: 14 additions & 1 deletion run.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -67,6 +67,14 @@ providers:
content_field: chunk
embedding_dimension: 384
embedding_model: ${env.EMBEDDING_MODEL_DIR}
chunk_window_config:
chunk_parent_id_field: "parent_id"
chunk_content_field: "chunk_field"
chunk_index_field: "chunk_index"
chunk_token_count_field: "num_tokens"
parent_total_chunks_field: "total_chunks"
parent_total_tokens_field: "total_tokens"
chunk_filter_query: "is_chunk:true"
persistence:
namespace: portal-rag
backend: kv_default
Expand Down Expand Up @@ -152,7 +160,11 @@ registered_resources:
- shield_id: llama-guard
provider_id: llama-guard
provider_shield_id: openai/gpt-4o-mini
vector_stores: []
vector_stores:
- embedding_dimension: 384
embedding_model: sentence-transformers/${env.EMBEDDING_MODEL_DIR}
provider_id: solr-vector
vector_store_id: portal-rag
datasets: []
scoring_fns: []
benchmarks: []
Expand All @@ -166,3 +178,4 @@ vector_stores:
model_id: nomic-ai/nomic-embed-text-v1.5
safety:
default_shield_id: llama-guard

Loading