Merge pull request #103 from MKhalusova/unstructured

Notebook: unstructured data preprocessing for RAG
huggingface · Jun 6, 2024 · 7685a43 · 7685a43
2 parents 06dfb2a + 2ff29be
commit 7685a43
Show file tree

Hide file tree

Showing 3 changed files with 536 additions and 0 deletions.
diff --git a/notebooks/en/_toctree.yml b/notebooks/en/_toctree.yml
@@ -43,6 +43,8 @@
           title: Implementing semantic cache to improve a RAG system.
         - local: structured_generation
           title: RAG with source highlighting using Structured generation
+        - local: rag_with_unstructured_data
+          title: Building RAG with Custom Unstructured Data
 
     - title: Computer Vision Recipes
       isExpanded: false

diff --git a/notebooks/en/index.md b/notebooks/en/index.md
@@ -11,6 +11,7 @@ Check out the recently added notebooks:
 - [Using LLM-as-a-judge 🧑‍⚖️ for an automated and versatile evaluation](llm_judge)
 - [Create a legal preference dataset](pipeline_notus_instructions_preferences_legal)
 - [Suggestions for Data Annotation with SetFit in Zero-shot Text Classification](labelling_feedback_setfit)
+- [Building RAG with Custom Unstructured Data](rag_with_unstructured_data)
 
 You can also check out the notebooks in the cookbook's [GitHub repo](https://github.com/huggingface/cookbook).