Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Take advantage of increased LLM context window #117

Open
AJaySi opened this issue Sep 2, 2024 · 2 comments
Open

Take advantage of increased LLM context window #117

AJaySi opened this issue Sep 2, 2024 · 2 comments
Assignees
@AJaySi
Labels
AI writer enhancement New feature or request LLM RAG knowledgebase Memory

Comments

@AJaySi
Copy link
Owner

AJaySi commented Sep 2, 2024

RAG is dying as the context window keeps increasing exponentially.
With 1M tokens context windows, who needs RAG. Caching course material and doing vector search seems like the way to go.

We will need to implement concepts from this paper: https://ai.google.dev/gemini-api/docs/long-context
@AJaySi AJaySi self-assigned this Sep 2, 2024
@AJaySi
Copy link
Owner Author

AJaySi commented Sep 24, 2024

https://ai.google.dev/gemini-api/docs/long-context

@AJaySi
Copy link
Owner Author

AJaySi commented Sep 24, 2024

https://github.com/google-gemini/cookbook/blob/main/examples/Apollo_11.ipynb

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@AJaySi AJaySi

Labels
AI writer enhancement New feature or request LLM RAG knowledgebase Memory
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@AJaySi