Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

llama: non-bool IncrementalStringFinder and AntipromptManager #3

Open
iboB opened this issue Oct 1, 2024 · 1 comment · May be fixed by #31
Open

llama: non-bool IncrementalStringFinder and AntipromptManager #3

iboB opened this issue Oct 1, 2024 · 1 comment · May be fixed by #31
Assignees
@pminev
Labels
enhancement New feature or request

Comments

@iboB
Copy link
Member

iboB commented Oct 1, 2024

To properly manage antiprompts users must have two options available:

  • break after the antiprompt was generated
  • backtrack to when before the antiprompt was generated and continue from there

Currently only the first option is supported.

To properly support the second one, the information where to backtrack to should be available
@iboB iboB added the enhancement New feature or request label Oct 1, 2024
@iboB
Copy link
Member Author

iboB commented Oct 1, 2024

Related to #10 but not blocked by it. The information should be available, the backtracking itself is out of scope for this issue.

@iboB iboB transferred this issue from alpaca-core/alpaca-core-sdk Nov 18, 2024
@pminev pminev moved this from Todo to In Progress in Local SDK Beta Jan 16, 2025
@pminev pminev self-assigned this Jan 16, 2025
pminev added a commit that referenced this issue Jan 17, 2025
@pminev
feat: get matched antiprompt to prepare data for backtracking, ref #3
2a5e664
@pminev pminev linked a pull request Jan 17, 2025 that will close this issue
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@pminev pminev

Labels
enhancement New feature or request
Projects
Local SDK Beta
Status: In Progress
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Antiprompt enhance alpaca-core/ilib-llama.cpp
2 participants
@iboB @pminev