Skip to content

feat(option): Negative prompt #31

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
2 tasks
grencez opened this issue Jul 16, 2023 · 2 comments
Open
2 tasks

feat(option): Negative prompt #31

grencez opened this issue Jul 16, 2023 · 2 comments
Labels
feature New feature or request

Comments

@grencez
Copy link
Contributor

grencez commented Jul 16, 2023

Reference: https://www.github.com/ggerganov/llama.cpp/pull/2135

@grencez grencez added the feature New feature or request label Jul 16, 2023
@grencez grencez self-assigned this Jul 16, 2023
@grencez
Copy link
Contributor Author

grencez commented Jul 23, 2023

  • Implement as any number of prompts with different weights.
  • Different prompts associated with different chat prefixes.
  • Different context lengths, so the tokens can be steered more effectively.
  • Different histories, potentially making room for private "inner monologue".

I have to think carefully about this one. It seems very tricky to balance multiple contexts.

@grencez
Copy link
Contributor Author

grencez commented Jul 24, 2024

We could call this an agent. The general outline could be as follows (but needs some work):

(rolling_prompt (())
 (file "rolling.txt")
 (loop (())
  (turn (prefix "{{user}}: ") (user_input +true))
  (turn
   (prefix "least_unhinged_twitch_chatter:")
   (guidance (agent polite_speech) (scale -1.0)))
 )
)
(agents (())
 (polite_speech
  (priming_prompt (())
   (text "You are a kind person named least_unhinged_twitch_chatter who uses speech compatible with a polite society.\n")
   (main_rolling_prompt)  ; Do we need the whole thing?
 ))
)

The sampling customization in #36 may affect this, so it's blocked on the same thing.

@grencez grencez removed their assignment Jul 24, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant