Decent system prompt using the new tag template system. #141
LoFiApostasy
started this conversation in
General
Replies: 1 comment
-
Thanks for sharing your workflow. It's very helpful.
I'm glad you like it. Here's my Ko-fi link: https://ko-fi.com/jhc13
Unfortunately, 6-bit is not supported in Hugging Face Transformers, which is the library used to run the models. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
First of all, @jhc13 please drop your buy me a coffee link, i love the new update.
This seems to work really well using the xtuner llava llama3.
1st pass generate your WD tags.
2.d pass settings:
Model: xtuner llava llama3
Start caption with: Image Medium:
Prompt:
Insert before first tag
Load in 4bit: True (it would be nice to have this editable, 6bit is really good quality)
Discourage from caption:
Minimum tokens: 100
Maximum tokens: 150 (or) 225 (or) 300
Number of beams: 6 (with 4bit: true and 24g of ram, adjust to your available vram)
Temperature: .9 (adjust per your own experimentation)
The rest is defaults.
Hope this helps others, this is meant as a starting point and to demonstrate how you can get two experts in a single shot. Adjust the experts to your own needs, i found that without tagging the art styles the text to image model lost style flexibility.
Cheers!
Exit: Updated banned caption list
Beta Was this translation helpful? Give feedback.
All reactions