Releases: Acly/krita-ai-diffusion
Version 1.21.0
Download krita_ai_diffusion-1.21.0.zip
Localisation
Interface Language
This release adds support for switching between languages for the plugin UI. There aren't any translations yet, but the framework is there. If you are interested in providing a translation, please read Contributing Translations. Open an issue or Pull request to get it added to future versions of the plugin.
Text Prompt Translation
The second part of localisation is automatic translation of text prompts into English. Select the language you want to translate in the Interface settings to activate the feature. You will get an indicator in all text boxes and can now enter instructions in your language of choice.
You can click the indicator to toggle translation on/off. Usually the translation happens behind the scenes, but you can Ctrl + click to translate immediately and replace your text with the translated version. Read more on using prompt translation
Translation happens locally with a small AI model, which is downloaded automatically on first use.
Universal ControlNet for SDXL
This release supports the Xinsir Union ControlNet model for SDXL. It combines many control modes (scribbles, lines, depth, normals, pose, segmentation...) into one model.
This does not change how you use control layers! Simply pick the mode from the drop-down as usual.
Installing (Managed Server)
The model can be downloaded in the Connection settings. It is now the only default option for new installations.
If you have an existing installation, note that it will not automatically delete previous models. You will have to do it manually if you want to save space, or re-install.
Installing (Custom Server)
- Download the model from huggingface.co/xinsir
- Rename to
xinsir-controlnet-union-sdxl-1.0-promax.safetensorsand put it inComfyUI/models/controlnet/- (other names are fine as long as they contain union-sdxl)
- Other specific control models will still work, and take precedence if they exist. Union model is used as fallback whereever it applies.
As usual, make sure ComfyUI & custom nodes are updated!
NSFW Filter
There is now an optional NSFW filter. It helps to mostly avoid accidental naughty things in places where that's not appropriate.
The options are:
- Basic filters out most explicit sexual content, but allows some (partial) nudity and suggestive images
- Strict attempts to filter out anything remotely suggestive
Warning
The filter is not perfect, and some images may slip through. Please keep this in mind when considering scenarios where eg. children are involved.
Other Changes
- Pinned the pytorch version for managed servers to avoid breaking installation mid-release #966 #967
- Using pytorch 2.3.1 for now because a lot of people have missing DLL issues with 2.4.0
- Reduced default line art control layer strength for SDXL
- Added configurable keyboard shortcut for Live mode "Apply in new layer" #959
Version 1.20.1
Download krita_ai_diffusion-1.20.1.zip
Changes
- Fixed hang/crash when replacing layer content in Live mode #922
- Fixed crash when previewing generation results after using "Flatten Layers" operation #836
- Fixed issues with Fill Layer and applying Live results not working in some cases #928
- Fixed Ctrl+Backspace shortcut (remove previous word) not working in text prompt editor #798 (by @dyscorv)
- Added some alternative search paths for xinsir control models #935
- Clean up interrupted and unfinished jobs from job queue after server disconnect #814
- Fixed opening generated images from ComfyUI where prompt text comes from nodes #920
Contributors
Assets 3
Version 1.20.0
Download krita_ai_diffusion-1.20.0.zip
UI Improvements
- Improved performance during Live painting with Regions #883
- The strength slider and % value now snaps to full sampling steps (by @FeepingCreature)
- Previously was a fixed interval, where sometimes changes seemingly had no effect
- Now snaps to the previous/next value that would produce a change in the image
- Optionally displays the full step count (see Settings ⮞ Interface ⮞ Show Steps)
- When creating a new document, the most recently used parameters are used as defaults #902
- Affects things like seleted Style, Inpaint settings, and batch count
- When opening images generated by Auto1111 or basic ComfyUI workflows, the prompt is now read from the image
- Added context menu for discarding all generated images (clear history) #728
- Documented
{prompt}placeholder in Style settings #901
New Models
- Added xinsir depth-sdxl-1.0 SDXL depth control model
- Added xinsir tile-sdxl-1.0 SDXL unblur control model (new default)
- Added sdxl_segmentation_ade20k SDXL segmentation control model
Note: These are alternative choices to the previous models, which continue to work. There is no need to replace them.
New Schedulers
There are various new options for schedulers when creating custom sampler presets (thanks @Danamir!):
align_your_stepsgits(this is now used by the built-in "Fast" preset)polyexponential
Important
If you are using a custom ComfyUI installation, make sure to update it along with custom nodes.
Bugfixes
Contributors
Assets 3
Version 1.19.0
Download krita_ai_diffusion-1.19.0.zip
Model Updates
There have been a lot of new and improved models for SDXL lately. This update changes quite a few of the plugin's defaults, with some optional choices also added to the list.
SDXL ControlNet models
| Mode | 1st priority | 2nd priority | 3rd priority |
|---|---|---|---|
| Scribble | 🌟 XinsirScribble | 🌟👍 MistoLine | SAI-Sketch |
| Line Art | 🌟 XinsirScribble | 🌟👍 MistoLine | SAI-Sketch |
| Soft Edge | 🌟👍 MistoLine | 🌟 Xinsir-Scribble | |
| Canny Edge | 🌟 XinsirCannyV2 | 👍 SAI-Canny | 🌟 MistoLine |
| Pose | 🌟👍 XinsirOpenPose | ThibaudOpenPose | |
| Segmentation | 🌟 abovzv-ade20k | ||
| Stencil | 🌟 QR Code Monster |
🌟means it's a new model, 👍means it's the default download option for the integrated installer.
If you have multiple models installed the priority defines the order in which they are selected.
Sometimes the first choice isn't the default, usually because they're really close in terms of quality, but the other model is smaller (requires less space and loads faster). You may also notice that most of the line modes are covered by the same models, it works pretty well regardless!
ControlNet preprocessor models
Those are the models that turn your current image into lines, a depth map, a pose skeleton, etc. They apply to both SD1.5 and SDXL! There are three changes here:
- Soft Edge now uses AnyLine model. It will be downloaded automatically.
- Depth now uses version 2 of DepthAnything. It will be downloaded automatically.
- Canny Edge was changed to be more sensitive. No model/download required.
Realtime/Live models
Those are LoRA used to generate images significantly faster with lower step count. There is usually a trade-off in quality.
In this update Hyper-SD replaces LCM as the default choice for Live mode. This means the model is required to use the plugin. It will be downloaded when you update. Compared to LCM they are much more faithful to the model's usual output and retain most of the quality.
The LCM models are no longer required, but can still be used as before. For your custom Styles you can switch to Hyper easily by selecting the "Realtime - Hyper" sampler preset. One of the advantages is that you can tweak the CFG value now to get more defined results.
Custom ComfyUI installs
This section is for those who manage their own ComfyUI server. As usual, please make sure ComfyUI and custom nodes are up-to-date!
You will have to download the Hyper-SD 8-step CFG LoRA and put it into ComfyUI/models/loras:
For the new control models, please follow the links above. To use the Xinsir models rename them into any filename which contains xinsircanny, xinsiropenpose, xinsirscribble (case-insensitive). If you already downloaded them from civitai those filenames will match.
Stable Diffusion 3
There is basic support for the Stable Diffusion 3 (SD3) base model, so you can give it a try! "Basic" means that things like control layers and regions are not supported, and you need to download models manually from HF SD3 Medium. The required files are:
- sd3_medium.safetensors to
ComfyUI/models/checkpoints - clip_g.safetensors to
ComfyUI/models/clip - clip_l.safetensors to
ComfyUI/models/clip
Please use the (somewhat temporary) SD3 sampler preset!
Other Changes
- Added ZavyChromaXL to recommended checkpoints and made it the default for "Digital Artwork (XL)" style
- Fixed SSL issues when using a https connection on Mac #840 by @DrewWalkup
- Fixed control layers disappearing when unrelated layers are removed #823
- Fixed "/ComfyUI" being appended when selecting existing server installs #859
- Fixed the "Show negative prompt" toggle not having any immediate effect #857
- Fixed error being reported when creating Control Layers with active Filter Mask layers #846
- Fixed LoRA not appearing in prompt history (again) #855
- Paint layers are now converted into groups correctly also when applying multiple results from the same batch
- Properly track linking/unlinking regions - previously regions could end up linked to the wrong layer in saved .kra files
- Fixed crash in rare situation where the image is a tiny bit large than the preferred checkpoint resolution
- Fixed some issues with apply when replacing layer content
Contributors
Assets 3
Version 1.18.1
Download krita_ai_diffusion-1.18.1.zip
Region UI tweaks
Button to toggle focused inpaint mode for the active Layer/Region
This toggle is only available when using regions. It has two effects:
- Generation will only use the text prompt and control layers of the currently active region.
- The active layer's alpha/transparency is used as mask. (But a selection will override this.)
Live mode: Button to apply result in a new Layer
Without regions, this is a simple way to apply a Live result as a new layer instead of replacing contents, same as previous versions.
With regions, the new button will apply the result to the active layer only. This is in contrast to the regular apply, which usually changes things in a small area around the active layer, and "splats" results to all affected regions. If you want the splatting, but as new layers, simply put your region layers in a group.
Other Changes
- Fixed upscale tile layout computation for non-square aspect ratios #791
- Fixed control layers for regions not showing up in Live mode #788
- Fixed (non-region) control layers not being stored/loaded from .kra files #788
- Increased strength threshold where an Inpaint model is used for refinement to 80% (was 50%)
- Changed region tracking in Live mode to be more similar to how it works in Generation workspace
- Disabled auto-hide of control layers in Live mode
- Fixed mask layers (Filter Mask, Transform Mask, Colorize Mask) causing errors #788
- Fixed LoRA folder filter not working in mixed Windows/Linux setup #793
- Improved Undo behavior when applying results by replacing content (can now be undone, but requires 2 actions)
- Fixed active layer changing to a different region when applying results to more than one region
- Workaround for error due to document without active layer #805
- Trim generated layer names for exessively long prompts #804
Version 1.18.0
Download krita_ai_diffusion-1.18.0.zip
Regions
This release allows you collect text prompts, reference images and control layers in Regions, which are linked to paint layers or groups.
- Restrict prompts to areas which are indicated by layer's content (alpha mask)
- Seperate subjects in your image without their descriptions getting mixed up
- Use regions you define as masks for inpaint
- Jump between subjects in your image without having to adjust text prompts each time
- Selections will automatically find the regions they cover when using Fill or Refine
- Live painting focuses on the region which is linked to the active layer
- Keep parts of the image you're not working on fixed
- Work with higher canvas resolutions than before
- Tiled upscale now effectively works with prompts by selecting matching regions for each tile
- Control layers and reference images work with regions!
- Manage complexity with region hierarchies (nested groups)
Thanks to @Danamir for getting this started!
Please watch the video to get started and let us know how it goes. Further tutorial and documentation coming when time permits.
Important
If you are using a custom ComfyUI installation, make sure to update. Latest version of comfyui-tooling-nodes are required.
Changes
- ⚠ Applying results in Live mode now replaces active layer content by default
- Adding a layer per region becomes messy really fast
- Create a group for your layer if you want "non-destructive" apply
- Maybe this will be an option in the future
- Canvas now resizes right away when upscale is triggered (required for correct behavior in some cases)
- Renamed "Blur" control layer to "Unblur" (it takes blurry input and tries to sharpen/add detail)
- Added download option for SDXL version of Unblur control layer
- Added option to select if Unblur is used for tiled upscale (with two strength presets)
- Added seed to generated layer name #727
Cloud
- Full support for regions
- Purchase options also available now for those interested
Contributors
Assets 3
Version 1.17.2
Download krita_ai_diffusion-1.17.2.zip
Changes
- Use Lanczos for scaling images instead of bilinear filtering. This improves image sharpness #679
- Increased the range for alpha blending to get slightly smoother transitions when working with selections
- Minimum step count is now configurable for sampler presets #662 #697 #483
- Default is 4 (unchanged)
- Read here for an explanation how total steps, strength and minimum steps are related
- Tweaked performance presets for high-end GPUs to a more realistic range
- Fixed LoRA auto-completion not triggering at the beginning of a new line #700
- Fixed custom context from selection mask for fill and refine region #669
- Fixed PNG fallback for remote image buffers on Linux systems without WEBP support #702
- Fixed plugin not loading when there is an issue with settings.json file #665
Cloud
- Tweaked token cost to better match computation time
- Show token cost when hovering over Generate button
- Enabled performance settings (batch size, maximum resolution, etc.)
Version 1.17.1
Download krita_ai_diffusion-1.17.1.zip
Sampler preset changes
There was quite a bit of confusion about the changes to samplers in the last release, and a few bugs too. This release will hopefully improve the situation!
The preset name now contains both:
- a descriptive part (default, fast, realtime, ...) which indicates what it might be good for and how it differs from other choices, especially for users who are not familiar with Stable Diffusion
- the technical implementation name of the sampler (Euler A, DPM++ 2M, DPM++ SDE, ...) which you may see mentioned when downloading custom checkpoints
There are two new entries:
- Alternative - Euler Ancestral with normal scheduler and step count
- Lightning Merge - Euler Ancestral with uniform scheduler and low CFG/steps
Related changes:
- "Special" Lora (LCM, Lightning, FaceID) are no longer filtered out, but a warning will be displayed if they are added manually #640
- These are added automatically when needed, eg. when choosing a sampler or control layer that requires them
- Improved error messages for samplers which require a Lora
- Don't auto-convert previous sampler settings to a preset that requires a Lora
- Fixed sampler preset choice not being persisted in some cases #649
- Custom preset link will now open the folder if the preset file cannot be opened
- Added link to format documentation in the custom preset JSON
Please check out the documentation on the Wiki for more information about Samplers and how to customize them!
Other changes
Version 1.17.0
Download krita_ai_diffusion-1.17.0.zip
Style Transfer
There are two new Control layer modes: Style and Composition.
They work similar to the "Reference" mode: the selected image acts as a sort of inspiration, and doesn't have to match resolution or aspect ratio of your canvas. The difference is that Style will extract mostly art style and colors, while Composition focuses on the structural layout.
| Composition | Style | Result |
|---|---|---|
 |
 |
 |
 |
 |
 |
Works best with SDXL. Probably need a different approach for SD1.5.
Important
If you are using a custom ComfyUI installation, make sure to update. Latest version of ComfyUI_IPAdapter_plus is required.
LoRA Search and Auto-Completion
Redesigned the LoRA selection into a searchable drop-down.
There is also an option to filter via folders (applies to all added LoRA).
And adding LoRA in the text prompt will auto-complete now.
Control Presets
This release adds Presets for some Control layer and Sampler settings. The idea is to have a lean, easy to use UI where users can switch between a few recommended configuration options. Presets can be customized for those who want full control (but it may require editing a text file).
Control layer strength is now adjusted with a single slider, from low influence to very strong effect. This will influence the weight as well as the start and end of the interval in which ControlNet or IP-Adapter are applied.
If you want you can also modify those individually. The presets are stored in presets/control.json, it is recommended to copy it to the user data folder before editing.
Sampler Presets
Samplers can now be fully configured by choosing from a few pre-defined options.
As before, the number of steps and guidance strength can be tweaked in the UI. New: you can edit the presets or add your own, and choose from any sampler / scheduler which ComfyUI supports.
Other Changes
- Added option to enable Self-Attention Guidance (advanced checkpoint settings) (by @FeepingCreature)
- This may improve image quality at the cost of some performance
- Fixed LoRA in the text prompt not being stored to history #586
- Fixed error when restoring settings to default values
- Fixed crash when toggling Live Record without generating an image #579
- Fixed error when result images matched the thumbnail size #605
- Correctly update the selected style when the filter changes #564
- Removed [Live] prefix from generated layer name and added the seed value #613
- Use PNG as the format for saving result images from the history #582 #627
- Allow multi-selection when saving images from result history #626
- Added fallback for WEBP images on Linux without the required Qt5 package #582
- Improve robustness of rename during installation on Windows #515
- Make errors during process job attach non-fatal on Windows #616
- Improved folder selection for server installation #620
Contributors
Assets 3
Version 1.16.1
Download krita_ai_diffusion-1.16.1.zip
Bugfixes
- Fixed change of connection URL in the UI not having any effect #533
- Fixed inpaint mode chosen at 100% strength affecting masks even in refine mode (0-99% strength) #535
- Stop live mode polling after the document is closed (previously lead to errors and inconsistent state after opening a new document) #538
- Fixed LoRA not working when added in the text prompt #540
- Fixed selection not working properly in live mode #539
- Re-enabled IP-Adapter with DirectML backend (seems to be working again) #552
- Improved error reporting for missing checkpoints and other models #553 #550 #541 #537
Cloud
- Added SDXL
- Fixed "Remove object" not working