add support for Hrfix and CN

[jetjodh]

Description

• Fix interop issue of kohya hrfix and CN
• Fixes: ControlNet and Kohya HRFix interop support #95

Checklist:

• I have read contributing wiki page
• I have performed a self-review of my own code
• My code follows the style guidelines
• My code passes tests

[jetjodh]

@huchenlei can you review this?

[huchenlei]

Can you add an API test under https://github.com/lllyasviel/stable-diffusion-webui-forge/blob/main/extensions-builtin/sd_forge_controlnet/tests/web_api/ ?

It can be similar to the test added in #754 . Although we cannot enable the test in the CQ, at least we can have a stable way to verify this is working locally and compare test results across versions.

[jetjodh]

Can you add an API test under https://github.com/lllyasviel/stable-diffusion-webui-forge/blob/main/extensions-builtin/sd_forge_controlnet/tests/web_api/ ?

It can be similar to the test added in #754 . Although we cannot enable the test in the CQ, at least we can have a stable way to verify this is working locally and compare test results across versions.
@huchenlei
Added a test (hopefully works)

[adde88]

I tested this patch today several times, on both 1.5, and SDXL models, with HRfix and CN. The errors are not there anymore, and it seems to work. Thought i'd give some feedback :)