Connect any VLM Using OpenAi Api Local or Online

[LoFiApostasy]

Folks I made an (almost) drop in model that lets you use the well established OpenAi Apj. There are several choices out there, but i use LLM Studio.
Edit: Fix my copy pasta. Added clarity to path.

• models_list.py

  • located in auto_captioning folder
  • Here is a summery of changes, if your not a coder just drop the file and these hints into your online ai of choice.
  • For those that could not get gptqmodel installed on windows remove the references to XComposer2 models.
  • Add import: 'from auto_captioning.models.openai_compatible import OpenAICompatibleModel'
  • Add: 'OpenAI-compatible Vision API', to the model list and update the 'def get_model_class'

• openai_compatible.py

  • goes into the auto_captioning/models folder
  • Gemma 3 Support? #360 (comment)

• Install_win.ps1

  • goes i to taggui root folder
  • Should get windows users up when using git clone from source.
  • Install_win.ps1.txt

• Launch.ps1

  • goes i to taggui root folder
  • If you need help and are unfamiliar with python, you can run this ps1 script.
  • Install powershell 7.x and run from the ps7 cli.
  • Launch.ps1.txt

If you really want the one click run experience, you can make a .bat file

@echo off
REM TagGui.bat - Launches the TagGui application with LM Studio integration

echo Starting TagGui with LM Studio integration...
"C:\Program Files\PowerShell\7\pwsh.exe" -ExecutionPolicy Bypass -File "%~dp0Launch.ps1"

REM If PowerShell exits with an error, pause to show the error message
if %ERRORLEVEL% NEQ 0 (
    echo.
    echo An error occurred while running the launch script.
    pause
)

[LoFiApostasy]

This has been quite useful and after more testing i cant find anything broken. For those who want a nsfw capable tagger this works better many others i have tried. (Currently Gemma 3 27b abliterated). Here are some examples below. It can accurately differentiate erect/flaccid/semi-erect, will use slang if prompted. I probability went a little heavy with my "Use a spicy tone with slang verbs" instruction.