Support Custom API endpoint

[Sourabh964]

In the multi turn conversation using red teaming orchestrator, can we support Custom API endpoint as well similar to the target LLM so that we can test any chat bot hosted at custom API

[rdheekonda]

Yes, the framework supports that, but you'll need to add a target that implements the PromptChatTarget abstract class assuming you would like to set the system prompt under pyrit/prompt_target/prompt_chat_target. Once you've implemented the target, it can be used for red teaming bot as well as the target that you would like to probe.

[ClarkKentIsSuperman]

to add to this @rdheekonda - does the same answer apply for any custom webpage based chatbot? Is there no plan for a generic REST style adaptation where we can paste in a custom POST body format for a custom endpoint? Assuming we do NOT want to set the system prompt for the target, just test it as is. Or is the idea that for any testing we have to create a promptChatTarget instance?

For example, we have a local RAG running at localhost:8080/query and just takes in a simple POST body of {"query": "this is my query"} and thats it. Looking for a simple way to test this without implementing/modifying core framework files if possible.