[Feature Request] Add support for gymnasium.spaces.Text #1704
Labels
check the checklist
You have checked the required items in the checklist but you didn't do what is written...
enhancement
New feature or request
🚀 Feature
Unless I'm mistaken, stable-baselines3 only supports Box, Discrete, MultiDiscrete, MultiBinary and Dict spaces from gymnasium.
It seems like a new fundamental space has been introduced in Gymnasium ( gymnasium.spaces.Text ), which seems to be a more natural way to deal with text data.
Motivation
This new support would ease the training of LLMs with RL.
Pitch
No response
Alternatives
One alternative is to use gymnasium.spaces.Box(low=0, high=vocab_size-1, dtype=np.int).
However this requires padding to support smaller texts.
Additional context
No response
Checklist
The text was updated successfully, but these errors were encountered: