Add GPU Support for GLiNERRecognizer and Validator Module for PII Detection #13
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This pull request introduces GPU support for the
GLiNERRecognizerclass and updates thevalidatormodule to allow GPU usage for PII detection. The changes include adding ause_gpuparameter, determining the device for model inference, and ensuring the model is loaded and executed on the appropriate device.GPU Support for
GLiNERRecognizer:use_gpuparameter to theGLiNERRecognizerconstructor to enable or disable GPU usage. The_get_devicemethod determines whether to use a GPU or CPU based on availability and theuse_gpuflag. (validator/gliner_recognizer.py, [1] [2]loadmethod to move the model to the appropriate device and set it to evaluation mode if GPU is used. (validator/gliner_recognizer.py, validator/gliner_recognizer.pyR24-R44)analyzemethod to ensure the model is on the correct device and to disable gradients during inference for efficiency. (validator/gliner_recognizer.py, validator/gliner_recognizer.pyR24-R44)Integration with
validatorModule:use_gpuparameter to theValidatorclass constructor and passed it to theGLiNERRecognizerinstance whenuse_localis enabled. (validator/main.py, [1] [2] [3]