This repository was archived by the owner on Sep 13, 2023. It is now read-only.

Add huggingface transformers support#553

Open

mike0sv wants to merge 4 commits intomainfrom

features/transformers

Commits on Dec 28, 2022

WIP transformers support
mike0sv
committed

Commits on Dec 29, 2022

Add batchencoding type for tokenizers
mike0sv
committed

Commits on Dec 30, 2022