boost tokenizer docs
csv processing
pytorch-cpp examples
unique_ptr for sentencepiece
batch function
pkg-config and cmake - sentencepiece doesn't have a proper cmake file
libtorch no_grad()
how to compile sentencepiece manually
g++ -o out in.cpp -L<path to /lib with sentencepiece.so> -lsentencepiece