Working on advanced splitter #15
LexiestLeszek
started this conversation in
Ideas
Replies: 1 comment
-
|
I have the word one in the library currently, it would be interesting to see the use of sentences/paragraphs but I can't think of a use case personally. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Hi! NaturalLanguage swift library has built-in tokenizers for .paragraph / .sentence / .word
https://developer.apple.com/documentation/naturallanguage/tokenizing_natural_language_text
https://developer.apple.com/documentation/naturallanguage/nltokenunit/paragraph
https://developer.apple.com/documentation/naturallanguage/nltokenunit/sentence
https://developer.apple.com/documentation/naturallanguage/nltokenunit/word
Does it make sense to use it for text splitting instead?
Beta Was this translation helpful? Give feedback.
All reactions