You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Currently only a small set of chars are in punctuation regex: ,:;.!?"\). I wonder if we should add more, e.g. unicode quotes.
An example (though I'm not sure if it will be fixed by such change):
Detecting entities on their own is not always enough; in many cases what is wanted is to find the relationship between them. For example, “ street_name/STREET city_name/CITY zipcode_number/ZIPCODE form an address”, or “ phone/TEL is a phone of person/PER ”.
The text was updated successfully, but these errors were encountered:
kmike
changed the title
support unicode punctuation
support unicode punctuation better
Sep 21, 2018
Currently only a small set of chars are in punctuation regex:
,:;.!?"\)
. I wonder if we should add more, e.g. unicode quotes.An example (though I'm not sure if it will be fixed by such change):
The text was updated successfully, but these errors were encountered: