Refactor IOB #64
Open
Refactor IOB #64
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
a later PR will add crfsuite base on the newly python-crfsuite(https://github.com/tpeng/python-crfsuite)
It is better to put models somewhere else, and notebooks were broken.
add base classifier and global ngrams feature functions
1. rename DEFAULT_TAGSET to EXAMPLE_TAGSET; 2. rename DEFAULT_FEATURES to EXAMPLE_TOKEN_FEATURES; 3. make token_features empty by default in create_wapiti_pipeline.
except model_filename must be kwargs now. Also, this fixes the example from the tutorial.
…v/webstruct into speed_up_text_tokenizer
Speed up text tokenizer
Wapiti for webstruct
Ignore all non-text tags
Non-recursive implementation of algorithm
fix boolean bug
update travis to run different python versions
Codecov Report
@@ Coverage Diff @@
## master #64 +/- ##
==========================================
+ Coverage 81.02% 81.08% +0.06%
==========================================
Files 40 40
Lines 2092 2104 +12
==========================================
+ Hits 1695 1706 +11
- Misses 397 398 +1 |
Kebniss
commented
Jun 5, 2018
| c, tg = self.sequence_encoder.split(c) | ||
| chains.append((c, tree, is_tail)) | ||
| tags.append(tg) | ||
|
|
There was a problem hiding this comment.
with this implementation I don't think it would make sense to create BILOU as a class as it would be just a function that translates IOB tags. I would add here a check for Bilou flag that if True would call the bilou_translator function from sequence_encoding.py
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.