JMEE #4
Comments
|
I found the same quetion. |
|
@shiqing1234 The preprocessing results of this repository clearly differ from that of JMEE. But the results of this code are more similar to previous studies likes JOINTEVENTENTITY (Yang and Mitchell, 2016), JRNN (Nguyen et al., 2016) as shown in the bellow table.
The difference seems to have occurred because there are no promised rules for splitting sentences within the sgm format files. For example, there is this sentence in the data. On page 256 you say, "As the years went by" -- this is when you were in the Senate -- "less and less information was new, fewer and fewer arguments were fresh, and the repetitiveness of the old arguments became tiresome." I didn't split the sentence when @kkkyan |
|
@shiqing1234 @kkkyan I ran JMEE with this command and got disappointing results. python -m enet.run.ee.runner --train "ace-05-splits/train.json" --test "ace-05-splits/test.json" --dev "ace-05-splits/dev.json" --earlystop 10 --restart 10 --optimizer "adadelta" --lr 1 --webd "./ace-05-splits/glove.6B.300d.txt" --batch 8 --epochs 99999 --device "cuda:0" --out "models/enet-081" --hps "{'wemb_dim': 300, 'wemb_ft': True, 'wemb_dp': 0.5, 'pemb_dim': 50, 'pemb_dp': 0.5, 'eemb_dim': 50, 'eemb_dp': 0.5, 'psemb_dim': 50, 'psemb_dp': 0.5, 'lstm_dim': 220, 'lstm_layers': 1, 'lstm_dp': 0, 'gcn_et': 3, 'gcn_use_bn': True, 'gcn_layers': 3, 'gcn_dp': 0.5, 'sa_dim': 300, 'use_highway': True, 'loss_alpha': 5}"The following results were printed on the console: |
|
@bowbowbow dev-ed ：
dev-ae ：
test-ed ：
test-ae ：
I am trying to use some new params to test model, the original params is not belivable. In addition, in issue #4 under JMEE, there's someone who can reach If you get some better result, please let me know. |
Have you changed the format of train.json, test.json, dev.json? |
I got the result same as you, ed f1=0.54 ae f1=0.30. I am trying to improve the result. Do you have get better?? @kkkyan |
|
@ScuLilei2014 |
|
@kkkyan Hello, I have dataset tac-kmp-2017, but I want to use ace2005-preprocessing for preprocessing, Do you provide an A.apf.xml file and an A.sgm for me. |
@kkkyan @shiqing1234 Thank you for your contribution. I got the preprocessing output, and downloaded glove.6B.300d.txt file from web.
I try to replace train.json with sample.json. the error is also.Would you meet before? |
very thank you for your code,i want to ask you do you use your output data to feed the JMEE model to achieve event extract and get the same F1 in the JMEE paper?because i find that in the JMEE paper the sentences in dev/test/train is different from yours
This data split includes 40 newswire articles (881 sentences) for the test set, 30 other documents (1087 sentences) for the development set and 529 remaining documents (21,090 sentences) for the training seti am looking forward to your reply~very thank you
The text was updated successfully, but these errors were encountered: