Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Write Script for WordSimirarity Assessment #18

Open
sehsanm opened this issue Dec 3, 2018 · 2 comments
Open

Write Script for WordSimirarity Assessment #18

sehsanm opened this issue Dec 3, 2018 · 2 comments
Assignees
@kibamin
Labels
TEST SCRIPT
Milestone
Assignment

Comments

@sehsanm
Copy link
Owner

sehsanm commented Dec 3, 2018 •
edited
Loading

  • See Build or find Semantic Similarity Dataset for Persian #12 for file format of the input
  • Compute Spearman’s rank correlation coefficient between this scoreand the human judgments
  • Consider variations to use Euclidean distance and other metrics to calculate similarity
    see : J. Camacho-Collados, M. T. Pilehvar, N. Collier, and R. Navigli,
    “Semeval-2017 task 2: Multilingual and cross-lingual semantic
    word similarity,” in Proceedings of the 11th International
    Workshop on Semantic Evaluation (SemEval 2017). Vancouver,
    Canada, 2017.
@sehsanm sehsanm added this to the Assignment milestone Dec 3, 2018
@kibamin kibamin self-assigned this Dec 4, 2018
@sehsanm
Copy link
Owner Author

sehsanm commented Dec 5, 2018

Please keep in touch with @zahramajd to make sure file format is agreed.

@kibamin
Copy link
Collaborator

kibamin commented Dec 17, 2018 •
edited
Loading

چی کسی **human judgment** مشخص میکنه؟! @sehsanm

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@kibamin kibamin

Labels
TEST SCRIPT
Projects
None yet
Milestone
Assignment
Development

No branches or pull requests
2 participants
@sehsanm @kibamin