Skip to content

Minor Grammatical Fix/Improvement #96

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
chrisdenman wants to merge 1 commit into
base: master
Choose a base branch
from
Open

Minor Grammatical Fix/Improvement #96

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion ELMo.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -19,7 +19,7 @@ ELMo vectors are "contextual" meaning they take into account the nature of the w
For example, where as in word2vec the word "play" only has a single embedding that combines both interpretations of the word (a command to start music or a theatrical act).
In ELMo, this is not the case. The embedding for the word "play" in ELMo would, in theory, be different when trained and used with example sentences like "Play some music on the living room speakers." and "Get tickets for the play tonight.".

An ELMo vector for a target word is actually comprised of 3 components (a 2D array `3 x (embedding dimensions)` instead of just a 1D array of `(embedding dimensions)`):
An ELMo vector for a target word actually comprises 3 components (a 2D array `3 x (embedding dimensions)` instead of just a 1D array of `(embedding dimensions)`):
1) A forward pass bi-directional RNN contextual embedding taking into account words before the target word in the sentence.
2) A backward pass bi-directional RNN contextual embedding taking into account words after the target word in the sentence.
3) A context-independent embedding of the target word.
Expand Down