New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Idea - rebuild glove vectors #165

Open

AngledLuffa opened this issue Jan 22, 2020 · 1 comment

Contributor

AngledLuffa commented Jan 22, 2020

Goal: build new glove vectors with current vocab

new people you haven't heard of should now have word vectors
match tokenization of the glove vectors with the upcoming corenlp tokenization
also, we don't have good records of what data we used to build the vectors

wikipedia + gigaword
maybe common crawl and/or twitter as well

could look at attardi's wikipedia cleaner

note for internal use: /u/downloads/data

Big-Tree commented Dec 24, 2021

This would be very useful. I want something up to date and I can't seem to find any alternatives.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment