New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

For BinaryBERT, what is the value of config.dyna_hidden_size? #220

Open

Phuoc-Hoan-Le opened this issue Oct 31, 2022 · 2 comments

Phuoc-Hoan-Le commented Oct 31, 2022

For BinaryBERT, what is the value of config.dyna_hidden_size? Where is it initialized at exactly, what file?

Contributor

itsucks commented Nov 15, 2022

The paper take DynaBERT (Hou et al., 2020) sub-networks as backbones, so this is from DynaBERT configuration

Author

Phuoc-Hoan-Le commented Nov 16, 2022

What is the size though? there are many different types of DynaBERT.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment