New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

习题7-7 #58

Open

simo-an opened this issue Jan 7, 2022 · 0 comments

simo-an commented Jan 7, 2022 •

edited

Loading

题目

习题7-7 从再参数化的角度来分析批量归一化中缩放和平移的意义。

解答

对净输入 𝒛(𝑙) 的标准归一化会使得其取值集中到 0 附近，如果使用 Sigmoid型激活函数时，这个取值区间刚好是接近线性变换的区间，减弱了神经网络的非线性性质．

因此，为了使得归一化不对网络的表示能力造成负面影响，可以通过一个附加的缩放和平移变换改变取值区间。

simo-an changed the title ~~习题7-7（coming）~~ 习题7-7

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment