This commit is contained in:
wanyiming 2021-11-22 09:52:37 +08:00
parent 94036ca8c0
commit 706fd10341
1 changed files with 1 additions and 0 deletions

View File

@ -272,6 +272,7 @@ class HeUniform(Initializer):
.. math::
boundary = \sqrt{\frac{6}{(1 + a^2) \times \text{fan_in}}}
which is the bound of the HeUniform distribution.
For details of HeUniform algorithm, please check