2021-12-04 18:09:50 +08:00
|
|
|
|
mindspore.nn.LeakyReLU
|
|
|
|
|
|
=======================
|
|
|
|
|
|
|
|
|
|
|
|
.. py:class:: mindspore.nn.LeakyReLU(alpha=0.2)
|
|
|
|
|
|
|
|
|
|
|
|
Leaky ReLU激活函数。
|
|
|
|
|
|
|
2021-12-20 15:33:20 +08:00
|
|
|
|
该激活函数定义如下:
|
2021-12-04 18:09:50 +08:00
|
|
|
|
|
|
|
|
|
|
.. math::
|
|
|
|
|
|
\text{leaky_relu}(x) = \begin{cases}x, &\text{if } x \geq 0; \cr
|
2021-12-20 15:33:20 +08:00
|
|
|
|
{\alpha} * x, &\text{otherwise.}\end{cases}
|
2021-12-04 18:09:50 +08:00
|
|
|
|
|
2021-12-20 15:33:20 +08:00
|
|
|
|
其中,:math:`\alpha` 表示 `alpha` 参数。
|
2021-12-04 18:09:50 +08:00
|
|
|
|
|
2022-08-27 16:53:12 +08:00
|
|
|
|
更多细节详见 `Rectifier Nonlinearities Improve Neural Network Acoustic Models <https://ai.stanford.edu/~amaas/papers/relu_hybrid_icml2013_final.pdf>`_ 。
|
2021-12-04 18:09:50 +08:00
|
|
|
|
|
2022-07-22 16:25:38 +08:00
|
|
|
|
参数:
|
|
|
|
|
|
- **alpha** (`Union[int, float]`) - x<0时激活函数的斜率,默认值:0.2。
|
2021-12-04 18:09:50 +08:00
|
|
|
|
|
2022-07-22 16:25:38 +08:00
|
|
|
|
输入:
|
|
|
|
|
|
- **x** (Tensor) - 计算LeakyReLU的任意维度的Tensor。
|
2021-12-04 18:09:50 +08:00
|
|
|
|
|
2022-07-22 16:25:38 +08:00
|
|
|
|
输出:
|
|
|
|
|
|
Tensor,数据类型和shape与 `x` 相同。
|
2021-12-04 18:09:50 +08:00
|
|
|
|
|
2022-07-22 16:25:38 +08:00
|
|
|
|
异常:
|
|
|
|
|
|
- **TypeError** - `alpha` 不是浮点数或整数。
|