Activation Functions - EXPLAINED!
111 هزار بار بازدید -
4 سال پیش
-
We start with the whats/whys/hows.
We start with the whats/whys/hows. Then delve into details (math) with examples.
Follow me on M E D I U M: https://towardsdatascience.com/likeli...
REFERENCES
[1] Amazing discussion on the "dying relu problem": https://www.quora.com/What-is-the-dyi...
[2] Saturating functions that "squeeze" inputs: https://stats.stackexchange.com/quest...
[3] Plot math functions beautifully with desmos: https://www.desmos.com/
[4] The paper on Exponential Linear units (ELU): https://arxiv.org/abs/1511.07289
[5] Relatively new activation function (swish): https://arxiv.org/pdf/1710.05941v1.pdf
[6] Used an Image of activation functions from this Pawan Jain's Blog: https://towardsdatascience.com/comple...
[7] Why bias in Neural Networks? https://stackoverflow.com/questions/7...
Follow me on M E D I U M: https://towardsdatascience.com/likeli...
REFERENCES
[1] Amazing discussion on the "dying relu problem": https://www.quora.com/What-is-the-dyi...
[2] Saturating functions that "squeeze" inputs: https://stats.stackexchange.com/quest...
[3] Plot math functions beautifully with desmos: https://www.desmos.com/
[4] The paper on Exponential Linear units (ELU): https://arxiv.org/abs/1511.07289
[5] Relatively new activation function (swish): https://arxiv.org/pdf/1710.05941v1.pdf
[6] Used an Image of activation functions from this Pawan Jain's Blog: https://towardsdatascience.com/comple...
[7] Why bias in Neural Networks? https://stackoverflow.com/questions/7...
4 سال پیش
در تاریخ 1398/12/28 منتشر شده
است.
111,017
بـار بازدید شده