Neural Networks From Scratch - Lec 9 - ReLU Activation Function
1.4 هزار بار بازدید -
2 سال پیش
-
Building Neural Networks from scratch
Building Neural Networks from scratch in python.
This is the ninth video of the course - "Neural Networks From Scratch". This video covers the ReLU activation function and it's importance. We discuss the advantages of using ReLU activation function and its drawbacks. finally we discussed some tips to follow when using ReLU function in the neural networks. Also we saw the python implementation.
Course Playlist:
Neural Networks From Scratch in Python
Sparsity in Machine Learning:
https://blogs.nvidia.com/blog/2020/05...
https://arxiv.org/abs/2102.00554
Please like and subscribe to the channel for more videos. This will help me in assessing the interests and creating more content. Thank you!
Chapter:
0:00 Introduction
0:38 Vanishing Gradient Problem
1:11 ReLU Activation function
2:07 ReLU function behaviour
2:55 Sine wave approximation using ReLU
3:20 Derivative of ReLU
3:46 Dying ReLU Problem
4:29 Advantages
6:33 Drawbacks
7:37 Tips for using ReLU
9:05 Python Implementation
#reluactivationfunction, #reluactivationfunctioninneuralnetwork, #sigmoidactivationfunction, #activationfunctioninneuralnetwork, #vanishinggradient
This is the ninth video of the course - "Neural Networks From Scratch". This video covers the ReLU activation function and it's importance. We discuss the advantages of using ReLU activation function and its drawbacks. finally we discussed some tips to follow when using ReLU function in the neural networks. Also we saw the python implementation.
Course Playlist:
Neural Networks From Scratch in Python
Sparsity in Machine Learning:
https://blogs.nvidia.com/blog/2020/05...
https://arxiv.org/abs/2102.00554
Please like and subscribe to the channel for more videos. This will help me in assessing the interests and creating more content. Thank you!
Chapter:
0:00 Introduction
0:38 Vanishing Gradient Problem
1:11 ReLU Activation function
2:07 ReLU function behaviour
2:55 Sine wave approximation using ReLU
3:20 Derivative of ReLU
3:46 Dying ReLU Problem
4:29 Advantages
6:33 Drawbacks
7:37 Tips for using ReLU
9:05 Python Implementation
#reluactivationfunction, #reluactivationfunctioninneuralnetwork, #sigmoidactivationfunction, #activationfunctioninneuralnetwork, #vanishinggradient
2 سال پیش
در تاریخ 1400/11/11 منتشر شده
است.
1,439
بـار بازدید شده