Implementing Leaky ReLU and Its Derivative from Scratch
286 بار بازدید -
2 سال پیش
-
In this video, we discuss
In this video, we discuss and implement Leaky ReLU activation function and its derivative using PyTorch.
Codebase: https://github.com/oniani/ai
GitHub: https://github.com/oniani
Web: https://oniani.ai
#ai #softwareengineering #programming #stylepoint #leakyrelu
Chapters
0:00 - Intro
0:27 - Discussing Leaky ReLU
3:06 - Computing the derivative of Leaky ReLU
5:06 - Implementing `forward` method
6:23 - Implementing `backward` method
6:53 - Using `gradcheck` for testing
7:28 - The alternative implementation
8:59 - Outro
Codebase: https://github.com/oniani/ai
GitHub: https://github.com/oniani
Web: https://oniani.ai
#ai #softwareengineering #programming #stylepoint #leakyrelu
Chapters
0:00 - Intro
0:27 - Discussing Leaky ReLU
3:06 - Computing the derivative of Leaky ReLU
5:06 - Implementing `forward` method
6:23 - Implementing `backward` method
6:53 - Using `gradcheck` for testing
7:28 - The alternative implementation
8:59 - Outro
2 سال پیش
در تاریخ 1401/07/06 منتشر شده
است.
286
بـار بازدید شده