Implementing Sigmoid and Its Derivative from Scratch
505 بار بازدید -
2 سال پیش
-
In this video, we discuss
In this video, we discuss and implement Sigmoid activation function and its derivative using PyTorch.
Codebase: https://github.com/oniani/ai
GitHub: https://github.com/oniani
Web: https://oniani.ai
#ai #softwareengineering #programming #stylepoint #sigmoid
Chapters
0:00 - Intro
0:36 - Discussing Sigmoid
4:59 - Numerical stability
5:37 - Computing the derivative of Sigmoid
8:21 - The API of the first approach
8:45 - Implementing `forward` method
11:23 - Implementing `backward` method
12:01 - Using `gradcheck` for testing
12:21 - The alternative implementation
14:35 - Outro
Codebase: https://github.com/oniani/ai
GitHub: https://github.com/oniani
Web: https://oniani.ai
#ai #softwareengineering #programming #stylepoint #sigmoid
Chapters
0:00 - Intro
0:36 - Discussing Sigmoid
4:59 - Numerical stability
5:37 - Computing the derivative of Sigmoid
8:21 - The API of the first approach
8:45 - Implementing `forward` method
11:23 - Implementing `backward` method
12:01 - Using `gradcheck` for testing
12:21 - The alternative implementation
14:35 - Outro
2 سال پیش
در تاریخ 1401/07/01 منتشر شده
است.
505
بـار بازدید شده