Derivative of Sigmoid and Softmax Explained Visually

The derivative of the sigmoid function can be understood intuitively by looking at how the denominator of the function transforms the numerator. The derivative of the softmax function, which can be thought of as an extension of the sigmoid function to multiple classes, works in a very similar way, and in this video, I explain that relationship. The sigmoid and softmax are commonly used in neural networks, so having a more intuitive understanding of their derivatives will help us better understand how the gradients propagate through our neural networks during backpropagation.

My previous video, "Why We Use the Sigmoid Function in Neural Networks for Binary Classification":
📼 Why Do We Use the Sigmoid Function fo...

My previous video, "Softmax Function Explained In Depth with 3D Visuals":
📼 Softmax Function Explained In Depth w...

Desmos graph for sigmoid derivative:
📈 https://www.desmos.com/calculator/r8h...

Desmos graph for softmax derivative:
📈 https://www.desmos.com/calculator/u5r...

Join our Discord community:
💬 Discord: discord

Connect with me:
🐦 Twitter - Twitter: elliotwaite
📷 Instagram - Instagram: elliotwaite
👱 Facebook - Facebook: elliotwaite
💼 LinkedIn - LinkedIn: elliotwaite

🎵 Kazukii - Return
→ SoundCloud: ohthatkazuki
→ https://open.spotify.com/artist/5d07M...
→ officialkazuki

• #education
• #derivative_of_sigmoid
• #derivative_of_softmax
• #sigmoid_derivative
• #softmax_derivative
• #derivative_of_sigmoid_explained
• #derivative_of_softmax_explained
• #sigmoid_derivative_explained
• #softmax_derivative_explained
• #sigmoid_derivative_backpropogation
• #softmax_derivative_backpropogation
• #sigmoid_function_derivative
• #softmax_function_derivative
• #sigmoid_derivative_graph
• #softmax_derivative_graph
• #derivative_of_sigmoid_function
• #derivative_of_sigmoid_proof
• #derivative_of_softmax_proof