Neural Networks Part 7: Cross Entropy Derivatives and Backpropagation

Here is a step-by-step guide that shows you how to take the derivative of the Cross Entropy function for Neural Networks and then shows you how to use that derivative for Backpropagation.

NOTE: This StatQuest assumes that you are already familiar with...
The main ideas behind neural networks: The Essential Main Ideas of Neural Ne...
The main ideas behind backpropagation: Neural Networks Pt. 2: Backpropagatio...
Neural networks with multiple inputs and outputs: Video
ArgMax and SoftMax: Neural Networks Part 5: ArgMax and So...
Cross Entropy: Neural Networks Part 6: Cross Entropy

For a complete index of all the StatQuest videos, check out:
https://statquest.org/video-index/

If you'd like to support StatQuest, please consider...

Buying my book, The StatQuest Illustrated Guide to Machine Learning:
PDF - https://statquest.gumroad.com/l/wvtmc
Paperback - https://www.amazon.com/dp/B09ZCKR4H6
Kindle eBook - https://www.amazon.com/dp/B09ZG79HXC

Patreon: Patreon: statquest
...or...
YouTube Membership: @statquest

...a cool StatQuest t-shirt or sweatshirt:
https://shop.spreadshirt.com/statques...

...buying one or two of my songs (or go large and get a whole album!)
https://joshuastarmer.bandcamp.com/

...or just donating to StatQuest!
https://www.paypal.me/statquest

Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter:
Twitter: joshuastarmer

0:00 Awesome song and introduction
5:47 dCE_setosa with respect to b3
11:19 dCE_virginica with respect to b3
15:03 Other derivatives
16:09 Backpropagation with cross entropy

#StatQuest #NeuralNetworks #CrossEntropy

• #education
• #josh_starmer
• #statquest
• #machine_learning
• #statistics
• #data_science