Neural Networks Part 6: Cross Entropy

When a Neural Network is used for classification, we usually evaluate how well it fits the data with Cross Entropy. This StatQuest gives you and overview of how to calculate Cross Entropy and Total Cross Entropy.

NOTE: This StatQuest assumes that you are already familiar with...
The main ideas behind neural networks: The Essential Main Ideas of Neural Ne...
The main ideas behind backpropagation: Neural Networks Pt. 2: Backpropagatio...
Neural networks with multiple inputs and outputs: Neural Networks Pt. 4: Multiple Input...
ArgMax and SoftMax: Neural Networks Part 5: ArgMax and So...

For a complete index of all the StatQuest videos, check out:
https://statquest.org/video-index/

If you'd like to support StatQuest, please consider...

Buying my book, The StatQuest Illustrated Guide to Machine Learning:
PDF - https://statquest.gumroad.com/l/wvtmc
Paperback - https://www.amazon.com/dp/B09ZCKR4H6
Kindle eBook - https://www.amazon.com/dp/B09ZG79HXC

Patreon: Patreon: statquest
...or...
YouTube Membership: @statquest

...a cool StatQuest t-shirt or sweatshirt:
https://shop.spreadshirt.com/statques...

...buying one or two of my songs (or go large and get a whole album!)
https://joshuastarmer.bandcamp.com/

...or just donating to StatQuest!
https://www.paypal.me/statquest

Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter:
Twitter: joshuastarmer

0:00 Awesome song and introduction
1:48 Cross Entropy defined
2:50 General equation for Cross Entropy
4:11 Calculating Total Cross Entropy
5:41 Why Cross Entropy and not SSR?

#StatQuest #NeuralNetworks #CrossEntropy

• #education
• #josh_starmer
• #statquest
• #machine_learning
• #statistics
• #data_science