Which Activation Function Should I Use?

All neural networks use activation functions, but the reasons behind using them are never clear! Let's discuss what activation functions are, when they should be used, and what the difference between them is.

Sample code from this video:
https://github.com/llSourcell/Which-A...

Please subscribe! And like. And comment. That's what keeps me going.

More Learning resources:
http://www.kdnuggets.com/2016/08/role...
http://cs231n.github.io/neural-networ...
https://www.quora.com/What-is-the-rol...
https://stats.stackexchange.com/quest...
https://en.wikibooks.org/wiki/Artific...
https://stackoverflow.com/questions/9...
https://papers.nips.cc/paper/874-how-...
http://neuralnetworksanddeeplearning....
Medium: activation-functions-in-neural-networks
Medium: mathematical-foundation-for-activation-functions-in-artificial-neural-networks

Join us in the Wizards Slack channel:
http://wizards.herokuapp.com/

And please support me on Patreon:
https://www.patreon.com/user?u=3191693
Follow me:
Twitter: Twitter: sirajraval
Facebook: Facebook: sirajology Instagram: Instagram: sirajraval Instagram: Instagram: sirajraval
Signup for my newsletter for exciting updates in the field of AI:
https://goo.gl/FZzJ5w
Hit the Join button above to sign up to become a member of my channel for access to exclusive content! Join my AI community: http://chatgptschool.io/ Sign up for my AI Sports betting Bot, WagerGPT! (500 spots available):
https://www.wagergpt.co

• #education
• #neural_network
• #deep_learning
• #activation_function
• #relu
• #sigmoid
• #tanh
• #math
• #mathematics
• #machine_learning
• #artificial_intelligence
• #ai
• #ml
• #andrew_ng
• #udacity
• #coursera
• #programming
• #coding
• #data_science
• #python
• #code
• #learn_to_code
• #learn_to_program
• #tensorflow
• #google