PyTorch Autograd Explained - In-depth Tutorial

Elliot Waite
Elliot Waite
103.2 هزار بار بازدید - 6 سال پیش - In this PyTorch tutorial, I
In this PyTorch tutorial, I explain how the PyTorch autograd system works by going through some examples and visualize the graphs with diagrams. As you perform operations on PyTorch tensors that have requires_grad=True, you build up an autograd backward graph. Then when you call the backward() method on one of the output nodes, the backward graph gets traversed, starting at the node that the grad_fn attribute of the output node points to, and traversing backwards from there, accumulating gradients until leaf nodes are reached. The final leaf node gradients will be stored on the grad attribute of the leaf tensors.

This is my first PyTorch tutorial video. If you'd like to see more PyTorch related videos, let me know in the comments. And if you have anything specific about PyTorch that you would like me to make videos about, let me know.

The diagrams.net flowcharts shown in the video:
🔗 https://drive.google.com/file/d/1bq3a...
(Note: Click this link to go to the Google Drive file, then click the button in the top center that says "Open with diagrams.net", then once it's loaded, there will be tabs along the bottom of the diagrams.net page for all the different graphs shown in the video.)

Join our Discord community:
💬 Discord: discord

Connect with me:
🐦 Twitter - Twitter: elliotwaite
📷 Instagram - Instagram: elliotwaite
👱 Facebook - Facebook: elliotwaite
💼 LinkedIn - LinkedIn: elliotwaite

🎵 ksolis - Nobody Else (ksolis - Nobody Else)
6 سال پیش در تاریخ 1397/08/12 منتشر شده است.
103,262 بـار بازدید شده
... بیشتر