How does Groq LPU work? (w/ Head of Silicon Igor Arsovski!)
18.9 هزار بار بازدید -
6 ماه پیش
-
Become a Patreon:
Become a Patreon: Patreon: theaiepiphany
👨👩👧👦 Join our Discord community: Discord: discord
I invited head of silicon at Groq, Igor Arsovski, to share the nitty-gritty details behind Groq's LPUs! LPU or language processing units showed promising results (understatement of the year) on inference benchmarks compared to NVIDIA GPUs.
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
⌚️ Timetable:
00:00:00 - 00:00:42 Intro
00:00:42 - 00:02:23 Hyperstack GPU cloud (sponsored)
00:02:23 - 00:12:18 What does Groq do?
00:12:18 - 00:26:40 Hardware
00:26:40 - 00:37:52 Software
00:37:52 - 00:45:09 Power control
00:45:09 - 00:54:22 Networking
00:54:22 - 00:59:30 AllReduce comparison between GPUs and LPUs
00:59:30 - 01:04:10 GPU vs LPU
01:04:10 - 01:11:45 Outro
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
💰 SPONSOR
The AI Epiphany - Patreon: theaiepiphany
One-time donation - https://www.paypal.com/paypalme/theai...
Huge thank you to these AI Epiphany patreons:
Eli Mahler
Petar Veličković
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
💼 LinkedIn - LinkedIn: aleksagordic
🐦 Twitter - Twitter: gordic_aleksa
👨👩👧👦 Discord - Discord: discord
📺 YouTube - theaiepiphany
📚 Medium - Medium: gordicaleksa
💻 GitHub - https://github.com/gordicaleksa
📢 AI Newsletter - https://aiepiphany.substack.com/
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
#groq #lpu #aichip #ai
👨👩👧👦 Join our Discord community: Discord: discord
I invited head of silicon at Groq, Igor Arsovski, to share the nitty-gritty details behind Groq's LPUs! LPU or language processing units showed promising results (understatement of the year) on inference benchmarks compared to NVIDIA GPUs.
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
⌚️ Timetable:
00:00:00 - 00:00:42 Intro
00:00:42 - 00:02:23 Hyperstack GPU cloud (sponsored)
00:02:23 - 00:12:18 What does Groq do?
00:12:18 - 00:26:40 Hardware
00:26:40 - 00:37:52 Software
00:37:52 - 00:45:09 Power control
00:45:09 - 00:54:22 Networking
00:54:22 - 00:59:30 AllReduce comparison between GPUs and LPUs
00:59:30 - 01:04:10 GPU vs LPU
01:04:10 - 01:11:45 Outro
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
💰 SPONSOR
The AI Epiphany - Patreon: theaiepiphany
One-time donation - https://www.paypal.com/paypalme/theai...
Huge thank you to these AI Epiphany patreons:
Eli Mahler
Petar Veličković
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
💼 LinkedIn - LinkedIn: aleksagordic
🐦 Twitter - Twitter: gordic_aleksa
👨👩👧👦 Discord - Discord: discord
📺 YouTube - theaiepiphany
📚 Medium - Medium: gordicaleksa
💻 GitHub - https://github.com/gordicaleksa
📢 AI Newsletter - https://aiepiphany.substack.com/
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
#groq #lpu #aichip #ai
6 ماه پیش
در تاریخ 1402/12/09 منتشر شده
است.
18,975
بـار بازدید شده