Distributed Computing for Large Generative AI Models

Masoud Ardakani Large generative AI models (such as ChatGPT, and Picaso) need to perform massive computations. In particular, matrix operations of monumental size (trillions of entries) are performed. Such operations are distributed over many computing devices. In such a distributed computing setup, if even one of the computing devices fails to provide its assigned task, the whole operation is endangered. Coded distributed computing is a solution to this problem, and in my talk, I will discuss the opportunities and challenges of this area of research.

• #علوم_پایه
• #masoud_ardakani
• #amirkabir
• #aaiss