What is Flash Attention?

This video explains an advancement over the Attention mechanism used in LLMs (Attention is all you need) , Flash Attention which improves both time and space complexity.
#ai #llm #ml #datascience #maths