I asked Llama2 who is Mr Beast with LlamaCpp the no GPU no cost Generative AI

Super Lazy Coder
Super Lazy Coder
209 بار بازدید - 9 ماه پیش - The main goal of llama.cpp
The main goal of llama.cpp is to run the LLamA model using 4-bit integer quantization. This enables LlamaCpp to run heavy generative AI models on a CPU machine. Models are downloaded free of cost from hugging face so it saves any subscription billing cost as well.
In this video we do the LlamaCpp installation and a short demo to showcase its magic.
Stay until the end to learn about CTransformers as well.

Subscribe for more videos about Langchain.
Happy Learning!

0:00 Introduction
1:03 What is Llama Cpp
4:00 Installation
10:52 Asking Llama2 about Mr Beast
26:20 Llama Cpp example on local VSCode
28:12 CTransformers
30:35 Like Share Subscribe
21:10 Comparison between OpenAi and LlamaCpp

Langchain playlist - Langchain and Large language models

Langchain Agents link - https://python.langchain.com/docs/mod...

Llama2 model download - https://huggingface.co/TheBloke/Llama...

Llama.cpp installation - https://python.langchain.com/docs/int...
9 ماه پیش در تاریخ 1402/08/25 منتشر شده است.
209 بـار بازدید شده
... بیشتر