Installing Llama 2 on Windows Using oobabooga Web UI

Downloading the new Llama 2 large language model from meta and testing it with oobabooga text generation web ui chat on Windows.

oobabooga GitHub: https://github.com/oobabooga/text-gen...
Llama 2 Meta Page: https://ai.meta.com/llama/
huggingface lama models: https://huggingface.co/meta-llama

Note regarding the token:
from: @user-tc5cc3or5m
with the recent oobabooga version, you have to set HF_TOKEN with your token only. if you set HF_USER and HF_PASS as shown in the video, things won't work anymore!

If you get the 401 Unauthorized error in the UI tab even after creating the environment variables, then try either of these 2 alternatives:
1. do a git clone to a new folder within the models folder. Like create this folder "oobabooga_windows\text-generation-webui\models\meta-llama_Llama-2-7b-chat-hf" and within that do the git command from hugging face:
git lfs install
git clone https://huggingface.co/meta-llama/Lla...
That should result in the same files.

2. You could also manually download the files from the hugging face Files and versions tab and place them in that folder: "oobabooga_windows\text-generation-webui\models\meta-llama_Llama-2-7b-chat-hf"

Video with method 2 to download the model manually: Download Llama 2 Model Manually (with...