Finetune LLAMA2 on custom dataset efficiently with QLoRA | Detailed Explanation| LLM| Karndeep Singh

This video describes the step-by-step, detailed explanation on how to finetune llama 2 on a single GPU efficiently with QLoRA. Following are the topics covered in the video:
1. Overview of Supervised fine-tuning and RLHF
2. Why is Finetuning required?
3. What is LoRA and how is it helpful?
4. How to prepare an Instruct Dataset for finetune generative models?
5. How to train the LLAMA 2 model using Instruct Dataset?
6. Inference using fine-tuned LLAMA 2 Model.

Notebook: https://github.com/karndeepsingh/gene...

Dataset: https://huggingface.co/datasets/knkar...


Connect with me on :
1. LinkedIn: LinkedIn: karndeepsingh

2. Telegram Group: https://telegram.me/datascienceclubac...

3. Github: https://www.github.com/karndeepsingh

Background Music:
Sweet Dreams by BatchBug | SoundCloud: batchbug
Music promoted by https://www.chosic.com/free-music/all/
Creative Commons Attribution 3.0 Unported License
https://creativecommons.org/licenses/...

#llms #llama2 #finetune #qlora #huggingface