Setting Up a RAG Demo on NVIDIA AI Workbench

Walk through a complete start-to-finish installation of a generative AI retrieval-augmented generation (RAG) system with Lee Bushen, solutions architect at NVIDIA.

You can use this system to create a RAG project on your own computer (no local GPU required) in about 1 hour.

This approach uses NVIDIA AI Workbench to install the system. NVIDIA AI Workbench is an easy-to-use developer toolkit for data science, machine learning, and AI project development. AI Workbench is free, and you can install it in minutes.

For more details, see the resources listed below.

######################
CHAPTERS IN THIS VIDEO
######################
0:00 – Intro and Prerequisites
02:01 – Create GitHub and NGC Accounts
05:39 – AI Workbench Install
09:46 – Clone/Launch the RAG Project
16:49 – How to Re-Enter the API Key
18:35 – Example Prompts
23:11 – Stopping/Restarting the Demo

Project storage and sharing: http://github.com

Used for API calls to optimized LLM:  http://ngc.nvidia.com

Download NVIDIA AI Workbench: https://www.nvidia.com/en-us/deep-lea...

Hybrid RAG example project: https://github.com/NVIDIA/workbench-e...

Sample user data files:

NVIDIA H100 data sheet: https://resources.nvidia.com/en-us-te...

NVIDIA AI Enterprise Solution Overview:
https://resources.nvidia.com/en-us-da...