Understanding Embeddings in LLMs (ft LlamaIndex + Chroma db)

We do a deep dive into one of the most important pieces of LLMs (large language models, like GPT-4, Alpaca, Llama etc): EMBEDDINGS! :)  In every langchain or llamaindex tutorial you'll come across this idea, but they can feel quite "rushed" or opaque, so this video presents a deeper look into what embeddings really are, and the role it plays in a world dominated by large language models like GPT.

In Chroma's own words, Embeddings are "the A.I-native way to represent any kind of data, making them the perfect fit for working with all kinds of A.I-powered tools and algorithms. They can represent text, images, and soon audio and video. There are many options for creating embeddings, whether locally using an installed library, or by calling an API".

LlamaIndex (GPT Index) is a project that provides a central interface to connect your LLM’s with external data.

LangChain is a fantastic tool for developers looking to build AI systems using the variety of LLMs (large language models, like GPT-4, Alpaca, Llama etc), as it helps unify and standardize the developer experience in text embeddings, vector stores / databases (like Chroma), and chaining it for downstream applications through agents.

Mentioned in the video:
- Chroma Embeddings database (vector store):
https://docs.trychroma.com/embeddings

- Watch PART 1 of the LangChain / LLM series: LangChain + OpenAI tutorial: Building...

- Watch PART 2 of the LangChain / LLM series:
LangChain + OpenAI to chat w/ (query)...

- Watch PART 3 of the LangChain / LLM series
LangChain + HuggingFace's Inference API (no OpenAI credits required!)
LangChain + HuggingFace's Inference A...

- HuggingFace's Sentence-Transformer model
https://huggingface.co/sentence-trans...

All the code for the LLM (large language models) series featuring GPT-3, ChatGPT, LangChain, LlamaIndex and more are on my github repository so go and ⭐ star or 🍴 fork it. Happy Coding!
https://github.com/onlyphantom/llm-py...