Importing Open Source Models to Ollama

Hugging Face is a machine learning platform that's home to nearly 500,000 open source models. In this video, I show you how to download, transform, and use them in your local Ollama setup. Get access to the latest and greatest without having to wait for it to be published to Ollama's model library. Let's go! Check out my other Ollama videos -    • Get Started with Ollama   Links: Code from the video - decoder.sh/videos/importing-open-source-models-to-… Ollama docs for adding a model - github.com/ollama/ollama/blob/main/docs/import.md CapybaraHermes model - huggingface.co/argilla/CapybaraHermes-2.5-Mistral-… The Bloke GGUF model - huggingface.co/TheBloke/CapybaraHermes-2.5-Mistral… Ollama Quantization Docker Image - hub.docker.com/r/ollama/quantize Dolphin dataset - erichartford.com/dolphin OpenHermes dataset - huggingface.co/datasets/teknium/OpenHermes-2.5 Capybara dataset - huggingface.co/datasets/LDJnr/Capybara Git LFS - git-lfs.com/ GGUF - github.com/ggerganov/ggml/blob/master/docs/gguf.md Safetensor - huggingface.co/docs/safetensors/index ChatML - huggingface.co/teknium/OpenHermes-2.5-Mistral-7B#p… Timestamps: 00:00 - Intro 00:13 - But Why? 00:57 - Where do new models come from? 01:06 - Who makes models? 01:22 - Our target model 01:37 - What even is a model? 01:50 - GGUF 02:02 - Safetensors 02:18 - Importing GGUF to Ollama 02:33 - TheBloke Quantized Models 03:07 - Creating Modelfile 03:48 - Create Model 03:55 - Run Model 04:21 - DIY Quantization of safetensors 05:12 - Download safetensors 05:56 - Quantization 06:49 - What's Next? 07:09 - Feel better soon

• #science_technology
• #ollama
• #hugging_face
• #machine_learning
• #llm
• #self_hosted
• #open_source
• #large_language_model