Deploying machine learning models on Kubernetes

In this video, we will go through a simple end to end example how to deploy a ML model on Kubernetes. We will use an pretrained Transformer model on the task of masked language modelling (fill-mask) and turn it into a REST API. Then we will containerize our service and finally deploy it on a Kubernetes cluster.

Code from the video:
https://github.com/jankrepl/mildlyove...

00:00 Intro
00:22 3 step procedure diagram
01:42 Existing framework overview
02:09 Creating an API
09:25 Containerization
13:53 Containerization - custom platform
15:47 Preparing a minikube K8s cluster
17:43 K8s: Deployment and service
21:31 K8s: 2 cool features - self-healing and load balancing
26:00 Outro

If you have any video suggestions or you just wanna chat feel free to join the discord server: Discord: discord

Twitter: Twitter: moverfitted

Credits logo animation
Title:  Conjungation · Author: Uncle Milk · Source: SoundCloud: unclemilk · License: https://creativecommons.org/licenses/... · Download (9MB): https://auboutdufil.com/?id=600

• #science_technology
• #docker
• #fastapi
• #machine_learning
• #artificial_intelligence
• #kubernetes
• #hugging_face
• #masked_language_modelling
• #bert
• #rest_api
• #container
• #containarization
• #deployment
• #service
• #horizontal_scaling
• #minikube
• #kubectl
• #natural_language_processing
• #mlops
• #devops
• #python
• #production
• #serving_models