Running LLM's on your PC with LM Studio | Mistral 7B on your PC
Large Language Models have taken the world by storm! But do we really want to send all our data to OpenAI? Why not run LLM's locally on our PC? In this video you'll learn how to use LM Studio to run models on your PC!
I first show you how to chat with the model, the same way we do with ChatGPT, and in my second example you learn how to create a local server and connect with it from a Python script.
⭐️ Links ⭐
🔗 Download LM Studio: https://lmstudio.ai/
🔗 More info about Mistral7b: https://huggingface.co/TheBloke/Mistr...
⭐️ Timestamps⭐
00:00 - Intro
00:18 - Download LM Studio
00:41 - Selecting a model from LM Studio
02:27 - What is quantization in LLMs?
03:02 - Downloading the model to your PC
03:17 - How to chat with a local LLM - Mistral
03:37 - How to use a system prompt?
03:51 - How to chat with a local model (Mistral)?
04:32 - How to call a local LLM from a Python script?
05:17 - How to install the openai library in Python?
06:34 - Outro
⭐️ Follow me ⭐
💼 LinkedIn: / thomas--janssen
✅ Instagram: / tomstechacademy
❗ Some of my videos contain affiliate links. When you click on these kind of links, I get a small percentage in case you make a purchase via the website. Be aware that this doesn't cost you anything - you never pay more than the standard retail price.
#largelanguagemodels #llm #python #lmstudio
