How To Run ANY Open Source LLM LOCALLY In Linux
In this video, I will show you how to run ANY open source llm (large language models) locally on Linux using Ollama & LMStudio. Ollama & LMStudio are the best tools that allows you to run various models such as llama3, Gemma, Mistral, codellama & much more. Watch this video and learn running LLMS locally on Linux computer.
*Timestamps*
00:00 Introduction
00:38 Pre-requisites
01:16 Installing Ollama
02:18 Download LLM
03:01 Testing LLAMA3 & Gemma
05:31 Customizing Model
06:55 Installing LMStudio
*Download*
Ollama: https://ollama.com/download
LMStudio: https://lmstudio.ai/
*Relevant Tech Videos*
Dual boot ubuntu 24.04 LTS And Windows 11 – https://www.youtube.com/watch?v=alFosqQ1ang
Clean Install Ubuntu 24.04 LTS – https://www.youtube.com/watch?v=XjQGGLa_Dic
Install Ubuntu 24.04 LTS On Virtual Box -https://www.youtube.com/watch?v=8uYjoBh21IU
~ *Buy Me A Coffee* – http://buymeacoffee.com/kskroyal
~ *Connect On Instagram* – @KSKROYALTECH
~ *For Business Enquires ONLY* – [email protected]
~ *My Website* – https://kskroyal.com/
*© KSK ROYAL*
*MereSai*
source
