How To Run ANY Open Source LLM LOCALLY In Linux



In this video, I will show you how to run ANY open source llm (large language models) locally on Linux using Ollama & LMStudio. Ollama & LMStudio are the best tools that allows you to run various models such as llama3, Gemma, Mistral, codellama & much more. Watch this video and learn running LLMS locally on Linux computer.

*Timestamps*
00:00 Introduction
00:38 Pre-requisites 
01:16 Installing Ollama
02:18 Download LLM
03:01 Testing LLAMA3 & Gemma
05:31 Customizing Model
06:55 Installing LMStudio

*Download*
Ollama: https://ollama.com/download
LMStudio: https://lmstudio.ai/

*Relevant Tech Videos*
Dual boot ubuntu 24.04 LTS And Windows 11 – https://www.youtube.com/watch?v=alFosqQ1ang
Clean Install Ubuntu 24.04 LTS – https://www.youtube.com/watch?v=XjQGGLa_Dic
Install Ubuntu 24.04 LTS On Virtual Box -https://www.youtube.com/watch?v=8uYjoBh21IU

~ *Buy Me A Coffee* – http://buymeacoffee.com/kskroyal
~ *Connect On Instagram* – @KSKROYALTECH
~ *For Business Enquires ONLY* – [email protected]
~ *My Website* – https://kskroyal.com/

*© KSK ROYAL* 
    *MereSai*

source

Similar Posts