MasterNerd@lemm.eetoSelfhosted@lemmy.world•Is it possible to run a LLM on a mini-pc like the GMKtec K8 and K9?English
5·
5 months agoLook into ollama. It shouldn’t be an issue if you stick to 7b parameter models
Look into ollama. It shouldn’t be an issue if you stick to 7b parameter models
RGB is overrated
So I know it’s supposed to be an arm, but those language be dummy thicc
I don’t have any experience with them honestly so I can’t help you there