It has been a interesting weekend. fireworks both inside and outside my house, lol! I was able to get Open WebUI and Ollama installed on my server but it is running crazy slow due to no GPU support. It is taking a crazy amount of time to run basic queries which kind of suck. I am playing with the configuration to see if I can get some working better without employing a gpu but I think I might have to go with Nomad setup from Crosstalk Solutions verses what I am using now. I did not think it would be this hard, but it is what it is, I guess!
Happy Monday 😅
No comments:
Post a Comment