Hosting LLM's is a heavy lift!

It has been a interesting weekend.  fireworks both inside and outside my house, lol!  I was able to get Open WebUI and Ollama installed on my server but it is running crazy slow due to no GPU support.  It is taking a crazy amount of time to run basic queries which kind of suck.  I am playing with the configuration to see if I can get some working better without employing a gpu but I think I might have to go with Nomad setup from Crosstalk Solutions verses what I am using now.  I did not think it would be this hard, but it is what it is, I guess!

Happy Monday 😅

Open WebUI

Okay

I have been working on getting open webui setup in my environment.  I hope to get it done today.  I have done the reading now I am ready to roll it out.  I have been envisioning several scenarios for using it in my daily workflow.  I got this!!!!!! LOL

More on Monday!

Happy Friday  😄

Growing Pains

Well, I have learned a lesson using FreshRSS.  Do not use the "Marked as read" feature until you have read all the articles/YouTube videos in your feed.  You would think it would be possible to just make individual ones as you are going through that feed list.  I don't know, it may be a me problem, but I will be more carefully in the future.  Other than that. it is working great for me.  it is nice to be able to reference recent YouTube videos in one place verses using the browser history which sometimes is a hit and miss!

Not making much headway on resolving my Wallabag issues.  Right now I am just making sure I am backing up my articles just in case I have to blow the whole thing and start over again.  I am somewhat sure I can fix it from the server but not 100% sure.  I will keep working on it!

Happ Friday 😄🤔

Wallabag ?

Wallabag may turn out to be a bust!  Once you get into the interface, it works as advertised,d but it is turning out to be very buggy!  I had to reboot my laptop and thought I could just simply click on the shortcut for wallabag and it would load no problem.  That was far from the truth!!!!  I had to do all kind of url gymnastics to get it to load and when I tried to configure the android app on my phone, the app keeps trying to go to port 80 instead of 8000 even though I have it correctly typed into the url field, weird.  It could be the way I installed it since I did use the proxmox script to set it up in proxmox, not sure!  I will keep at it for now, but I am very disappointed.

Thumbs down so far!

Happy Thursday 😞

Paperless-NGX and Wallabag

Okay

I have been playing around with paperless-ngx and wallabag for the last couple of days and of the 2 I am definitely digging wallabag more.  Paperless-NGX kind of does most of what I need a note taking app to do but it is not Joplin.  I have been having issues with getting pdf's imported into paperless-ngx and you can't really create notes in the app which is kind of strange for a note taking app.  I am also having an issue with finding where the note/pdfs I am importing into it are being stored.  I will keep it as a backup for most of my notes and pdfs files, but it will not be my daily driver for taking and updating notes. 

Now Wallabag is kind of a useful app.  One of the things I am not able to do in Joplin due to me not using Chrome as a web browser is web clip websites and store them locally.  Joplin has these feature, but it does not support Microsoft edge which I use as my web browser.  So, I will use wallabag for the web clipping part and Joplin for everything else.  Also backing up both paperless-ngx and wallabag is as simple as backing up the lxc in proxmox.  I know I am lazy, lol!  i will get the backup of just the data for them at a later date.  Pick your battles!

Happy Tuesday ☺️

Hallelujah!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!

Okay

I have found my replacement for all the note-taking apps I use so far.  I honestly did not think Joplin would come out on top but low and behold it is the lead contender to date.  I am able to do business cards, picture, pdfs and notes as well as encrypt them in the app.  I have to admit I did not think I was going to find something that would replace OneNote with all it features, but Joplin seems to be the one so far!  I am able to run it locally(on-prem) and it is able to sync the bigger pdf files I need stored.

Happy Happy Friday 😇

Joplin

Well I have spent the last couple of days getting Joplin setup on my server.  It was quite the project.  i was able to get 90% of my Evernote files exported to it.  These has been an enlightening couple of days.

I will be referring back to this later, lol!

Happy Thursday 😌

Librespeed-rust

Well, I loaded librespeed-rust on the proxmox server the other day, and it is interesting to say the least.  Pretty good at testing the speed of the connection between endpoints in my environment, but I need to test on external connections.  I will explore that at a later date.  For now, it is pretty cool!  Nice to have when needed.

Happy Monday 😏

Uptime Kuma

Okay so today I will talk about uptime kuma.  I installed it on my proxmox server the other day and it works okay, I guess seeing whether a server is up or not is useful information.  Still trying to see what I can do with it overall.  I think I should be able to monitor docker instances as well as monitor services I have running on the mini server like jellyfin, plex and mssql.  I have never had to go in and restarted one of those services but it would be nice to know if it is necessary.

Funny, I use to think using the install scripts for proxmox was kind of cheating but even getting the server up and running doesn't mean you have the server up and running the way you want.  Getting it configured is a bear of a process but kind of fun in a warped way, lol!

Happy Friday 😁

I am back!! LOL

It has been a while, but a lot has transpired in my life.  Just watch a BHIS video and the guy doing the presenting talked a lot about having a blog and a GitHub account for posting your projects/achievements.  I think for the next couple of days I will post on the stuff i have accomplished in the last couple of weeks.  I have done a lot and still have a lot yet to do!

This is a current project, but I am finding practical applications for my daily routine.

FreshRSS

I loaded FreshRSS on my Proxmox server a couple of days ago.  I have been learning to work with getting feeds setup on it by using a template from Tom Lawrence that he made available online.  I have since been able to create my own feeds using a browser plugin for both YouTube and other news-based websites.  I love how it works with the Edge browser.  I have been able to add a lot of feeds into it today.  I think I like it so far!

Now what to post tomorrow!

Happy Thursday ☺️