Awesome, glad you are enjoying. If you have any other thoughts or suggestions, feel free to hit me up; best! https://cloud.disroot.org/apps/forms/s/Lzai4d2A79iNsapnpbGbBGcH

Glad to hear it doesn’t come across as conflicting with something else. 💘

What would you use instead? It and podman are nicely interchangeable.

What else did you try and what was lacking?

I find your experiments inspired. Thank you! I’m learning about this myself on an rtx and excited to discuss on my little podcast.james.network one of these days. Been using paperless minus the AI functionality so far. About to start testing different AI services on an arm64 device with 16gb ram that claims some level of AI support; will see how that goes. Let me know if there are any other specific services/models you’d recommend or are curious about.

Which specific models did you try and how would you rank each is usability?

How do you like auto1111 as I’ve never head of it

afaik Ollama would fit that bill, but perhaps others can chime in. You could probably run it on your local computer with a small model based on CPU alone.

Not sure I know what that is. As in Hoarder?

Sounds like you and I are in a similar place of testing.

Would you please talk more about it. I forgot about Open-webui, but intending to start playing with. Honestly, what do you actually do with it?