Last piece to describe – how to combine large language models with web content. Similar to using local documents for Retrieval Augmented Generation (RAG), it is also possible to use content coming from a search on the web. If you have ever used perplexity.ai, you have seen this already. Personally, I love Perplexity. To a…
As written in this post I preordered a Framework Desktop. I’m about to cancel this, and here is why. For the past few months, I’ve been deeply involved in experimenting with Large Language Models (LLMs), both running them locally and exploring different hardware options. I was extremely excited about the Framework Desktop. The promise of…
In this part, I will explain why and how I made Open WebUI available publicly on the internet. First things, first. Why? Because it is possible and it allows me to use the services while being not at home (e.g connecting it to Obsidian or VSCode). I would also consider this as quite safe, as…
Recently I came to know about a new processor from AMD, called AMD Ryzen Ryzen AI Max+ 395. I saw the first post of this, as I’m following the subreddit r/LocalLLaMA about local large language models. This Reddit post discusses an AMD Ryzen AI Max+ 395 chip being 2.2 times faster than an NVIDIA 4090…
Image generation using large language models like Midjourney, Dall-E, and Adobe Firefly has become immensely popular. This can also be achieved with certain software running on a local system. There are two options for this: Automatic1111 Stable Diffusion Web UI and ComfyUI. Both are user interfaces designed to leverage various available image generation models. For…
In the first part we looked at Ollama. Now let’s dig a bit deeper into Open WebUI which is the piece that glues everything together. Open WebUI is an open-source, self-hosted interface designed to facilitate interaction with various Large Language Models (LLMs). It provides users the ability to run LLMs locally on their own servers…
Starting with this I will describe my home AI setup. It consists of several pieces: As a sneak peak, have a look at the below video snippet. It shows prompting (“generate a prompt for … “) in Open WebUI and image generation based on the given response. Let’s start to dig into the various components…
