getting blurt to use the CUDA whisper.cpp version in Fedora Silverblue

an immutable OS means never being able to install the CUDA toolkit directly In order to get the blurt gnome desktop integration to use the whisper.cpp CUDA model in Fedora Silverblue (or any immutable OS), you need to do a couple of things: main-cuda is the key Assuming you have whisper.cpp and blurt installed and…

Testing out LLMs with a Mandelbrot plot using numba and CUDA

I don't think LLMs understand CUDA I am exploring numba and CUDA. What better way to examine code than to ask an LLM to generate samples. It works for some code examples, but it is painfully obvious that at best LLMs are a copy/paste function (with lacuna) and at worst simply don't understand CUDA at…