The PR has just landed from @mikepapadim.bsky.social : github.com/spring-proje...
Add jitLLM chat model support by mikepapadim · Pull Request #7054 · spring-projects/spring-ai
Adds a local chat model backed by jitLLM (io.github.beehive-lab:jitllm), the successor of GPULlama3.java. It runs GGUF models in-process on the CPU or, through TornadoVM, on a GPU (CUDA, OpenCL or ...
github.com