🚀 Gemma4 Java runner: • Single file, no deps • E2B→31B + MoE • GGUF + quant (F16→Q8) • Vector API ⚡ • CLI + thinking modes • GraalVM native + instant TTFT Pure Java 😏 by @mukel.bsky.social github.com/mukel/gemma4...
github.com
Strong with the JVM, Gemma 4 is 😌 jbang gemma4@mukel \ --model %{https://hf.co/unsloth/gemma-4-E2B-it-GGUF/resolve/main/gemma-4-E2B-it-Q8_0.gguf} \ --system-prompt "like Master Yoda, reply you must" \ --chat ~5GB once, download you must. Python or CUDA, you need not. Local AI, this is.
Over the Easter weekend, I got Gemma 4 running in pure Java. No Python. No JNI. No native code. Just the JVM. github.com/mukel/gemma4...
github.com
My @graalvm.org Native Image deep dive recording is already up: youtube.com/watch?v=1J6m... 🐰🚀 It includes the very public first demo of Project Crema, Open World for Native Image, at 2:19:54 😅 Thank you, @devoxx.com! All demos and notes are here: github.com/alina-yur/gr...
Deep Dive: GraalVM in Practice by Alina Yurenko
YouTube video by Devoxx
youtube.com
run an LLM with a supercharged engine powered by Java and GraalVM (ht @alina-yurenko.bsky.social ) www.youtube.com/shorts/7zSEa...
Run a supercharged LLM powered by Java and GraalVM #ai #programming #javaprogramming #java #graalvm
YouTube video by Coffee + Software
youtube.com
✅ @graalvm.org Native Image ✅ Llama3.java ✅ Vector API, FFM API ✅ Apple Silicon ❤️ — `git clone github.com/mukel/llama3... ` — `sdk install java 25.ea.17-graal` — `make native` (optionally preload a model for zero overhead) — Profit!🚀 #Java #GraalVM #LLM #LLama
I had lots of fun talking about my early days as a dev, how I caused double credit bookings all over Germany, stopped smoking to survive long GraalVM meetings and how to heat the room with Java inception. Already looking forward to part 2.
Adam Bien@adambien.blog · last yr."Pure Java Inception" 👉 an airhacks.fm podcast conversation with Christian Hummer is ready to listen: adambien.blog/roller/pure_... #java #podcast #airhacks
what's new in llama3.java and the upcoming @graalvm.org for JDK 24 🔥 Try it out here: github.com/mukel/llama3... @stephanjanssen.be @mukel.bsky.social #VDCERN #VoxxedDaysCERN
This will be a big deal 🪄🤩. Normally the debug experience of natively compiled languages get obfuscated due to compiler optimisations like inlining. Not here. All optimizations can be enabled to debug GraalVM native images and it looks just the same as without opts.
Fabio Niephaus@fniephaus.com · 2y agoWe just merged the current status of the upcoming JDWP support for @graalvm.org Native Image! 🥳 This will soon provide developers with the same debugging experience they are used to in Java, but for native images! Stay tuned for more details. github.com/oracle/graal...
We just merged the current status of the upcoming JDWP support for @graalvm.org Native Image! 🥳 This will soon provide developers with the same debugging experience they are used to in Java, but for native images! Stay tuned for more details. github.com/oracle/graal...
Excited to welcome @mukel.bsky.social as my co-speaker for the VoxxedDays #CERN talk on "The Era of AAP: Ai Augmented Programming using only Java" ☕️ 🚀 🔥 cern.voxxeddays.com/talk/the-era...
https://buff.ly/40KmT0t Graal compiler: +10% faster inference with the latest early access build. New features: batched prompt processing & AVX512 support.
GitHub - mukel/llama3.java: Practical Llama 3 inference in Java
Practical Llama 3 inference in Java. Contribute to mukel/llama3.java development by creating an account on GitHub.
buff.ly