magnesit

@magnesit.bsky.social

llm go brrrr

Hmm. Reading the numbers, Grok 4.5 seems to be an absurdly good model. And relatively cheap. The high price you pay isn't in dollars, though... Credit where credit is due

Listening to Ribs by Lorde when a cool breath of air streams through your window while laying on the bed in the heat is corny but peak as fuck and you ain't gonna change my mind

How does this keep happening? Bluesky is a platform full of very loud anti-AI people, but still, it's the single platform that drowns in slop and and everybody keeps liking these images. Again, what do you want, man? How does this keep happening?

Post nicht verfügbar.

Something's odd about the launch of Mistral Medium 3.5, and it's not their fault. Artificial Analysis paid close to $1k to benchmark the model but still defaults to showing Mistral Small 4, a much worse model, on their front page. Medium 3.5 scores way better (Deepseek V3.2 level).

The new pricing of Medium 3.5 suggests Mistral is in need of money, probably because of failed training runs or low demand. They were able to provide Devstral 2 (123B dense) at a much lower cost than Medium 3.5 (128B dense), even though it should effectively be almost identically heavy on hardware.

Mistral dropped the bomb: a 128B DENSE Medium 3.5. They indeed seemed to take a Devstral-like architecture (same hidden size, attn heads/dims, among other things), maybe even literally a Devstral checkpoint, and added a vision encoder on top. But not just that: They added reasoning 1/5

Gemma 4 E2B reaches a whopping 620 tok/s prefill speed on the dated Tensor G4 GPU! This is truly impressive. Shows that simply interleaving sliding window attention with full attention is still a worthy technique. Wouldn't have guessed that, to be honest.

New open-weights, likely multimodal+dense Mistral Medium model (128B) inbound for tomorrow, hopes are high as always! It's still unclear whether the model has reasoning baked in, as you can't see that from the architecture alone, but if it has, it could become a real banger!

Deepseek V4 finally released today, if you haven't noticed yet. I've spent some time reading their technical report and benchmarks and my feelings are extremely mixed. I am full of thoughts, but I feel like it's too early to pinpoint most things for V4 yet.

I usually don't post these "hype"-ish posts, but I need to say it: Qwen 3.6 35B A3B is genuinely impressive. I'm able to run it quantized to Q4_K_M @ 50+ tok/s on my RTX 4070 Ti (12 GB VRAM) with FULL (!) 256k context length. It's smart and actually useful. Local models are evolving really quickly.

Reasoning LLMs are the biggest compromise in machine learning - converting all those rich, contextual embeddings into discrete token IDs and then feeding them back. Awful. I'm confident "they" will come up with something more efficient soon. Please.

I don't like the chains of thought of the newer open-weight LLMs on the market. They just don't try to be efficient anymore. I know, it's supposed to be more structured and stuff, but I think leaving all the distillation artifacts from bigger models like the one marked in the image is unacceptable.

Image depicting a chain-of-thought of Gemma 4 E2B generating "Thinking process: 1. **Analyze the request**: ..."

I came up with a tremendous, nearly undetectable method to cheat in exams; instead of trying to smuggle in an AI assistant akin to ChatGPT to help you out, simply *remember* (!) the weights of an open, frontier LLM like, say, GLM 5.1.

I welcome the two-week ceasefire the US and Iran agreed last night. It brings much-needed de-escalation. I thank Pakistan for its mediation. Now it is crucial that negotiations for an enduring solution to this conflict continue. We will continue coordinating with our partners to this end.