So, the second AI-containment-breach in a few days that goes public. How many have been kept quiet? I mean, do we really need the AI assistance in our demise? We can already wage wars with lots of human casualties on our own.
Wenzel 💚
@stairjoke.ninja
I’m a nerd turned coding designer. I practice UX and UI design for a living because I love great software! www.wenzelmassag.de Mastodon: @stairjoke@indieweb.social
Not to be over dramatic, but this changes everything. And it makes those AI GPU warehouses look old and clunky: Something like this might pop the #AI bubble one of these days soon-ish.
Local AI On Apple Silicon uses 7X Less RAM
Turbo Fieldfare runs a 26 billion parameter Gemma 4 model on a Mac in about 2GB of RAM, streaming most of the weights off the SSD, and it still gets 23 tokens per second on an M3 Max. We pull the design apart and show why it only works on Apple Silicon. 🔗 Relevant Links https://github.com/drumih/turbo-fieldfare ❤️ More about us Radically better observability stack: https://betterstack.com/ Written tutorials: https://betterstack.com/community/ Example projects: https://github.com/BetterStackHQ 📱 Socials Twitter: https://twitter.com/betterstackhq Instagram: https://www.instagram.com/betterstackhq/ TikTok: https://www.tiktok.com/@betterstack LinkedIn: https://www.linkedin.com/company/betterstack 📌 Chapters: 0:00 A 26B model in 2GB of RAM 0:54 Running it locally on an M3 Max 1:23 How Gemma's mixture of experts works 2:14 Two piles: 1.35GB resident, 12.9GB on SSD 2:57 What happens when you generate a token 3:30 The router problem: you can't prefetch 3:58 Why this only works on a Mac 4:40 A file format the GPU reads directly 5:06 Hiding the disk read behind the shared expert 5:27 The LFU expert cache 6:16 Wrap up
youtube.com
All I want right now is for the summer to be over. I've been uncomfortably hot almost non-stop for months…
Germany has a thing called #finAPI. It's a service where you give random strangers your online banking login credentials instead of your IBAN, so they can manage payments. It trains people to give their logins to strangers. Which utterly technologically challenged moron came up with that?
All I want for my birthday is for you to send me something that’s made you laugh.
Lake Lünersee and the top station of the gondola. In this picture, the station is dwarfed by the mountaintop of "Seekopf".
Wenzel Massag (@stairjoke@gram.social)
Lake Lünersee and the top station of the gondola. In this picture, the station is dwarfed by the mountaintop of “Seekopf”.
gram.social
Low waters at Lünersee (pumped reservoir).
Wenzel Massag (@stairjoke@gram.social)
Low waters at Lünersee (pumped reservoir).
gram.social
The steam ship "Hohentwiel" in front of the river delta of the Rhine at lake Constance. The ship was modernised to run on light heating oil in 1988 instead of coal and is the last paddle steamer on the lake.
Wenzel Massag (@stairjoke@gram.social)
The steam ship “Hohentwiel” in front of the river delta of the Rhine at lake Constance. The ship was modernised to run on light heating oil in 1988 instead of coal and is the last paddle steamer on the lake. Fun fact: It was docked from 1963 until 1984 in the marina at Bregenz, serving as the floating home for the local yachting club.
gram.social
No longer content with pillaging intellectual work and dismembering our environment (already critically weakened), AI companies are now hellbent on destroying books galore including rare editions. Shut down these nefarious enterprises already.
AI labs buy, scan, shred millions of rare books
If you have retreated to physical books because the internet is too full of AI slop, bad news — now they’re shredding the books to feed their AI slop machines.
news.com.au
Sometimes I wonder how difficult it might be to jailbreak an iPhone 5C and run linux on it…?
I am charging my car right now and because the only chargers within remaining range were Tesla Superchargers, I'm charging my VW at Tesla. I've got to admit the UX of Tesla is miles ahead of the UX of any other charger I have used in the past eight years. It's faster to sign in, the app is cleaner…
More than 2x the debt than previously reported, the US #AI industry is so far into debt, it should make countries blush.
Peter Lewis (@peterlewis.design)
cool cool cool! https://thenextweb.com/news/tech-giants-hidden-off-balance-sheet-debt-ai
bsky.app
Rumours have Apple work on a Mac with 1.5 TB of unified memory, they also have Apple rush to get the M7 Ultra fast tracked. That would basically mean many companies stop paying for AI and start running their own.
The orange man wants to blame his 2020 loss on China and distract from his illegal war against Iran. He's going to start WW3, maybe already has, and the damage to the US is incredible.
I've switched my RSS reader to show the oldest unread on top. I'll read my way to the present over the next months. Starting with the oldest unread from 2003-01-17, which was published before I owned my first iPod.
So the United States is now charging a toll in the Strait of Hormuz. Brazen.