OpenAI’s write-up of the incident reads more like a marketing document promoting a feature than an incident summary, while the quote from HuggingFace sounds more like someone accepting an award than someone who just got hacked. It’s a bit surreal.
Nathan Hamiel
@nhamiel.bsky.social
Senior Director of Research. Black Hat Review Board Member (AI, ML, and DS track lead) and International public speaker. I focus on emerging technologies and risks at the intersection of humanity and tech. Hype Critic. My writing: https://perilous.tech
I swear Teams is being developed by sadists trying to implement extra-clickmaxxing.
Nils and I will be at the AI Summit at Black Hat USA. This time, bringing half presentation and half hands-on labs focused on defending developer AI environments. See you in Vegas! blackhat.com/us-26/summit...
People are obsessed with data, even when that data doesn't lead to useful optimizations. They often don't consider how data can be detrimantal to the activity they are collecting it for. In this article, I look at how this even extends to people who read. perilous.tech/reading-data...
Reading Data and Optimizing The Wrong Things - Perilous Tech
People love to utter phrases like “data is the new oil” or “data is the new gold.” When we hear these phrases, we immediately think of businesses and big
perilous.tech
Reorganizing some books this weekend and not sure how I ended up with two copies of Simulacra and Simulation.
And not a moment too soon. Companies were being torn apart by the vulnpocalypse! 🙄 Overhyping these aspects has turned out to be a fantastic foot gun. The features they want to protect against are the most useful features of the model.
This article has an error. What appears as addiction is actually dependence. These students’ brains are rewired by cognitive offloading, not by a chatbot's addictive design. Adding the friction back seems painful, so they fall back to using AI. futurism.com/artificial-i...
College Students Consumed by "Resignation and Despair" as They're Relentlessly Pressured to Use AI
A professor asked his students to share their anonymous thoughts on AI, revealing a a complicated and bleak picture.
futurism.com
Rarely does a news story hit me so hard and go straight to my heart 😆
"A spokesman for KPMG International said the firm takes the accuracy and integrity of its published content seriously.” 🤣 Content and services continue to degrade around us every day. Are you feeling the AGI yet?
Well, that was a pretty quick change. We didn't even need to wait 12 to 18 months🤣
AI won't make you irreplaceable. It might even do the opposite. In this post, I dissect the two most common AI phrases and provide some perspective on why you might not want to wave goodbye to your skills and become one of the faceless. #AI #Skills #Workforce perilous.tech/poor-advice-...
Poor Advice From the Two Most Common AI Phrases - Perilous Tech
You’ve heard these two phrases uttered thousands of times. They creep into every conversation about AI and work, being mindlessly parroted as people nod in
perilous.tech
"To the slop architect, execution, skills, and experience are secondary, bowing at the pedestal of ideas. The fact is, most ideas are ill-thought-out, half-baked, or just plain fucking stupid." perilous.tech/the-architec...
This take from Ed Zitron needs some tweaking. LLMs impress the non-writers who want to write, the non-coders who want to code, the researchers who simply want to boost their publication count, and the lawyers who’d rather be drinking.
This may be a drop in the bucket for Google, bit it says a lot since it takes a lot for people switch. However, when a service continues to degrade with a slew of features nobody asked for, that's what happens. BTW, you still can't Google the word "disregard" in AI mode.
The flip side is that with the guardrails removed, the models become more useful. Much of the commentary about the dangers here is overly sensational. The way guardrails are added to models is more like wrapping paper than a true protection mechanism anyway.
This is a follow-up to my techno-communism post from last year. So many people talk about utopias or dystopias from the perspective of already being in them. What about the time leading up to them? This is what I call the dystopian lag. perilous.tech/the-ai-adjus...
The AI Adjustment Bureau and the Dystopian Lag - Perilous Tech
Whenever people discuss utopias or dystopias, they thrust us right into the middle of them, but you find fewer people who talk about the transition period
perilous.tech
Pull out irony gun, point directly at foot. He started his own investigation? Wasn't that what writing the book was? Seriously, he had one job! 🤦♂️ Incidents like these are a lot more damaging than people think.
Nope, the singularity isn't 4 years away, but the shitularity is certainly already here.
These predictions are always 12 to 18 months. That's because the timeframe is short enough to seem impactful, yet long enough for you to forget about the prediction after it doesn't happen.
Ah, yes, "innovation." Please capture what's on my screen, what I say, and what I point at all so I can... do what exactly? It's obvious what Google gets, but what do I get for all this surveillance? Other than, zomg! My Ctrl-c has AI!!!
Right on queue, the democratization of AI psychosis continues. Dawkins was hit by what I called local bias. He blew himself away with his experiment. perilous.tech/democratizin...
Imagine having to pay a token ransom to keep your solutions functional. This may become a reality in the very near future. AI cost volatility is a new risk that must be factored into the calculus of AI use and the development of AI-powered solutions. kudelskisecurity.com/modern-ciso-...
AI Cost Volatility: A New Risk for Security Leaders - Nathan Hamiel - Kudelski Security
Explore expert perspectives on cybersecurity, leadership, and emerging threats. The Modern CISO Blog delivers strategic insights for today’s security decision-makers.
kudelskisecurity.com
Agents don't just hallucinate or create errors. They do so with action. If your design isn't robust against these inevitable failure modes, you're gonna have a bad time.
Okay, who made these icons? 😆 When I called out that the icons shouldn't be used, I was asked why. Upon realizing I'd have to explain, I said, "Forget it. They look great."
This article examines the democratization of AI psychosis and the capture of smart people by AI hype. A fascinating yet terrifying trend. We need to recognize when our perceptions of reality are warped, and it’s not as easy as it sounds. perilous.tech/democratizin...
Democratizing AI Psychosis: Why Smart People Are Captured By AI Hype - Perilous Tech
For months now, I’ve been fascinated by seeing smart people completely captured by AI hype. The very people who should be pushing back against the hype are
perilous.tech
What's happening with all of these price hikes and capability reductions in AI products? Influencers and "visionaries" have been telling us to plan for the price of intelligence to be zero! Apparently, subsidizing tokens while hemorrhaging money isn't a great business strategy.