Angel Chen ▄ ▀

@ideosyncretic.com

Web dev, design, UI/UX • Currently indie-hacking promptbible.ai with @andric.dev • LLMs ∩ tools for thought • Previously built ops admin tools at startups

Much decision-making is tacit or qualitative. Making our OODA loops more legible is the first step towards observability & steerability. AI systems might help us codify this nebulous process. But how will it be trained to do this, and on what data? We don’t have good primitives or tooling for this.

Andric@andric.dev · 2y ago

I don’t really want to prompt an AI system. Instead I want it to passively watch what I do as I do things, talk to me to understand what I’m thinking as I do them, and progressively learn from me. Over time, it should understands tacitly what it’s like to make certain decisions, and then do them.

The article I most want to read right now is a detailed breakdown of prompt engineering project from somebody who hand-wrote their own simple automated evals and then used those to iterate on a prompt over time, measuring the impact each change had on their eval score and shipping an improved app