Much decision-making is tacit or qualitative. Making our OODA loops more legible is the first step towards observability & steerability. AI systems might help us codify this nebulous process. But how will it be trained to do this, and on what data? We don’t have good primitives or tooling for this.
I don’t really want to prompt an AI system. Instead I want it to passively watch what I do as I do things, talk to me to understand what I’m thinking as I do them, and progressively learn from me. Over time, it should understands tacitly what it’s like to make certain decisions, and then do them.