Agents can't see what wasn't measured
An agent optimizes the world it can observe. Whatever you didn't instrument doesn't exist for it, so the boundary of your metrics is the boundary of its judgment.
Blog / Tag
Posts tagged #goodhart.
An agent optimizes the world it can observe. Whatever you didn't instrument doesn't exist for it, so the boundary of your metrics is the boundary of its judgment.