Tag: Evaluation

Almost everyone who uses these tools daily has had the feeling that a model got worse. The labs deny it, precisely, and the denials are true. Both things can hold at once, and the documented record now shows exactly how.

Almost every organization has an impressive AI demo somewhere. Far fewer have an AI system doing real work every day. Most of the difficulty, and most of the value, sits in the distance between those two states.