AI & Machine Learning
Structured Outputs Are Not an Evaluation Strategy
Constrained decoding guarantees your model returns valid JSON. It guarantees nothing about whether the values inside it are right - and the two get confused constantly.
Topic
Models, inference, evaluation and the engineering around them.