The unexpected implications of constrained JSON decoding
Constrained JSON decoding works by filtering logits, not by teaching the model. This has consequences for performance, correctness, and schema design that are easy to miss.
constrained decoding