Let Me Speak Freely? A Study on the Impact of Format Restrictions on Performance of Large Language Models

https://arxiv.org/abs/2408.02442

Requiring structured output such as JSON or XML significantly weakens reasoning compared with free-form responses; stricter formats cause larger drops.

Grammar-constrained decoding for valid game actions