Support for structured generation

[johnjosephhorton]

It would be useful for some questions to support structured outputs.

https://platform.openai.com/docs/guides/structured-outputs

[iwr-redmond]

Structured outputs over remote inference aren't as useful as they first appear. From the reference:

JSON mode will not guarantee the output matches any specific schema, only that it is valid and parses without errors. You should use Structured Outputs to ensure it matches your schema, or if that is not possible, you should use a validation library and potentially retries to ensure that the output matches your desired schema.

Ollama has the same problem, asking the model "pretty please" instead of actually requiring that the provided schema is followed.

Local inference options can transcend this limitation by using token level generation supervision. However, these aren't presently supported in EDSL.