[Bug]: Attribute extraction fails with Flan-t5 Model.

[mkchaitanya03]

Describe the bug A clear and concise description of what the bug is. Attribute extraction example task fails when tried with "flan-t5-xxl" model using Refuel AI API.

Expected behavior A clear and concise description of what you expected to happen. The output guidelines are not followed. Only a few attributes are extracted and a json object is not returned. This leads to an error while deserializing the output. Guardrails can be setup to ensure the generations abide by the guidelines. Another option could be to extract each attribute explicitly through seperate llm calls.

[rajasbansal]

Thanks for bringing this up, looking into this