[PRO-157] Improvements to Review results

[NicHaley]

The AI for the Reviews feature will sometimes return subpar results. For example:

• The AI might not catch some clear rule violations (eg. it does not find a spelling mistake)
• It returns a weird result. For example, it may say a sentence is missing a comma, when it isn't
• The results might not be consistent for the same block of text. This is despite having temperature set to 0, and the seed param set in the GPT request

In general, results seem to be worse when running against a lot of content in one request (eg. when running against an entire file).

Some ideas for how this can be improved:

• Chunk requests into even small chunks. Perhaps dividing by paragraph or line count.
  • Subdividing will use more tokens on the first request, but should result in fewer tokens across multiple requests due to caching
• Asking for a max limit on results
• Fine-tuning
• Prompt updates. For example, would a 'chain of thought'-style prompt yield better results?

_{From SyncLinear.com | PRO-157}