vscode-ai-toolkit icon indicating copy to clipboard operation
vscode-ai-toolkit copied to clipboard

FYI: data and responses for Bulk Run

Open Burhan-Q opened this issue 3 months ago • 1 comments

Overview

More of an FYI (maybe a feature suggestion). When doing a "Bulk Run" the data and responses won't be saved unless a "New Version" checkpoint is registered. When switching to another Agent, if no checkpoint is registered after completing the Bulk Run, when switching back, the data and responses will be missing. Sounds obvious, but there was no clear indication that this was the case and I double checked the docs, but didn't see it mentioned (could have missed it tho).

Feature Ideas

As a feature, it might be useful to provide a notification or notice that data and responses won't be saved when attempting to swap Agents. Even better might be to auto-save after any response is returned, that way if something were to happen, there would be at least something saved; probably have to check if config in the checkpoint and current config match. I know that the responses might not make sense to auto save since the current config and the last checkpoint might not be the same, but maybe auto saving manually input data would be worthwhile. Exporting the data to a file certainly would be a way to save one's work, but it would be painful if someone didn't know an input a lot of data without knowing to export before switching (luckily I only had three rows with two columns).

tldr;

  • it's possible to lose the responses or data from a Bulk Run without warning
  • register a checkpoint after Bulk Run returns all responses, saves both input data and responses
  • export input data for Bulk Runs to a file if not running right away
  • a notice about unsaved changes when switching Agents or an auto save feature might be nice

Burhan-Q avatar Sep 05 '25 22:09 Burhan-Q

Thank you for contacting us! Any issue or feedback from you is quite important to us. We will do our best to fully respond to your issue as soon as possible. Sometimes additional investigations may be needed, we will usually get back to you within 2 days by adding comments to this issue. Please stay tuned.