phpshell icon indicating copy to clipboard operation
phpshell copied to clipboard

decrease database size by removing vld (helpers) output

Open SjonHortensius opened this issue 2 years ago • 1 comments

While this output is useful, it is not needed in the db for all scripts, for eternity. We do currently have a dependency on it for generating functionCalls. The impact should be pretty significant, the output could decrease by roughly 60%:

select sum(length(raw)) from output; # 26 GiB
select sum(length(raw)) from output where id in(select output from result where version=(select id from version where name='vld')); # 16 GiB

Options:

  • remove entirely
  • (simple) replace with $output = trigger('vld'); delete(); return $output
  • replace with real-time call (requires daemon to communicate output via additional table / call)

Implementing one of the two alternatives would allow for introducing additional helpers a lot easier, as we won't need to batch all inputs before showing the output online

SjonHortensius avatar Feb 14 '23 10:02 SjonHortensius