sPyNNaker icon indicating copy to clipboard operation
sPyNNaker copied to clipboard

Recorder database

Open Christian-B opened this issue 4 years ago • 2 comments

Depends on https://github.com/SpiNNakerManchester/SpiNNFrontEndCommon/pull/774

Data is now cached in an SQL database in a user readable format.

Currently only used to cache data from previous segments or if specifically requested.

Medium term I could add methods to convert the data to Neo if anyone asks

Long term plans are to fill this database in the Java during data extraction.

The "Single" methods are designed for the long term where each core provides only 1 column (for example spike_counts)

Tested by https://github.com/SpiNNakerManchester/IntegrationTests/pull/37

Christian-B avatar Mar 24 '21 07:03 Christian-B

Some steps that could come after this (i.e. in other PRs) are:

  1. Add reader that makes the data end up in Neo format (as you suggested)
  2. Make the code actually use this database when reading results normally
  3. Create a "Neo IO" object that lets neo read from the database directly rather than converting to Neo
  4. Make Java write the database directly (again as you suggested)

rowleya avatar Mar 24 '21 08:03 rowleya

"Make the code actually use this database when reading results normally"

Yes this is the long term plan but only makes sense if done one a per core basis otherwise it is just add extra step with no benefit unless we also have the Neo IO

Christian-B avatar Mar 24 '21 08:03 Christian-B

Done in a different way now

Christian-B avatar Oct 03 '23 13:10 Christian-B