conquery icon indicating copy to clipboard operation
conquery copied to clipboard

Feature/rewrite caching

Open thoniTUB opened this issue 8 months ago • 0 comments

Instead of a wrapping CachedStore that will hold all objects in memory over time, this uses a configurable Cache, for resolved ids. Further changes:

  • Removed NsIdRef-annotation because it hinders caching with a cache loader because of recursive call to cache loader
    • All Ids have now a resolve method which returns the refernced object.
    • For this to work, Ids get an idResolver set, either by the IdDeserializer or by the IdentifiableImpl from which the Id is derived from. The Id can then "query" it self on a storage. An IdentifiableImpl on the other hand gets now the MetaStorage and DatasetRegistry (or NamespacedStorage) injected by a corresponding ObjectMapper.
    • For both exists Placeholders (e.g. PlaceholderMetaStorage) which simply fail resolving any Id and are injected into ObjectMapper that don't have acces to such a store like the ObjectMapper on a Shard.
    • Ids are not interned currently, because interning happend in a static class
  • More separation between test code and backend in IntegrationTests
    • Most test meta data (dataset, concepts, ...) are parsed independently of backend
    • Dataset and secondaryids are now uploaded instead of injected
    • Sql test also upload tables concepts, ... via http
  • The execution manager now sets the execution state to failed if starting the execution failed. Before tests waited in an endless loop for "RUNNING" executions

thoniTUB avatar May 29 '24 13:05 thoniTUB