rlmolecule icon indicating copy to clipboard operation
rlmolecule copied to clipboard

Redis / PostgresQL reward caching; performance comparison

Open pstjohn opened this issue 5 years ago • 0 comments

Would be great to get a quantitative estimation of the performance for redis / postgresQL, perhaps some wrapper functions that make caching easier using either backend.

I've noticed that sometimes the reward calculation takes a while -- with many simultaneous games, we sometimes see the entry not present in the reward buffer, but it gets added by a different node by the time its complete. so this can throw errors

Other things we could cache depending on performance:

  • node values and prior logits (these would have to get cleared every time the model weights are updated)

pstjohn avatar Sep 25 '20 19:09 pstjohn