gps icon indicating copy to clipboard operation
gps copied to clipboard

Implement persistent caching in SourceMgr

Open sdboyer opened this issue 7 years ago • 2 comments

With additional testing being done as part of the new tool, it's increasingly clear that we really, really need to get persistent, disk-backed caching into place. There are four basic things we need to cache:

  1. Version lists - all the versions available for a source
  2. Manifest and Lock - for a given rev and a particular analyzer, these should be permanently cacheable
  3. PackageTree - for a given rev and gps version, these should be permanently cacheable
  4. Project root computations - those that require a go-get metadata query

The biggest immediate question is how to actually store it on disk. For the first three, at least, discrete files would probably work. However, I'm inclined to store everything together using bolt. That'll cover the last case more easily, especially because it is likely to require prefix queries; it'll also probably make it a bit cleaner to store TTLs.

(supercedes #8)

sdboyer avatar Dec 30 '16 11:12 sdboyer

With #196 finally done, the road to this is pretty clear. There's even a TODO exactly where a handle to it should be dropped in 😄

We do need to pick a storage lib for it. LevelDB would be fine, as would Bolt.

sdboyer avatar Apr 04 '17 14:04 sdboyer

This issue was moved to golang/dep#431

fabulous-gopher avatar Apr 21 '17 14:04 fabulous-gopher