OlegDB icon indicating copy to clipboard operation
OlegDB copied to clipboard

Optimization Megaticket

Open qpfiffer opened this issue 10 years ago • 2 comments

General dumping ground for things that need doing to make Oleg Do the Dew™ faster.

  • AOL is pretty damn slow right now. See ticket.
  • fsync/fflush distinction. I've had problems with fsync not actually writing data to disk, so we have to fsync and fflush. Sometimes many times.
  • Transactions must be written to disk and then read from disk to be commited. This fucking sucks. Redo the AOL file so that it is trivially mmap()-able. This way we can take full advantage of the kernel's caching layer.
  • ~~Re-examine stop-the-world rehashing. Might be a good oppotunity to use Google's JumpConsistentHash as a way to only re-index small parts of the table. This would mean removing Murmur3. I'm open for conversation on this one. #nodeps~~ Edit: Tried this, it was slower.

qpfiffer avatar Jan 19 '15 18:01 qpfiffer

bump

lykkin avatar Mar 31 '15 22:03 lykkin

  • [ ] have
  • [ ] you
  • [ ] heard
  • [ ] about
  • [ ] check
  • [ ] lists

You can use them like this:

  • [x] Privilege

dequis avatar Mar 31 '15 22:03 dequis