meta
meta copied to clipboard
language model efficient top_k
(as referenced in #107)
See if we can store context -> (id, prob), (id, prob), ...
in the forward index format.
You'd need a map from context -> id though, which is probably too expensive. The postings format requires contiguous ids, too, so just saying id = hash(context)
isn't sufficient.