Slow retrieval from cache

[rajasbansal]

While labeling 25k examples, we see that the cache size grows to 500MB and the retrieval from cache takes 0.03s per example, which translated to around 10 minutes for 15k examples. This might be too slow and we should try to make the retrieval from the cache by reducing information stored in the cache or creating indices, or invalidating some entries