bert_score Cache embeddings

Cache embeddings

Open djaym7 opened this issue 1 year ago • 2 comments

I'm trying to use bertscore to retrive top N similar docs, is there a a way to cache the embeddings for N docs ?

Dec 28 '23 23:12 djaym7

@Tiiiger

Dec 28 '23 23:12 djaym7

I'm using this temp solution for now : https://github.com/djaym7/bert_score_with_cache/tree/master

avg times for 7 runs: 13s without cache and 7s with using cache

Dec 29 '23 01:12 djaym7