natural icon indicating copy to clipboard operation
natural copied to clipboard

tf-idf, adding phrases

Open catchnthrow opened this issue 8 years ago • 2 comments

Hi, I am trying to add a two word phrase that we can search for. Eg. "meet me" tf-idf should return weight(positive) for this only when both the terms are search.

So, if user searches for 'meet' value should be 0 if user searchers for 'me', value should be 0 if user searches for 'meet me', value should be > 0

catchnthrow avatar Jan 09 '17 08:01 catchnthrow

Please elaborate a bit more on what you want to achieve. tfidf is a weighting algorithm, it gives insight in how (un)important words are in documents. It is not a search algorithm.

Hugo

Hugo-ter-Doest avatar May 12 '18 07:05 Hugo-ter-Doest

@prashant19sep you should perhaps use underscores to unit ngrams that are part of the same phrase so meet_me becomes its own entity.

lazharichir avatar Nov 20 '18 22:11 lazharichir