ML icon indicating copy to clipboard operation
ML copied to clipboard

How to use TF-IDF when it is not categorical?

Open sr13579 opened this issue 1 year ago • 1 comments

Maybe I am asking a very 'noob' question. If the tfidf doesn't work with categorical data then how can I use it on a document? Example tutorials are to find. Anyone here to help?

sr13579 avatar Apr 01 '24 23:04 sr13579

Hey @sr13579, TF-IDF works on token frequency vectors. You can transform blobs of text into token frequency vectors using either Word Count Vectorizer or Token Hashing Vectorizer.

andrewdalpino avatar Apr 15 '24 00:04 andrewdalpino