tensorfx icon indicating copy to clipboard operation
tensorfx copied to clipboard

Implement a schema field of type tokens

Open nikhilk opened this issue 7 years ago • 0 comments

This is for representing tokenized set of values (eg. comma separated strings or numbers). The ideas is as part of data preparation, one can convert text into a set of tokens (after doing word breaking, stop-word removal, stemming etc.)

nikhilk avatar Mar 12 '17 21:03 nikhilk