insobot icon indicating copy to clipboard operation
insobot copied to clipboard

Tracking topics in mod_markov

Open baines opened this issue 8 years ago • 0 comments

Currently mod_markov generates text completely randomly; I think it could be interesting to take recent text into account, to say more relevant things.

The basic idea is to see which words are being said frequently, use something like wordnet to get similar words, then give a probability boost to those words when generating a sentence.

The per-word total stored in the word_ht hash table can be used to see how rare a word is (if we also store the total word count). This would allow very common words like "a", "the", etc to be excluded from being topic words.

baines avatar Apr 14 '17 20:04 baines