open-tamil
open-tamil copied to clipboard
Solthiruthi - queues based framework - document flow for palnilai/multipass thiruthi
Solthiruthi - queues - document flow
- Split words from document into entity/non-entity with line/col info attributes
- Each entity has 'is_error' Boolean attribute, and a 'reason' list of strings attribute.
- File read process puts this data into a queue.
- Each pass/nilai will read words, process them and put them back in output queue