rustfst icon indicating copy to clipboard operation
rustfst copied to clipboard

`Determinize` acts differently than OpenFST `Determinize`

Open thatchedroof opened this issue 9 months ago • 1 comments

On some inputs, determinize produces larger results than OpenFST's Determinize. I'm porting over an algorithm from hfst, and these large determinization steps seem to be the cause of significant slowdown.

Input FST

rustfst / OpenFST output

rustfst / OpenFST graphviz

thatchedroof avatar Feb 15 '25 05:02 thatchedroof

I had a similar issue when porting over an algorthm. I had assumed it was something with the algorithm iteslf, but after experimenting a bit, it seems that rust fst, might require some earlier minimization/detminzation before applying other algorthms. After doing this, I ended up with comparable performance.

jzw2 avatar Apr 29 '25 11:04 jzw2