mtmonkey icon indicating copy to clipboard operation
mtmonkey copied to clipboard
verified publisher icon ufal

Piped processors

Open lefterav opened this issue 10 years ago • 2 comments

Modified MT-monkey that encapsulates perl pre- and post-processors.

lefterav avatar Jan 13 '15 18:01 lefterav

We've found out that the util.preprocessor Python module is missing from the commits. Could you please add it?

tuetschek avatar Jan 14 '15 14:01 tuetschek

This PR replaces the current Worker implementation, so it would break our systems running the current (master) version of Worker, where Moses has been trained with the Python preprocessing in mind. Note that the current version of Worker is thread-safe and faster than anything using Perl and pipes, so it's worth keeping.

This PR should be changed to an alternative (configurable in the config file) in order to be merged.

martinpopel avatar Aug 18 '15 08:08 martinpopel