djl icon indicating copy to clipboard operation
djl copied to clipboard

Published 20 hours ago • verified publisher icon deepjavalibrary

The 'processor. Encode' and 'processor. Decode' methods of 'SentencePiece' cannot be used, and the 'SpTokenizer' in DJL cannot use the 'getProcessor' method in other classes. Is there any way?

Open kkangert opened this issue 2 years ago • 1 comments

The 'processor. Encode' and 'processor. Decode' methods of 'SentencePiece' cannot be used, and the 'SpTokenizer' in DJL cannot use the 'getProcessor' method in other classes. Is there any way?

kkangert avatar Jun 27 '23 15:06 kkangert

Could you provide the demo code to reproduce the problem?

Also about "the 'SpTokenizer' in DJL cannot use the 'getProcessor' method in other classes, do you think it is due to the Access Modifiers is not public enough?

KexinFeng avatar Jul 02 '23 01:07 KexinFeng