sentence-transformers icon indicating copy to clipboard operation
sentence-transformers copied to clipboard

clustring notebook doesn't work

Open ali-yz opened this issue 2 years ago • 1 comments

It seems that there is package version conflict between new sentence transformer and the model loaded there. I first solved the mismatch with installing emoji==1.7.0 but then faced this:

ValueError Traceback (most recent call last) in <cell line: 1>() ----> 1 from preprocessing import cleaning 2 from IPython import display 3 4 import numpy as np 5 import pandas as pd

3 frames /content/preprocessing.py in 5 6 normalizer = hazm.Normalizer() ----> 7 tagger = hazm.POSTagger(model='./resources/postagger.model') 8 9

/usr/local/lib/python3.10/dist-packages/hazm/pos_tagger.py in init(self, model, data_maker, universal_tag) 38 data_maker = self.data_maker if data_maker is None else data_maker 39 self.__is_universal = universal_tag ---> 40 super().init(model, data_maker) 41 42 def __universal_converter(self: "POSTagger", tagged_list):

/usr/local/lib/python3.10/dist-packages/hazm/sequence_tagger.py in init(self, model, data_maker) 65 def init(self: "SequenceTagger", model=None, data_maker=data_maker) -> None: 66 if model is not None: ---> 67 self.load_model(model) 68 else: 69 self.model = None

/usr/local/lib/python3.10/dist-packages/hazm/sequence_tagger.py in load_model(self, model) 111 """ 112 tagger = Tagger() --> 113 tagger.open(model) 114 self.model = tagger 115

pycrfsuite/_pycrfsuite.pyx in pycrfsuite._pycrfsuite.Tagger.open()

pycrfsuite/_pycrfsuite.pyx in pycrfsuite._pycrfsuite.Tagger._check_model()

pycrfsuite/_pycrfsuite.pyx in pycrfsuite._pycrfsuite.Tagger._check_model()

ValueError: Invalid model file './resources/postagger.model'

ali-yz avatar Mar 12 '24 16:03 ali-yz

I could fix it with replacing the pos_tagger.model with a newer version downloaded from hazm.

ali-yz avatar Mar 12 '24 16:03 ali-yz