model_server
model_server copied to clipboard
[wip] [redhat] RUN_TESTS=1 Install python3.12 before exporting unit test models
It fixes issue with openvino-tokenizer support missing for python 3.9 and below, however export_models.py still fails with:
Traceback (most recent call last):
File "/usr/local/bin/optimum-cli", line 8, in <module>
sys.exit(main())
^^^^^^
File "/usr/local/lib/python3.12/site-packages/optimum/commands/optimum_cli.py", line 219, in main
service.run()
File "/usr/local/lib/python3.12/site-packages/optimum/commands/export/openvino.py", line 345, in run
from ...exporters.openvino.__main__ import infer_task, main_export, maybe_convert_tokenizers
File "/usr/local/lib/python3.12/site-packages/optimum/exporters/openvino/__init__.py", line 17, in <module>
from .__main__ import main_export
File "/usr/local/lib/python3.12/site-packages/optimum/exporters/openvino/__main__.py", line 28, in <module>
from openvino import Core, Type, save_model
File "/opt/intel/openvino/python/openvino/__init__.py", line 21, in <module>
from openvino._pyopenvino import AxisSet
ImportError: cannot import name 'AxisSet' from 'openvino._pyopenvino' (unknown location)
Traceback (most recent call last):
File "/ovms/demos/common/export_models/export_model.py", line 640, in <module>
export_text_generation_model(args['model_repository_path'], args['source_model'], args['model_name'], args['precision'], template_parameters, args['config_file_path'])
File "/ovms/demos/common/export_models/export_model.py", line 409, in export_text_generation_model
raise ValueError("Failed to export llm model", source_model)
ValueError: ('Failed to export llm model', 'facebook/opt-125m')
https://github.com/openvinotoolkit/model_server/issues/3844