clip-as-service icon indicating copy to clipboard operation
clip-as-service copied to clipboard

bert serving start can not start right

Open ares5221 opened this issue 5 years ago • 5 comments

Prerequisites

Please fill in by replacing [ ] with [x].

System information

Some of this information can be collected via this script.

  • OS Platform and Distribution (e.g., Linux Ubuntu 16.04): ununtu18.04
  • TensorFlow installed from (source or binary):binary
  • TensorFlow version:1.10
  • Python version:3.6
  • bert-as-service version:
  • GPU model and memory:
  • CPU model and memory:

Description

Please replace YOUR_SERVER_ARGS and YOUR_CLIENT_ARGS accordingly. You can also write your own description for reproducing the issue.

I'm using this command to start the server:

bert-serving-start YOUR_SERVER_ARGS

and calling the server via:

bc = BertClient(YOUR_CLIENT_ARGS)
bc.encode()

Then this issue shows up:

I:VENTILATOR:[__i:__i: 67]:freeze, optimize and export graph, could take a while... I:GRAPHOPT:[gra:opt: 53]:model config: /home/liujiefei/pythonworkspace/06bertserver/02bertapp/chinese_L-12_H-768_A-12/bert_config.json I:GRAPHOPT:[gra:opt: 56]:checkpoint: /home/liujiefei/pythonworkspace/06bertserver/02bertapp/chinese_L-12_H-768_A-12/bert_model.ckpt I:GRAPHOPT:[gra:opt: 60]:build graph... I:GRAPHOPT:[gra:opt:132]:load parameters from checkpoint... I:GRAPHOPT:[gra:opt:136]:optimize... I:GRAPHOPT:[gra:opt:144]:freeze... I:GRAPHOPT:[gra:opt:149]:write graph to a tmp file: /tmp/tmpuy7sitnv I:VENTILATOR:[__i:__i: 75]:optimized graph is stored at: /tmp/tmpuy7sitnv I:VENTILATOR:[__i:_ru:129]:bind all sockets I:VENTILATOR:[__i:_ru:133]:open 8 ventilator-worker sockets I:VENTILATOR:[__i:_ru:136]:start the sink I:SINK:[__i:_ru:306]:ready I:VENTILATOR:[__i:_ge:222]:get devices Exception in thread Thread-1: Traceback (most recent call last): File "/usr/lib/python3.6/threading.py", line 916, in _bootstrap_inner self.run() File "/home/liujiefei/.local/lib/python3.6/site-packages/bert_serving/server/init.py", line 115, in run self._run() File "/home/liujiefei/.local/lib/python3.6/site-packages/zmq/decorators.py", line 75, in wrapper return func(*args, **kwargs) File "/home/liujiefei/.local/lib/python3.6/site-packages/zmq/decorators.py", line 75, in wrapper return func(*args, **kwargs) File "/home/liujiefei/.local/lib/python3.6/site-packages/zmq/decorators.py", line 75, in wrapper return func(*args, **kwargs) File "/home/liujiefei/.local/lib/python3.6/site-packages/bert_serving/server/zmq_decor.py", line 27, in wrapper return func(*args, **kwargs) File "/home/liujiefei/.local/lib/python3.6/site-packages/bert_serving/server/init.py", line 143, in _run device_map = self._get_device_map() File "/home/liujiefei/.local/lib/python3.6/site-packages/bert_serving/server/init.py", line 228, in _get_device_map num_all_gpu = len(GPUtil.getGPUs()) File "/home/liujiefei/.local/lib/python3.6/site-packages/GPUtil/GPUtil.py", line 102, in getGPUs deviceIds = int(vals[i]) ValueError: invalid literal for int() with base 10: 'Failed to initialize NVML: Driver/library version mismatch' ...

ares5221 avatar Feb 13 '20 11:02 ares5221

same problem here

SlimenBouras avatar May 05 '20 17:05 SlimenBouras

I have the same problem,have you solved it?

Scarlett796 avatar Jan 09 '21 05:01 Scarlett796

I have the same problem,have you solved it?

18166035475 avatar Sep 04 '21 08:09 18166035475

same problem here

try latest version

ares5221 avatar Sep 07 '21 01:09 ares5221

I have the same problem,have you solved it?

try latest version

ares5221 avatar Sep 07 '21 01:09 ares5221