ntaherkhani

embedding is doing only one worker and it is so slow

2

Hi, I am using bert_as_service 10. I start my bert server as: _**args = get_args_parser().parse_args(['-model_dir', str(model_path), '-num_worker', str(num_workers), '-port', str(in_port), '-port_out', str(out_port) ]) server = BertServer(args) server.max_seq_len=512 server.client_batch_size=4096 server.num_client=1 server.num_worker=8...