torch-quiver icon indicating copy to clipboard operation
torch-quiver copied to clipboard

CPU only sample will hang

Open LukeLIN-web opened this issue 2 years ago • 1 comments

When I use this setting,

    exp_id = 'fixed_depatch'
    request_mode = 'Fixed'
    sample_mode = 'CPU' # 'CPU', 'GPU', 'Auto'
    uva_gpu = 'GPU' # 'GPU', 'UVA'

I run python reddit_serving.py

output

LOG>>> P2P Access Initilization
LOG>>> 100% data cached
LOG>>> feature order is loaded
LOG >>> Memory Budge On 0 is 534 MB
LOG >>> Memory Budge On 1 is 534 MB
Data load finished
Enable P2P Access Between 0 <---> 1 
Elapsed time: 0.000009seconds
Elapsed time: 0.000008seconds
CPU Sampler 1 Start
CPU Sampler 0 Start

It cannot have any result_queue.get()

LukeLIN-web avatar Sep 11 '23 14:09 LukeLIN-web

I find in serving.py line 129 result_queue.put((res, time.perf_counter()-start)) will stuck.

LukeLIN-web avatar Sep 11 '23 19:09 LukeLIN-web