tenset icon indicating copy to clipboard operation
tenset copied to clipboard

Assembly-level Feature Extraction

Open liaopeiyuan opened this issue 3 years ago • 2 comments

Known records that results in OOM/Segfault on e5-2673:

'([6e24397e6a0f017cdf546cb2ec2116a5,4,8,8,512,1,1,512,2048,1,1,1,2048,4,8,8,2048,4,8,8,2048],llvm).json'  '([96a9c78ecf376dfe9479c94de3b5e43a,2,8,8,2048,2,8,8,2048],llvm).json'
'([8c674f26f66543069d1e1c56cda249f9,8,15,15,1024,1,1,1024,2048,1,1,1,2048,8,8,8,2048],llvm).json'         '([96a9c78ecf376dfe9479c94de3b5e43a,4,8,8,2048,4,8,8,2048],llvm).json'
'([96a9c78ecf376dfe9479c94de3b5e43a,1,8,8,2048,1,8,8,2048],llvm).json'                                    '([c985575127b3ad80868c19dff585d60b,1,100,36864,100,1,36864],llvm).json'
'([6e24397e6a0f017cdf546cb2ec2116a5,8,7,7,512,1,1,512,2048,1,1,1,2048,8,7,7,2048,8,7,7,2048],llvm).json'

Time taken roughly on a 64-core machine: 100 hours

Full-scale results on e5:

Model: xgb RMSE: 0.0775 R^2: 0.7641 pairwise comparision accuracy: 0.8556 mape: 10064628454.7681 average peak score@1: 0.8368 average peak score@5: 0.9098

Model: lgbm RMSE: 0.0727 R^2: 0.7928 pairwise comparision accuracy: 0.8665 mape: 10188322169.1727 average peak score@1: 0.8467 average peak score@5: 0.9203

e2e results:

XGB:

Estimated total latency: 17.791 ms Trials: 102 Used time : 18696 s Next ID: -1 Mean inference time (std dev): 15.84 ms (0.01 ms)

LightGBM:

Estimated total latency: 16.897 ms Trials: 102 Used time : 35345 s Next ID: -1 Mean inference time (std dev): 14.88 ms (0.02 ms)

liaopeiyuan avatar Jul 27 '21 17:07 liaopeiyuan

this PR is ready for review & merge.

liaopeiyuan avatar Aug 16 '21 23:08 liaopeiyuan

This PR is ready for review.

liaopeiyuan avatar Aug 24 '21 22:08 liaopeiyuan