tenset
tenset copied to clipboard
Assembly-level Feature Extraction
Known records that results in OOM/Segfault on e5-2673
:
'([6e24397e6a0f017cdf546cb2ec2116a5,4,8,8,512,1,1,512,2048,1,1,1,2048,4,8,8,2048,4,8,8,2048],llvm).json' '([96a9c78ecf376dfe9479c94de3b5e43a,2,8,8,2048,2,8,8,2048],llvm).json'
'([8c674f26f66543069d1e1c56cda249f9,8,15,15,1024,1,1,1024,2048,1,1,1,2048,8,8,8,2048],llvm).json' '([96a9c78ecf376dfe9479c94de3b5e43a,4,8,8,2048,4,8,8,2048],llvm).json'
'([96a9c78ecf376dfe9479c94de3b5e43a,1,8,8,2048,1,8,8,2048],llvm).json' '([c985575127b3ad80868c19dff585d60b,1,100,36864,100,1,36864],llvm).json'
'([6e24397e6a0f017cdf546cb2ec2116a5,8,7,7,512,1,1,512,2048,1,1,1,2048,8,7,7,2048,8,7,7,2048],llvm).json'
Time taken roughly on a 64-core machine: 100 hours
Full-scale results on e5:
Model: xgb RMSE: 0.0775 R^2: 0.7641 pairwise comparision accuracy: 0.8556 mape: 10064628454.7681 average peak score@1: 0.8368 average peak score@5: 0.9098
Model: lgbm RMSE: 0.0727 R^2: 0.7928 pairwise comparision accuracy: 0.8665 mape: 10188322169.1727 average peak score@1: 0.8467 average peak score@5: 0.9203
e2e results:
XGB:
Estimated total latency: 17.791 ms Trials: 102 Used time : 18696 s Next ID: -1 Mean inference time (std dev): 15.84 ms (0.01 ms)
LightGBM:
Estimated total latency: 16.897 ms Trials: 102 Used time : 35345 s Next ID: -1 Mean inference time (std dev): 14.88 ms (0.02 ms)
this PR is ready for review & merge.
This PR is ready for review.