asv
asv copied to clipboard
Warn if benchmark version looks wrong
Should we add a warning if the version of a benchmark that asv determines looks wrong?
In my case, my benchmarks contained from sage.all import *
which pulls in a version()
. Therefore, all graphs generated by asv only contain the latest commit; instead of the source code's hash, asv uses the mostly random <function version at 0x7faeb5da7668>
to identify the benchmark.
It took me quite a while to figure this out. Maybe we could include the version in some logging that shows with enough --verbose
flags?
On a second thought. Why would one ever want to pull the version from the module attributes?
cc @videlec, this is the issue at https://gitlab.com/jo314schmitt/admcycles.