systemds
systemds copied to clipboard
[FUTURE][SYSTEMML-1572] Enable native BLAS on remote executors
@mboehm7 can you please review this PR ?
@bertholdreinwald
I'll try to have a look next week. In the meantime, you might want to revisit the integration approach - the large number of files you had to modify is already an indicator that this is probably not a good approach.
It should be fairly simply: create a single static call which dispatches between matrix block (which should not call libnative at all) and libnative, initialize once, and call it for each matrix multiplication that potentially calls native BLAS - for example for compressed matrix blocks this is never required.
@mboehm7 This approach allows the matrix multiplication on remote executor to respect the configuration flag native.blas
. Since the configuration is not sent to the executor, not sure how single static call will enable that. But, we can discuss this next week after you have had chance to look at it :)
Refer to this link for build results (access rights to CI server needed): https://sparktc.ibmcloud.com/jenkins/job/SystemML-PullRequestBuilder/1435/
Not working as despite <native.blas>true</native.blas> in SystemML-config.xml, another env var disables it.
17/05/03 09:07:33 WARN utils.NativeHelper: Using internal Java BLAS as native BLAS support is disabled by the environment variable 'SYSTEMML_BLAS='.
Refer to this link for build results (access rights to CI server needed): https://sparktc.ibmcloud.com/jenkins/job/SystemML-PullRequestBuilder/1438/