systemds icon indicating copy to clipboard operation
systemds copied to clipboard

[FUTURE][SYSTEMML-1572] Enable native BLAS on remote executors

Open niketanpansare opened this issue 7 years ago • 5 comments

@mboehm7 can you please review this PR ?

@bertholdreinwald

niketanpansare avatar May 03 '17 03:05 niketanpansare

I'll try to have a look next week. In the meantime, you might want to revisit the integration approach - the large number of files you had to modify is already an indicator that this is probably not a good approach.

It should be fairly simply: create a single static call which dispatches between matrix block (which should not call libnative at all) and libnative, initialize once, and call it for each matrix multiplication that potentially calls native BLAS - for example for compressed matrix blocks this is never required.

mboehm7 avatar May 03 '17 04:05 mboehm7

@mboehm7 This approach allows the matrix multiplication on remote executor to respect the configuration flag native.blas. Since the configuration is not sent to the executor, not sure how single static call will enable that. But, we can discuss this next week after you have had chance to look at it :)

niketanpansare avatar May 03 '17 05:05 niketanpansare

Refer to this link for build results (access rights to CI server needed): https://sparktc.ibmcloud.com/jenkins/job/SystemML-PullRequestBuilder/1435/

akchinSTC avatar May 03 '17 06:05 akchinSTC

Not working as despite <native.blas>true</native.blas> in SystemML-config.xml, another env var disables it.

17/05/03 09:07:33 WARN utils.NativeHelper: Using internal Java BLAS as native BLAS support is disabled by the environment variable 'SYSTEMML_BLAS='.

bertholdreinwald avatar May 03 '17 16:05 bertholdreinwald

Refer to this link for build results (access rights to CI server needed): https://sparktc.ibmcloud.com/jenkins/job/SystemML-PullRequestBuilder/1438/

akchinSTC avatar May 04 '17 01:05 akchinSTC