dislib icon indicating copy to clipboard operation
dislib copied to clipboard

Performance test for LinearRegression in mn4 fails

Open salvisolamartinell opened this issue 5 years ago • 0 comments

Describe the bug The performance test for LinearRegression in mn4 is failing. That is using the kdd99 dataset (/gpfs/projects/bsc19/COMPSs_DATASETS/dislib/kdd99/train.csv). The task _compute_model_parameters fails with a Singular Matrix error. I don't know if this test ever worked. This is the stacktrace:

2020-10-08 13:29:45,783 ERROR pycompss.worker.piper.piper_worker worker - Traceback (most recent call last):
  File "/apps/COMPSs/2.7/Bindings/python/3/pycompss/worker/commons/worker.py", line 268, in task_execution
    **compss_kwargs)
  File "/apps/COMPSs/2.7/Bindings/python/3/pycompss/api/task.py", line 267, in task_decorator
    return self.worker_call(*args, **kwargs)
  File "/apps/COMPSs/2.7/Bindings/python/3/pycompss/api/task.py", line 1492, in worker_call
    kwargs['compss_tracing'])
  File "/apps/COMPSs/2.7/Bindings/python/3/pycompss/api/task.py", line 1843, in execute_user_code
    user_returns = self.user_function(*user_args, **user_kwargs)
  File "/home/bsc19/bsc19029/git/dislib_no_outs/dislib/regression/linear/base.py", line 191, in _compute_model_parameters
    params = np.linalg.solve(ztz, zty)
  File "<__array_function__ internals>", line 6, in solve
  File "/apps/PYTHON/3.6.4_ML/lib/python3.6/site-packages/numpy/linalg/linalg.py", line 399, in solve
    r = gufunc(a, b, signature=signature, extobj=extobj)
  File "/apps/PYTHON/3.6.4_ML/lib/python3.6/site-packages/numpy/linalg/linalg.py", line 97, in _raise_linalgerror_singular
    raise LinAlgError("Singular matrix")
numpy.linalg.LinAlgError: Singular matrix

To Reproduce In MN4 run the performance test /gpfs/projects/bsc19/PERFORMANCE/dislib/tests/lr.py with COMPSs. I had to install the cvxpy dependency locally before.

Environment:

  • SC: Mn4
  • COMPSs version: 2.7
  • Dislib version: master
  • Java / Python versions: java 8 / python 3.6.4_ML

salvisolamartinell avatar Oct 08 '20 14:10 salvisolamartinell