Encountering RuntimeError in CUTEst Problem: INDEF

[hjmshi]

Dheevatsa, have you seen any errors of the following sort?

Traceback (most recent call last):
  File "lbfgs_tests.py", line 114, in <module>
    obj, grad, lr, backtracks, clos_evals, grad_evals, fail = optimizer.step(p, grad, options=options)
  File "../functions/LBFGS.py", line 720, in step
    self._add_update(t - t_prev, d)
  File "../functions/LBFGS.py", line 251, in _add_update
    p.data.add_(step_size, update[offset:offset + numel].view_as(p.data))
RuntimeError: Overflow when unpacking long

I observed this when testing the L-BFGS implementation on the CUTEst problems. I found this from a quick Google search: https://github.com/pytorch/pytorch/issues/6339, but my version of PyTorch is 0.4.1...do you know why this might occur?

[dmudiger]

Let me try at my end with my version of pytorch, what was the specific run command that you used - so that I can recreate the problem ?

[hjmshi]

Have you installed PyCUTEst? If so, then you should be able to run python lbfgs_tests.py --problemName 'INDEF'.

I'm currently looking at CUTEst problems with Jorge. It may take some time but it will make sure that our implementation is fool-proof.

[dmudiger]

Setting it up now, following this - https://gist.github.com/antonior92/9fd6ac9f44c164ee42555e3a7dc5a332 Anything i need to do differently ?

[hjmshi]

Check out this: https://jfowkes.github.io/pycutest/_build/html/index.html.

[dmudiger]

I was able to get CUTEst and pycutest both setup (on my mac), but still running into a segfault ?? pytorch) dheevatsa-mbp:examples dheevatsa$ python lbfgs_tests.py --problemName 'INDEF' Parameters available for problem INDEF: N = 10 (int) N = 50 (int) N = 100 (int) N = 1000 (int, original value) N = 5000 (int) [default] ALPHA = 0.5 (float, indefiniteness) [default] ALPHA = 1 (float) ALPHA = 10 (float) ALPHA = 100 (float) ALPHA = 1000 (float) End of parameters for problem INDEF {'objective': 'O', 'constraints': 'U', 'regular': True, 'degree': 2, 'origin': 'A', 'internal': False, 'n': None, 'm': 0} Segmentation fault: 11 (pytorch) dheevatsa-mbp:examples dheevatsa$

[dmudiger]

seems like this is also the macOS version problem, what did you do to get around it ?

[hjmshi]

I didn't, I wound up using Linux. Could you run it on a Linux machine?

Interesting though that you are encountering a similar issue...

[lwn66]

请问了解这个测试库的matlab接口吗？