jax icon indicating copy to clipboard operation
jax copied to clipboard

_isolve tacitly checks for symmetric linear operator wrongly

Open Joshuaalbert opened this issue 1 year ago • 4 comments

Description

Instead of taking an explicit symmetric argument, which could be passed from user, or some auxillary information to determine the dtype of linear operator the RHS's dtype is used as a proxy for the dtype of the linear operator when check_symmetric=True. However, it is entirely possible that implicit up-casting is expected by user, such that linear operator is real, but RHS is complex, or that linear operator is symmetric but complex, in both cases matvec == vecmat for positive definite linear operators. This could be a problem for some users of jsp.solve_cg.

# real-valued positive-definite linear operators are symmetric
  def real_valued(x):
    return not issubclass(x.dtype.type, np.complexfloating)
  symmetric = all(map(real_valued, tree_leaves(b))) \
    if check_symmetric else False
  x = lax.custom_linear_solve(
      A, b, solve=isolve_solve, transpose_solve=isolve_solve,
      symmetric=symmetric)

System info (python version, jaxlib version, accelerator, etc.)

jax==0.4.31
jaxlib==0.4.31

Joshuaalbert avatar Sep 03 '24 16:09 Joshuaalbert

Thanks for the report! So the tricky thing here is that jax.scipy.sparse.linalg.cg implements the API of scipy.sparse.linalg.cg, which has no explicit symmetric flag. We could probably add an optional symmetric argument to JAX's version that lets the user override the default. What do you think?

jakevdp avatar Sep 03 '24 17:09 jakevdp

That sounds like a good solution.

Joshuaalbert avatar Sep 03 '24 17:09 Joshuaalbert

It this a change you're interested in contributing?

jakevdp avatar Sep 03 '24 18:09 jakevdp

@jakevdp I submitted #23486

Joshuaalbert avatar Sep 08 '24 17:09 Joshuaalbert