vaex icon indicating copy to clipboard operation
vaex copied to clipboard

[BUG-REPORT] converting to DataFrame from an astropy Table will drop 2D columns

Open rileythai opened this issue 1 year ago • 0 comments

Description When converting from an astropy Table object, vaex will silently drop two-dimensional columns. Adding a UserWarning or successfully converting them would be a viable fix.

A min reproducible is provided below:

>>> from astropy.table import Table
>>> import vaex as vx
>>> import numpy as np
>>> data = {'foo': np.ones(100), 'bar': np.ones((100,2)), 'apple': np.zeros(100)}
>>> t = Table(data)
>>> t
<Table length=100>
  foo      bar      apple 
float64 float64[2] float64
------- ---------- -------
    1.0 1.0 .. 1.0     0.0
    1.0 1.0 .. 1.0     0.0
    ...        ...     ...
    1.0 1.0 .. 1.0     0.0
>>> vx.from_astropy_table(t)
#    foo    apple
0    1.0    0.0
1    1.0    0.0
...  ...    ...

The column bar is silently dropped.

Software information

  • Vaex versions:
{'vaex': '4.17.0',
 'vaex-core': '4.17.1',
 'vaex-viz': '0.5.4',
 'vaex-hdf5': '0.14.1',
 'vaex-server': '0.9.0',
 'vaex-astro': '0.9.3',
 'vaex-jupyter': '0.8.2',
 'vaex-ml': '0.18.3'}
  • Vaex was installed via: conda-forge
  • OS: Ubuntu 22.04.2 LTS

Additional information Please state any supplementary information or provide additional context for the problem (e.g. screenshots, data, etc..).

rileythai avatar Dec 16 '24 00:12 rileythai