vaex
vaex copied to clipboard
[BUG-REPORT] converting to DataFrame from an astropy Table will drop 2D columns
Description
When converting from an astropy Table object, vaex will silently drop two-dimensional columns. Adding a UserWarning or successfully converting them would be a viable fix.
A min reproducible is provided below:
>>> from astropy.table import Table
>>> import vaex as vx
>>> import numpy as np
>>> data = {'foo': np.ones(100), 'bar': np.ones((100,2)), 'apple': np.zeros(100)}
>>> t = Table(data)
>>> t
<Table length=100>
foo bar apple
float64 float64[2] float64
------- ---------- -------
1.0 1.0 .. 1.0 0.0
1.0 1.0 .. 1.0 0.0
... ... ...
1.0 1.0 .. 1.0 0.0
>>> vx.from_astropy_table(t)
# foo apple
0 1.0 0.0
1 1.0 0.0
... ... ...
The column bar is silently dropped.
Software information
- Vaex versions:
{'vaex': '4.17.0',
'vaex-core': '4.17.1',
'vaex-viz': '0.5.4',
'vaex-hdf5': '0.14.1',
'vaex-server': '0.9.0',
'vaex-astro': '0.9.3',
'vaex-jupyter': '0.8.2',
'vaex-ml': '0.18.3'}
- Vaex was installed via: conda-forge
- OS: Ubuntu 22.04.2 LTS
Additional information Please state any supplementary information or provide additional context for the problem (e.g. screenshots, data, etc..).