python-stratify
python-stratify copied to clipboard
Stratify option to use float32
Model precision means that model data often only needs to be of type float32 or int32 data. However, vertical stratify is currently converting data to float64 for its calculations. This is unnecessary for some usecases and too slow for some operational use cases.
AC:
- Update stratify to accept and maintain data as float32.
See benfitzpatrick for more details.
@abooton Thanks 👍
I tried converting to cython: floating (https://github.com/SciTools-incubator/python-stratify/compare/master...benfitzpatrick:float_32_preservation) but it didn't/doesn't work with the inheritance structure (fused type support + inheritance problem).
@SciTools/peloton reviewing this : leaving it open, but it won't happen for quite a while. @benfitzpatrick is this still of interest ?
Still of interest, I reckon, but @s-boardman and @PaulAbernethy now better points of contact!
In general I think the Scientific Python community needs to make much more use of float32 wherever possible - faster, less memory, don't need the bits
In order to maintain a backlog of relevant issues, we automatically label them as stale after 500 days of inactivity.
If this issue is still important to you, then please comment on this issue and the stale label will be removed.
Otherwise this issue will be automatically closed in 28 days time.
This stale issue has been automatically closed due to a lack of community activity.
If you still care about this issue, then please either:
- Re-open this issue, if you have sufficient permissions, or
- Add a comment pinging
@SciTools/stratify-maintainers
who will re-open on your behalf.