Gryllos Prokopis
Gryllos Prokopis
the `chunk.meta_data.statistics` does it refer to the parent of the chunk? also the conversion to float is it generic first step of dealing with incoming null values?
> Maybe the int field is required, and you never have a situation where ... ah yea that's definitely happening; the parent is optional but nested fields are required in...
@martindurant the ``` if not self.schema.is_required(col): dtype[col] = np.dtype('f8') ``` seems to work
I will gladly take the time to do it; > whether the simple fix is appropriate or whether it's overly pessimistic. Seems a bit pessimistic indeed :/ Optional columns may...
yea I understand that; what I mean is that they way the check above is structure it's explicitly checking for count == 0. which is counter intuitive to me. don't...
uh sorry excuse my confusion (here is already very late :P ) this check indeed checks for not None and for not 0. if it is only checking for None...