Wes McKinney

Results 203 comments of Wes McKinney

I believe we have one of the most complex package builds in the whole Python ecosystem. I think TensorFlow or PyTorch might have us beat, but it's close (it's obviously...

Just to drop some statistics to indicate the seriousness of this problem, our download numbers are growing to the same magnitude as NumPy and pandas ``` $ pypistats overall pyarrow...

In Ibis automatic lazy execution is configurable: https://github.com/ibis-project/ibis/blob/master/ibis/expr/types.py#L25 If you `__repr__` an expression object in a Jupyter notebook, for example, then it executes automatically (rather than having to type `expr.execute()`)....

This is one of the central questions of this whole project: does the API expose execution semantics or not? The pandas API in general exposes eager execution semantics. This is...

> It is not too difficult to intercept API calls under __getattribute__ and build a DAG (this is what Modin does). IMHO, just because you *can* do this does not...

> My point was the pandas API itself does not imply eager. I don't know about this. By the same logic, no library has eager evaluation so long as API...

> Can you clarify a question about your RPandas comment? Are you saying that the API we define shouldn't limit itself to a subset of the pandas API? If so,...

> I strongly prefer to have a definition in terms of algebra, similar to the relational model, which will allow defining semantics of the operations, thus defining the execution model...

> 1.) If it is just a programming interface for tables, is an ORM a dataframe? ORMs are composable interfaces for relational tables, so why isn't SQLAlchemy a dataframe by...

I added bylines to the list, so go right ahead