bigflow icon indicating copy to clipboard operation
bigflow copied to clipboard

Published 20 hours ago • verified publisher icon baidu

Could bigflow support either SQL or a familiar DataFrame API to query structured data.

Open kelvict opened this issue 7 years ago • 3 comments

Could bigflow support either SQL or a familiar DataFrame API to query structured data.

kelvict avatar Dec 21 '17 12:12 kelvict

Bigflow will support this follow-up.

yshysh avatar Jan 03 '18 06:01 yshysh

We have a version of Bigflow on schema, but this version needs to improve, for example, only supportting input, process sql is on the way.

yshysh avatar Jan 03 '18 06:01 yshysh

We'd like to implement a Spark SQL familiar framework, but it's not a easy task.

We've implement a prototype, named Bigflow Schema, it's available inside Baidu. But it has a lot of problems if there are too many fields. So it's not recommended to use.

More time is needed to consider, design, and implement this.

acmol avatar Jan 03 '18 09:01 acmol