Sem comments

Results 232 comments of

Sem

Add ability to generate a parquet groupby dataset from h2o-data-rust/main.rs

Parquet is a problem because it is not an append-friendly format, and we will lose the ability of out of memory generation. We may add AVRO as an option, it...

Add ability to generate a parquet groupby dataset from h2o-data-rust/main.rs

> is writing the parquet file in multiple parts so that when the full directory is read In this case it may affect benchmarking very hard, because number of files...

[Feat][Spark] support of Spark 3.4.x and 3.5.x

@ShockleysxX Do you need any kind of help with this issue?

[POC]feat(format): Add format protocol definitions files with google protocol buffers

Based on my experience with Apache Spark itself, protobuf-way may be a painful story: - you need to incorporate it into CI; - the generated code is huge (for java...

[POC]feat(format): Add format protocol definitions files with google protocol buffers

@acezen Because it is a very huge change, should we discuss it first in a mailing list? Like voting. Because it is a really big change, pros and cons are...

[POC]feat(format): Add format protocol definitions files with google protocol buffers

May we add `buf` as a building system? It is under Apache 2.0 and actually we need only binaries. https://github.com/bufbuild/buf

[POC]feat(format): Add format protocol definitions files with google protocol buffers

@acezen May we merge it into a separate branch? I want to try to add `buf` and some additional scripts, especially for python part.

[Feat] Benchmarking with some common data format used in graph

I would also like to add something about neighborhood retrieval. For example, stats (min, max, etx.) for an ego-network.

[Apache][Infra] Committer: How to bind GitHub account to Apache account

![image](https://github.com/apache/incubator-graphar/assets/29755009/dc640cb8-4c8a-41a3-a523-7b5a941fc1c0)

[Feat][DevInfra] Add test coverage to CI to measure the covering code of unitest and add banner to README

@acezen It seems to me that we forgot to add PySpark to the coverage report