Takeshi Yoshimura
parquet-benchmarks only contain read and write benchmarks with a single thread. I add concurrent Parquet file scans like typical data-parallel computing.
I prototyped the LSF scheduler for torchx. It supports native, Docker, and Singularity as runtime with a shared filesystem at this moment. I confirmed it worked with Gloo and NCCL...
### 1. Quick Debug Information * OS/Version(e.g. RHEL8.6, Ubuntu22.04): RHCOS4.13 * Kernel Version: 4.18.0-372.59.1.el8_6.x86_64 * Container Runtime Type/Version(e.g. Containerd, CRI-O, Docker): CRI-O * K8s Flavor/Version(e.g. K8s, OCP, Rancher, GKE, EKS):...