Chen Liu

I totally agree that `generate_kmeans` and `generate_diffusion` are significantly slow, as they both involve repeated operations over a (H x W) x (H x W) matrix. Even with an image...

I have updated the code for kmeans and diffusion condensation. It shall be faster than before. However, they are not using GPU for acceleration, and they are not super fast...

Hi. By far, the known problem is that kmeans and diffusion requires some decent RAM (e.g., on slurm, I would need to set `--mem=20G` for it to successfully run). If...

Oh I might have said something confusing. `--mem=20G` is the setting for running a slurm job on a server. It means we need to request 20GB of RAM for that...

Unfortunately I don't really understand the root cause of the problem. So far the setting that works on my end is: - **Do NOT** use the `--rerun` flag. - Make...

If this still does not work, the following resources **might** be helpful. - You may try running `export MKL_THREADING_LAYER=GNU` before running the `generate_diffusion.py` or `generate_kmeans.py`. - Additional resources at https://github.com/joblib/threadpoolctl/blob/master/multiple_openmp.md

Thanks for trying these out. At this moment I am basically clueless. Sorry for not being able to be more helpful. I am still suspecting it's a RAM problem but...

I have updated the code for generating kmeans and diffusion condensation. I believe it may be good now?

I have not experienced overfitting in my use cases, and I haven't specifically designed ways to handle overfitting. However, if you encounter overfitting, you could try some standard techniques: 1....

@wwzz-max Congratulations! I saw your recent published paper https://link.springer.com/article/10.1007/s00371-024-03691-x. I am glad to help your research with this repository.