openfl icon indicating copy to clipboard operation
openfl copied to clipboard

Modify process_local_sources to support mount paths

Open Efrat1 opened this issue 7 months ago • 1 comments

Summary

Modify process_local_sources to support mount paths

Type of Change (Mandatory)

  • Feature enhancement

Description (Mandatory)

Use common base_dir for all local data sources, and source_paths relative to that base. The reason is to simplify path management in containerized environments, such as Docker. By using a common base_dir, we can ensure that paths remain consistent when mounting volumes, as only the base_dir needs to be adjusted to point to the mount path inside the container. This way, we only need to adjust the base_dir to point to the mount path.

  • Cosmetic changes in histology_s3 dataloader.
  • Change types names: "local" to "fs" and "azure_blob" to "ab"

Testing

Run full experiment in OpenFL and in OpenFL-Security.

Efrat1 avatar May 19 '25 15:05 Efrat1

Hi @Efrat1, after addressing @MasterSkepticista's comments, I'd request that you additionally test those changes by running a containerized OpenFL federation locally.

teoparvanov avatar May 21 '25 07:05 teoparvanov