Modify process_local_sources to support mount paths
Summary
Modify process_local_sources to support mount paths
Type of Change (Mandatory)
- Feature enhancement
Description (Mandatory)
Use common base_dir for all local data sources, and source_paths relative to that base.
The reason is to simplify path management in containerized environments, such as Docker. By using a common base_dir, we can ensure that paths remain consistent when mounting volumes, as only the base_dir needs to be adjusted to point to the mount path inside the container. This way, we only need to adjust the base_dir to point to the mount path.
- Cosmetic changes in histology_s3 dataloader.
- Change types names: "local" to "fs" and "azure_blob" to "ab"
Testing
Run full experiment in OpenFL and in OpenFL-Security.
Hi @Efrat1, after addressing @MasterSkepticista's comments, I'd request that you additionally test those changes by running a containerized OpenFL federation locally.