Julius von Kohout
Julius von Kohout
@TobiasGoerke i am a bit confused. In your patch you partially removed a networkpolicy and partially the networkattachmentdefinition. In my two lasts commits i just removed the networkattachmentdefinition completly. Is...
@Fkawala do you want to help with AWS S3 or GCS?
@FKkawala @surajkota @zijianjoy @ca-scribner This is what i have discussed yesterday with the AWS distribution maintainainer (@surajkota ) The current implementation here is perfectly suited for MinIO and MinIO only....
``` import urllib3 import json, boto3, base64 from botocore.client import Config minio_url = "http://minio-service.kubeflow.svc.cluster.local:9000" minio_user = "namespace" minio_password = "..." s3 = boto3.session.Session().resource( service_name="s3", endpoint_url=minio_url, aws_access_key_id=minio_user, aws_secret_access_key=minio_password, config=Config(signature_version="s3v4"), ) my_bucket...
We also have to think about switching the prefixes to /artifacts, /namespace/artifacts and /shared only to make it easier for users and graphical s3 browsers, but that would mean that...
> I'm not entirely sure about v1 behavior, but in v2, we don't make any assumption on whether an artifact has content in its path. For instance, `Metrics` artifact has...
> I believe that @juliusvonkohout raised a very important issue here. In many scenarios users are legally required to cleanup old records and keeping the cachedb in sync is definitely...
@chensun as a follow up to the meeting i do not see a global setting here https://www.kubeflow.org/docs/components/pipelines/overview/caching/
> I personally would prefer to improve the caching configuration story--if the existing caching setting is not that obvious or easy to use, maybe we can add a global config....