data-science-examples
data-science-examples copied to clipboard
Use connection for BucketFS information in classification examples
Currently, the BucketFS connection information get embedded into the UDF code (classification.ipynb). A much cleaner method is, to provide this information via a connection. Either, by providing the BucketFS URL directly, or by providing a path to a configuration file in the BucketFS.
- In order to upload an object into BucketFS, the notebook creates and uses an UDF called EXABUCKET_HELPER.
- Then this UDF is called when an object is going to be uploaded. Instead of creating an UDF to upload an object into BucketFS, we can use bucketfs connection object and bucketfs_python libraries.
@umitbuyuksahin, which sample are we talking about in detail.