fluid
fluid copied to clipboard
[FEATURES]How cache workers are scheduled to computing nodes
When the computing node does not have a cache worker,Scheduling cache workers to computing nodes can speed up training。Do you have relevant information?
@donghucey you can schedule data cache by specifying node affinity in Dataset.spec.
For example:
apiVersion: data.fluid.io/v1alpha1
kind: Dataset
metadata:
name: demo
spec:
mounts:
- mountPoint: https://downloads.apache.org/hbase/stable/
name: demo
nodeAffinity:
required:
nodeSelectorTerms:
- matchExpressions:
- key: foolabel
operator: In
values:
- "true"
Please refer to this doc for more information