fluid icon indicating copy to clipboard operation
fluid copied to clipboard

[FEATURES]How cache workers are scheduled to computing nodes

Open donghucey opened this issue 3 years ago • 1 comments

When the computing node does not have a cache worker,Scheduling cache workers to computing nodes can speed up training。Do you have relevant information?

donghucey avatar Sep 20 '22 08:09 donghucey

@donghucey you can schedule data cache by specifying node affinity in Dataset.spec.

For example:

apiVersion: data.fluid.io/v1alpha1
kind: Dataset
metadata:
  name: demo
spec:
  mounts:
    - mountPoint: https://downloads.apache.org/hbase/stable/
      name: demo
  nodeAffinity:
    required:
      nodeSelectorTerms:
        - matchExpressions:
            - key: foolabel
              operator: In
              values:
                - "true"

Please refer to this doc for more information

TrafalgarZZZ avatar Sep 21 '22 03:09 TrafalgarZZZ