axlearn icon indicating copy to clipboard operation
axlearn copied to clipboard
verified publisher icon apple

Dataflow changes

Open jiya-zhang opened this issue 1 year ago • 2 comments

I changed a few things in this PR:

  1. Add Dockerfile entrypoint for Dataflow (this is needed for Dataflow worker to start up successfully)
  2. Mount gcloud config folder to docker container (so that container will have the credentials to access GCS, etc.)
  3. Format command to avoid long commands and strip trailing newlines

jiya-zhang avatar Mar 25 '24 21:03 jiya-zhang