maxtext icon indicating copy to clipboard operation
maxtext copied to clipboard

Inconsistent environment variable names

Open gabeweisz opened this issue 7 months ago • 0 comments

MaxText uses the environment variables JAX_COORDINATOR_IP, JAX_COORDINATOR_PORT, NNODES, and NODE_RANK for multi-system GPU training, but JAX_COORDINATOR_ADDRESS, a fixed port, JAX_PROCESS_COUNT, and a combination of several environment variables, and for multi-system CPU training. It would be great if both configurations used the same environment variables

gabeweisz avatar Jul 16 '24 15:07 gabeweisz