orbax
orbax copied to clipboard
Orbax provides common utility libraries for JAX users.
Internal
Internal
Create an interface for retrieving the current step number. An implementation of this interface, when called for a training workload, will return the current step number, or 0 if training...
Internal change.
Hi, currently I'm trying to benchmark various storages for checkpoint reads/writes using orbax in a large-scale setup. To do so without allocating thousands of GPUs, I'm using XLA flag 'xla_force_host_platform_device_count=8'...
Hi, i'm using s3fs which has very similar restrictions as GCS (no atomic moves, for example). To enable GCS-style checkpointing I'm patching orbax which seems very ugly ``` def patch_with_gcs_style_checkpointing_for_path_prefix(prefix):...
ModuleNotFoundError Traceback (most recent call last) in () ----> 1 import t5x 2 from t5x import partitioning 3 from t5x import train_state as train_state_lib 4 from t5x import utils 5...
file access hardening on model exporter.
Would it possible for you to resume tagging releases to keep up with `orbax-checkpoint` and `orbax-export` on pypi? Something like `checkpoint-vX.X.X` and `export-vX.X.X` would be helpful.
Changes default timeout in AsyncCheckpointer.
Orbax test. Used for testing, don't submit.