yahp
yahp copied to clipboard
mosaicml
hyperparameter management
Hparams such as `grad_accum: Optional[str, int]` should attempt to use `int` first before defaulting to `str`. Otherwise, argparse flags such as `--grad_accum 1` would be converted as a string, instead...
Consider the following: ```python3 import dataclasses import yahp as hp class Foo: """Foo class Args: bar (int, optional): Most helpful docstring ever """ def __init__(self, bar: int = 5): self.bar...
I'm working on moving https://github.com/stanford-crfm/mistral to yahp for config, and the only major trip up was supporting lists of lists. I feel like this change is a bit incomplete, but...
Playing around with a custom hparams with composer, I ran into this. If I have an hparams with a `dict[str, OtherHparams]` member, the yaml parser will produce a `dict[str, dict]`....
## 🚀 Feature Request Currently, all of the registries are [hard-coded in `trainer/trainer_hparams.py`](https://github.com/mosaicml/composer/blob/10564364cd6722a1e9a89efa1faa1868c948583a/composer/trainer/trainer_hparams.py#L39). It seems like it would be simpler to have a `register_{optimizer/model/etc.}` function that decorates the relevant object,...
# Inherits Spec Want to move from our custom inherits scheme to a scheme such as JSON merge to allow for more flexibility when merging different parameter types. Hoping to...
It would be extremely useful to be able to convert between dot notation and nested syntax in order to support new features like parameter sweeping and other configuration tools.
Yamllint
We should have some sort of yamllinting / auto formatting Probably best to take in yaml, parse it with rumel, and re-dump it. yamllint doesn't auto-format.
Possibly a CLI tool to reformat someone's Hparams file and inject comments to make it clear what is missing or what is not defined properly. Should be fairly easy to...
Be able to template multiple different sets of values for Hparams objects like Resnet. Probably only for interactive templating ┆Issue is synchronized with this [Asana task](https://app.asana.com/0/1200593935312755/1200752799392306) by [Unito](https://www.unito.io)