Sebastian Raschka

Adding example/"cookiecutter" projects

3

I think it would be useful to add some example projects to the repo (not the package itself) so that users could browse through some use cases (and optionally clone...

Adding a __version__ attribute

8

It would be nice to add a `__version__` attribute similar to other Python projects, so that we can easily query the version for reproducibility reasons. I.e., ```python import tiktoken print(tiktoken.__version__)...

I think that a lot of weird errors with uninformative error messages that users encounter (e.g., see #438) are due to package mismatches. Since we are using the latest features...

Stream option

3

Add a `stream=True` option to `generate`

OptimizerArgs

4

This PR unbundles the OptimizerArgs approach from GaLore in #1192. ## Todos - [ ] OptimizerArgs for full finetuning - [ ] Update code - [ ] Add docstrings -...

As discussed, we should add a Python API. I can come up with some ideas and suggestions that we can discuss.

Streamline LitGPT API

7

Following up on a longer internal discussion we had (cc @carmocca @lantiga @awaelchli ), we want to support the following user-friendly API in LitGPT: ```bash # ligpt [action] [model] litgpt...

Option to skip expensive final validation

2

For quick dev and testing, the new final validation step can be very expensive, especially with larger checkpoints. This adds an option to disable it. (This is analogous to the...

Remove old and unused LLMs

3

Following up on a request, we may want to prune a few models that are not really used in practice anymore from LitGPT to declutter. If I were to remove...