aws-ml-jp
aws-ml-jp copied to clipboard
aws-samples
SageMakerで機械学習モデルを構築、学習、デプロイする方法が学べるNotebookと教材集
Bumps [transformers](https://github.com/huggingface/transformers) from 4.36.0 to 4.38.0. Release notes Sourced from transformers's releases. v4.38: Gemma, Depth Anything, Stable LM; Static Cache, HF Quantizer, AQLM New model additions 💎 Gemma 💎 Gemma...
![dependabot[bot] avatar](https://avatars.githubusercontent.com/in/29110?v=4 "dependabot[bot] avatar"){kind=avatar}
Bumps [transformers](https://github.com/huggingface/transformers) from 4.36.0 to 4.38.0. Release notes Sourced from transformers's releases. v4.38: Gemma, Depth Anything, Stable LM; Static Cache, HF Quantizer, AQLM New model additions 💎 Gemma 💎 Gemma...
Bumps [transformers](https://github.com/huggingface/transformers) from 4.36.0 to 4.38.0. Release notes Sourced from transformers's releases. v4.38: Gemma, Depth Anything, Stable LM; Static Cache, HF Quantizer, AQLM New model additions 💎 Gemma 💎 Gemma...
Bumps [black](https://github.com/psf/black) from 22.8.0 to 24.3.0. Release notes Sourced from black's releases. 24.3.0 Highlights This release is a milestone: it fixes Black's first CVE security vulnerability. If you run Black...
*Description of changes:* Amazon Bedrock を使った生成AIアプリケーション開発を学んでいただけるようなコンテンツを追加しました By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.
Bumps [jupyterlab](https://github.com/jupyterlab/jupyterlab) from 4.0.10 to 4.0.11. Release notes Sourced from jupyterlab's releases. v4.0.11 4.0.11 (Full Changelog) Security fixes Potential authentication and CSRF tokens leak in JupyterLab (GHSA-44cc-43rp-5947) SXSS in Markdown...
AWS で生成系 AI を使ったアプリケーションを開発する開発者として、想定しているユースケースに対し Amazon Bedrock のモデルを使い Prompt Tuning するのが良いのか、 OSS を Fine Tuning した方が良いのか、判断基準のポイントを知りたい。初手は実装が簡易な Amazon Bedrock がスムーズだが、ユーザーの実利用データが蓄積できより挙動を洗練させたい場合、どこまで Prompt Tuning / Few shot で進めどこから Fine Tuning に切り替えるか見通しが事前に把握できれば、切り替えポイントの見過ごしによる機会損失を最小化することができる。
*Issue #, if available:* *Description of changes:* 大規模言語モデルの分散学習での Pre-training、Fine-tuning、Instruction-tuning のサンプルを追加。 By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms...
SageMaker で自然言語処理を行うためのExampleが別リポジトリにあるため、参照するか統合を行うことでサンプルへ容易にアクセスできるようにする。 https://github.com/AtsunoriFujita/sagemaker_nlp_examples
https://github.com/aws-samples/aws-ml-jp/blob/main/sagemaker/hpo-pytorch-mnist/pytorch_mnist.ipynb ``` Creating 9ajrhyi7nk-algo-1-1nstb ... Creating 9ajrhyi7nk-algo-1-1nstb ... done Attaching to 9ajrhyi7nk-algo-1-1nstb 9ajrhyi7nk-algo-1-1nstb | 2022-10-30 14:27:21,859 sagemaker-training-toolkit INFO Imported framework sagemaker_pytorch_container.training 9ajrhyi7nk-algo-1-1nstb | 2022-10-30 14:27:21,863 sagemaker-training-toolkit INFO No GPUs detected...
Metadata
Owner
Metadata
SageMakerで機械学習モデルを構築、学習、デプロイする方法が学べるNotebookと教材集