Austin Welch

Hi, I was able to deploy the base Falcon-40B model to SageMaker using the TGI DLC by following [this blog post](https://www.philschmid.de/sagemaker-falcon-llm) I also recently fine-tuned the Falcon-40B model with QLoRA...

Hi, is there documentation for the list of ENV vars available when deploying the TGI DLC container in SageMaker? For example, any others besides these? `HF_MODEL_ID`, `SM_NUM_GPUS`, `HF_MODEL_QUANTIZE`

Hi, would it make sense to create a SageMaker batch processing example demonstrating running eval with [Eleuther AI Language Model Evaluation Harness](https://github.com/EleutherAI/lm-evaluation-harness)? I haven't seen any SM examples for LLM...

Hi, I plan to test combining parts from SageMaker examples 24 and 25, but are there any already existing notebook examples with FSDP + LoRA?

Hi, notebook `sagemaker/25_pytorch_fsdp_model_parallelism` states, "Here we will follow the instructions on the [Model card](https://huggingface.co/togethercomputer/GPT-NeoXT-Chat-Base-20B#strengths-of-the-model) and add the EOS token." What does this refer to? I can't seem to find anything...

[Bug Report] CartPole env.render() kills JupyterLab kernel

15

**Describe the bug** `env.render()` kills my JupyterLab kernel. **Code example** ```python import random import numpy as np import gym from tensorflow.keras.models import Sequential from tensorflow.keras.layers import Dense, Flatten from tensorflow.keras.optimizers...

validation data generator

2

Can I use ImageDataGenerator.flow_from_directory for the validation set when finding a momentum value?

[Question]: How to use LabelledRagDataset with RetrieverEvaluator or BatchEvalRunner

5

### Question Validation - [X] I have searched both the documentation and discord for an answer. ### Question Hi, I have a `LabelledRagDataset` created with `RagDatasetGenerator`. Now how can I...

[Bug]: "AttributeError: 'LangchainEmbedding' object has no attribute '_langchain_embedding'

8

### Bug Description "AttributeError: 'LangchainEmbedding' object has no attribute '_langchain_embedding' ### Version 0.9.44 ### Steps to Reproduce `requirements.txt`: ```txt boto3 sagemaker llama-index==0.9.44 llama-hub langchain langchain-community syne-tune pypdf unstructured[docx,pdf,pptx] nltk ```...

[Bug]: AttributeError: 'LangChainLLM' object has no attribute '_llm'.

4

### Bug Description `AttributeError: 'LangChainLLM' object has no attribute '_llm'.` ### Version llama-index==0.9.44 ### Steps to Reproduce `requirements.txt`: ```txt boto3 sagemaker llama-index==0.9.44 llama-hub langchain langchain-community syne-tune pypdf unstructured[docx,pdf,pptx] nltk ```...