Steven Krawczyk (Hegel AI)

Results 17 issues of Steven Krawczyk (Hegel AI)

**Describe the bug** Because the Transport struct requires urls, you cannot pass the uri of a local docker container, which is a very common use case. **To Reproduce** Create an...

bug

### 🐛 Describe the bug Running into the following on colab notebook: `AttributeError: 'AccelerateSFTTrainer' object has no attribute 'make_experience'` ![Screen Shot 2023-02-19 at 10 11 21 PM](https://user-images.githubusercontent.com/45177034/220024877-a67b8129-5a01-4bde-a331-2137c1dcdd30.png) ### Which trlX...

bug

# Overview of Change OpenAI has a new API format that uses a client object, so we need to change the way we monkey patch logging ``` from openai import...

### 🚀 The feature Request from potential user: "There are two main aspects, 1) adjusting prompts that changing semantic words does not trigger hallucination, 2) the prompt itself is such...

help wanted
good first issue

### 🚀 The feature We need an experiment or example for LlamaIndex. This will be similar to the work we need to do for LangChain and MindsDB. ### Motivation, pitch...

### 🚀 The feature We need a SQL validator for evaluation, like what we have for JSON and Python. We can use this package: https://pypi.org/project/sqlvalidator/ ### Motivation, pitch Many folks...

### 🚀 The feature We need to add benchmark test sets so folks can run on models / embeddings / systems A few essentials: * BEIR for information retrieval *...

enhancement
good first issue

### 🚀 The feature Today, we only support link sharing for 1 instruction and 1 prompt, and we don't capture configuration like temperature and other variables. First, we should support...

help wanted
playground

### 🚀 The feature As we add benchmarks, it would be good to cover common jailbreak scenarios. We should incorporate these benchmarks, and have auto-evals that check responses to see...

enhancement
help wanted