edsl

edsl copied to clipboard

Add 'piping' option where previous answers can be slotted into to question text / options in future questions

7

johnjosephhorton

Modify `Results.to_csv()` to allow pretty_labels

1

rbyh

rbyh

Results `sort_by()` method does not behave as expected

4

I expect it to sort fields in the order that I have applied it, but it does it in reverse:

rbyh

Results objects should have __add__ method

5

rbyh

Problems with non-Open AI models

3

I originally thought this was a problem with scenarios, but non-scenario questions are not running either: ``` from edsl.questions import QuestionMultipleChoice from edsl import Model model = Model('claude-3-opus-20240229') q =...

rbyh

This is what happens now when a job running has exceptions. @rbyh please document & we can add a URL. ```python >>> from edsl import QuestionFreeText; results = QuestionFreeText(question_text =...

johnjosephhorton

rbyh

For each inference service, add methods to learn tokens-per-minute and requests-per-minute limits

1

We need be able to adjust TPM/RMP limits dynamically. If too hard, these should be user settings on coop.

johnjosephhorton

Add coop client feature to upload exceptions / telemetry. I had this in https://github.com/expectedparrot/edsl/blob/main/edsl/jobs/runners/JobsRunnerAsyncio.py but I'm removing it for now: ``` # from edsl.jobs.interviews.ReportErrors import ReportErrors # full_task_history = TaskHistory(...

johnjosephhorton