Paul Prescod

Salesforce policy says that we do not run tests on a PR/branch created by someone outside of the company. This script copies an external branch to a local branch and...

Sometimes you want a parent object to have a field value which is the sum of many child values. Snowfakery allow you to specify or randomly generate the parent sum...

express-openapi: Unclear how to validate successful completion of tutorial

5

The express-openapi tutorial is excellent until the last paragraph. At the end, it seems to rely on other knowledge which a beginner might not have. https://github.com/kogosoftwarellc/open-api/blob/f5eb28e5a12b110d5ccdf8bcbcb8c66bb13146e8/packages/express-openapi/README.md?plain=1#L289 "Our paths are now...

Cannot run official builds on Windows Server 2016 Datacenter

3

I'm running on a remote VM with the following properties: Windows Server 2016 Datacenter Version 1607 Intel Xeon Platinum 8175M CPU 8GM of RAM 64 bit operating system, x64-based processor...

For all examples, please show how to get the answer out

5

Several of your examples show how to set up the chat or completion. Then they show you what the chat or completion looks like before its executed. But not how...

Node support

4

Please document whether Node is supported and if so, please provide an example. This example failed for me: ``` const { loadPyodide } = require("pyodide"); async function hello_python() { let...

[FEAT] LLM Support?

1

This blog post described unique challenges in doing evaluation for LLMs: https://medium.com/@ptannor/deepchecks-new-major-release-evaluation-for-llm-based-apps-82786e1ea109 Does there exist a tutorial or featureset for overcoming those challenges using this open source project? Is there...

Dramatically simpler and more reliable cache

1

It's my belief that the cache can be dramatically simplified, and made more reliable, by using the Python "diskcache" library. DiskCache handles so much: * locking * reliability in the...

Remove unconditional, uncontrollable output statements

1

**❗BEFORE YOU BEGIN❗** **Is your feature request related to a problem? Please describe.** I'm embedding your `evaluate` function in a program and it outputs stuff like this: ✅ Tests finished!...