Yang Gao

[BUG]calling pf_client.run inside the callable target function for evaluate got "Error: (AssertionError) daemonic processes are not allowed to have children."

3

**Describe the bug** A clear and concise description of the bug. **How To Reproduce the bug** Steps to reproduce the behavior, how frequent can you experience the bug: I am...

[BUG] promptflow built in evaluator cannot take nested json outputs as column mapping

3

**Describe the bug** A clear and concise description of the bug. I am using promptflow evaluate API where I provide a target call ``` def target_call(): ... return {"outputs": {"outputA":...

[BUG] 'Connection aborted.', RemoteDisconnected('Remote end closed connection without response') while running promptflow eval API

2

**Describe the bug** A clear and concise description of the bug. we keep getting this connection aborted issue, this seems particularly frequent when input dataset is large, our case has...

[BUG] eval API errors out with UnexpectedError: Unexpected error occurred while executing the batch run. Error: (TypeError) cannot pickle '_thread.RLock' object.

8

**Describe the bug** A clear and concise description of the bug. ``` myTargetCallObj= MyTargetCallClass() credential = DefaultAzureCredential() content_safety_chat_evaluator = ContentSafetyChatEvaluator(project_scope=project_scope, credential=credential) results = evaluate( evaluation_name="test", data="absolute path to jsonl", target=myTargetCallObj,...

[BUG] promptflow is trying to upload my entire working directory while running with evaluate API

2

**Describe the bug** I noticed while running promptflow evaluate API, it is trying to upload my entire working directory to remote, and below case it failed because there is a...

[Feature Request] pass addition inputs to target function when using the evaluate method

2

**Is your feature request related to a problem? Please describe.** A clear and concise description of what the problem is. Not sure if this is already supported, but I couldn't...

[BUG]evaluator keeps failing with promptflow-eval 0.3.1 but works with 0.3.0

3

**Describe the bug** After switching promptflow-eval from 0.3.0 to 0.3.1, for same code, it keeps giving me the error: ``` 2024-07-15 06:52:21 +0000 377 execution.bulk ERROR Error occurred while executing...

**Describe the bug** A clear and concise description of the bug. Looking at the evaluation code, it only supports the default UTF-8 encoding: ``` initial_data_df = pd.read_json(data, lines=True) ``` https://github.com/microsoft/promptflow/blob/main/src/promptflow-evals/promptflow/evals/evaluate/_evaluate.py#L115...

[QUERY] workload identity through Azure ADO pipeline service connection

4

### Library name and version azure.identity 1.11.4 ### Query/Question Hello, we are using **AzureCLI2** ADO task and pass in a service connection through **azureSubscription** parameter. In this AzureCLI2 task, we...