agenta
agenta copied to clipboard
[AGE-2612] [Bug] Test Set Upload Accepts Objects But Fails During Evaluation
Summary: Test set upload accepts JSON files with object fields without validation, but evaluation fails with 500 error when using these test sets.
Envs affected:
- OSS
- Stage
- Beta
- Prod
- other / local branch
Interface Affected
- web
- api
Functionalities Affected
- Testsets
- Evals
Current Behavior:
- User uploads a JSON test set containing fields with object values
- Upload succeeds without any validation error or warning
- When attempting to run an evaluation using this test set, the system returns a 500 server error
- No clear error message indicates that object fields are not supported
Expected Behavior:
- Test set upload should validate that all fields contain only string values
- If objects are detected, upload should fail with a clear error message explaining the requirement
- Alternatively, the system should handle object fields during evaluation without crashing
Steps To Reproduce:
- Create a JSON test set file with at least one field containing object values (not strings)
- Upload the test set through the web interface
- Navigate to create a human evaluation
- Select the uploaded test set
- Attempt to run the evaluation
Console / Container Logs: Server returns 500 error during evaluation execution
From SyncLinear.com | AGE-2612