[AI] enforce strict message schema

[creatorrr]

trafficstars

User description

Summary

• disallow unexpected fields on message objects so invalid YAML fails

Testing

• poe check (fails: command not found)
• poetry run poe check in agents-api (fails: Command not found: poe)

---

PR Type

Bug fix, Enhancement

---

Description

• Forbid extra fields in Message and InputChatMLMessage models

• Prevents invalid message attributes from being silently ignored

• Enforces strict schema validation for message objects

---

Changes walkthrough 📝

	Relevant files
Bug fix	openapi_model.py Forbid extra fields in message model configurations            agents-api/agents_api/autogen/openapi_model.py Set extra="forbid" in Message and InputChatMLMessage model configs Prevents acceptance of arbitrary/invalid keys in message objects Adds a note explaining the rationale for stricter validation +4/-0

---

Need help?

Type /help how to ... in the comments thread for any questions about Qodo Merge usage.

Check out the documentation for more information.

---

[!IMPORTANT] Enforce strict message schema by forbidding extra fields in Message and InputChatMLMessage to prevent ignoring invalid attributes.

• Behavior:
  • Enforce strict message schema by forbidding extra fields in Message and InputChatMLMessage classes in openapi_model.py.
  • Prevents silently ignoring invalid message attributes.
• Testing:
  • poe check and poetry run poe check commands fail due to command not found.

^{This description was created by for d564ebfc0b5b9ac2b2c08771759056a48343774e. You can customize this summary. It will automatically update as commits are pushed.}

[qodo-merge-for-open-source[bot]]

PR Reviewer Guide 🔍

Here are some key observations to aid the review process:

⏱️ Estimated effort to review: 1 🔵⚪⚪⚪⚪

🧪 No relevant tests

🔒 No security concerns identified

⚡ Recommended focus areas for review Configuration Inheritance The code uses Message.model_config when setting InputChatMLMessage.model_config, which might cause unexpected behavior if Message.model_config changes. Consider using InputChatMLMessage.model_config as the base instead. InputChatMLMessage.model_config = ConfigDict(**{**Message.model_config, "extra": "forbid"})

[qodo-merge-for-open-source[bot]]

PR Code Suggestions ✨

Explore these optional code suggestions:

Category	Suggestion	Impact
Possible issue	Fix incorrect config inheritance The second line for InputChatMLMessage is using Message.model_config instead of InputChatMLMessage.model_config as the base, which could lead to unexpected behavior if InputChatMLMessage has different config settings. Use the class's own model_config as the base. agents-api/agents_api/autogen/openapi_model.py [82-84] # AIDEV-NOTE: forbid extra fields to prevent silently ignoring invalid message attributes Message.model_config = ConfigDict(**{**Message.model_config, "extra": "forbid"}) -InputChatMLMessage.model_config = ConfigDict(**{**Message.model_config, "extra": "forbid"}) +InputChatMLMessage.model_config = ConfigDict(**{**InputChatMLMessage.model_config, "extra": "forbid"}) [ ] Apply / Chat Suggestion importance[1-10]: 7 __ Why: The suggestion correctly identifies that InputChatMLMessage.model_config should be used as the base for updating its own config, not Message.model_config. This prevents potential issues if the configs diverge, improving maintainability and correctness.	Medium
[ ] More

[qodo-merge-for-open-source[bot]]

CI Feedback 🧐

(Feedback updated until commit https://github.com/julep-ai/julep/commit/1f52fca38da3e8734f87a8d6486d467f35a12dee)

A test triggered by this PR failed. Here is an AI-generated analysis of the failure:

Action: Test

Failed stage: Run tests [❌]

Failed test name: test_mmr:24 utility: test to apply_mmr_to_docs

Failure summary: The action failed because the test test_mmr:24 utility: test to apply_mmr_to_docs failed. The test was expecting two UUIDs to be equal, but they were different: Expected: UUID('550e8400-e29b-41d4-a716-446655441122') Actual: UUID('550e8400-e29b-41d4-a716-446655440000') The failure occurred at line 57-58 in tests/test_mmr.py where the test was checking that applying MMR (Maximum Marginal Relevance) to documents with a limit greater than available docs should return all 5 docs with embeddings.

Relevant error logs: 1: ##[group]Operating System 2: Ubuntu ... 956: prune-cache: true 957: ignore-nothing-to-cache: false 958: ##[endgroup] 959: Downloading uv from "https://github.com/astral-sh/uv/releases/download/0.7.6/uv-x86_64-unknown-linux-gnu.tar.gz" ... 960: [command]/usr/bin/tar xz --warning=no-unknown-keyword --overwrite -C /home/runner/work/_temp/91833b6e-f989-48a2-aed8-357678027b8e -f /home/runner/work/_temp/bc7f4e9f-6a17-4c1b-9604-e28e669f9ee2 961: Added /opt/hostedtoolcache/uv/0.7.6/x86_64 to the path 962: Added /home/runner/.local/bin to the path 963: Set UV_CACHE_DIR to /home/runner/work/_temp/setup-uv-cache 964: Successfully installed uv version 0.7.6 965: Searching files using cache dependency glob: **/uv.lock 966: /home/runner/work/julep/julep/agents-api/uv.lock 967: /home/runner/work/julep/julep/cli/uv.lock 968: /home/runner/work/julep/julep/integrations-service/uv.lock 969: Found 3 files to hash. 970: Trying to restore uv cache from GitHub Actions cache with key: setup-uv-1-x86_64-unknown-linux-gnu-0.7.6-d92603d25acef1c08e643c37cc2475e5e190deb9690356b084828d60043a591f 971: ##[warning]Failed to restore: Cache service responded with 422 972: No GitHub Actions cache found for key: setup-uv-1-x86_64-unknown-linux-gnu-0.7.6-d92603d25acef1c08e643c37cc2475e5e190deb9690356b084828d60043a591f ... 1479: sql 1480: PASS test_agent_queries:126 query: update agent sql 4% 1481: PASS test_agent_queries:153 query: update agent with project sql 4% 1482: PASS test_agent_queries:177 query: update agent, project does not exist 4% 1483: PASS test_agent_queries:201 query: patch agent sql 5% 1484: PASS test_agent_queries:225 query: patch agent with project sql 5% 1485: PASS test_agent_queries:260 query: patch agent, project does not exist 5% 1486: PASS test_agent_queries:283 query: get agent not exists sql 5% 1487: PASS test_agent_queries:294 query: get agent exists sql 6% 1488: PASS test_agent_queries:315 query: list agents sql 6% 1489: PASS test_agent_queries:326 query: list agents with project filter sql 6% 1490: PASS test_agent_queries:352 query: list agents sql, invalid sort 6% 1491: direction 1492: PASS test_agent_queries:368 query: delete agent sql 6% 1493: INFO:httpx:HTTP Request: POST http://testserver/agents "HTTP/1.1 403 Forbidden" 1494: PASS test_agent_routes:9 route: unauthorized should fail 7% 1495: INFO:httpx:HTTP Request: POST http://testserver/agents "HTTP/1.1 201 Created" ... 1587: PASS test_docs_queries:445 query: delete user doc 20% 1588: PASS test_docs_queries:482 query: delete agent doc 20% 1589: PASS test_docs_queries:519 query: search docs by text 20% 1590: PASS test_docs_queries:556 query: search docs by text with technical 21% 1591: terms and phrases 1592: PASS test_docs_queries:619 query: search docs by embedding 21% 1593: PASS test_docs_queries:647 query: search docs by hybrid 21% 1594: INFO:httpx:HTTP Request: POST http://testserver/users/0682c7da-8c26-73c0-8000-d40232b1566a/docs "HTTP/1.1 201 Created" 1595: PASS test_docs_routes:15 route: create user doc 21% 1596: INFO:httpx:HTTP Request: POST http://testserver/agents/0682c7da-9441-7576-8000-0b429c9b0967/docs "HTTP/1.1 201 Created" 1597: PASS test_docs_routes:32 route: create agent doc 22% 1598: INFO:httpx:HTTP Request: POST http://testserver/agents/0682c7da-9c6e-7cb4-8000-b3d51e5991ae/docs "HTTP/1.1 201 Created" 1599: INFO:httpx:HTTP Request: POST http://testserver/agents/0682c7da-9c6e-7cb4-8000-b3d51e5991ae/docs "HTTP/1.1 409 Conflict" 1600: INFO:httpx:HTTP Request: POST http://testserver/users/0682c7da-9f76-777c-8000-367f13e4d728/docs "HTTP/1.1 201 Created" 1601: PASS test_docs_routes:49 route: create agent doc with duplicate title 22% 1602: should fail 1603: INFO:httpx:HTTP Request: POST http://testserver/agents/0682c7da-a7bc-7ef6-8000-888c83eeceee/docs "HTTP/1.1 201 Created" ... 1682: PASS test_execution_queries:136 query: list executions, invalid offset 29% 1683: PASS test_execution_queries:157 query: list executions, invalid sort by 29% 1684: PASS test_execution_queries:178 query: list executions, invalid sort 29% 1685: direction 1686: PASS test_execution_queries:199 query: count executions 30% 1687: PASS test_execution_queries:217 query: create execution transition 30% 1688: PASS test_execution_queries:238 query: create execution transition - 30% 1689: validate transition targets 1690: PASS test_execution_queries:283 query: create execution transition with 30% 1691: execution update 1692: PASS test_execution_queries:310 query: get execution with transitions 31% 1693: count 1694: PASS test_execution_queries:325 query: list executions with 31% 1695: latest_executions view 1696: PASS test_execution_queries:348 query: execution with finish transition 31% 1697: PASS test_execution_queries:382 query: execution with error transition 31% 1698: SKIP test_execution_workflow… workflow: evaluate step needs to be fixed 31% 1699: single 1700: SKIP test_execution_workflow… workflow: evaluate step needs to be fixed 32% 1701: multiple 1702: SKIP test_execution_workflo… workflow: variable access needs to be fixed 32% 1703: in expressions 1704: SKIP test_execution_workflo… workflow: yield step needs to be fixed 32% 1705: SKIP test_execution_workflo… workflow: sleep step needs to be fixed 32% 1706: SKIP test_execution_workflo… workflow: return step needs to be fixed 33% 1707: direct 1708: SKIP test_execution_workflo… workflow: return step needs to be fixed 33% 1709: nested 1710: SKIP test_execution_workflo… workflow: log step needs to be fixed 33% 1711: SKIP test_execution_workflo… workflow: log step needs to be fixed 33% 1712: expression fail 1713: SKIP test_execution_workf… workflow: system call workflow: thread race 34% ... 1848: INFO:httpx:HTTP Request: PUT http://testserver/test-paid-methods/put "HTTP/1.1 200 OK" 1849: INFO:httpx:HTTP Request: DELETE http://testserver/test-paid-methods/delete "HTTP/1.1 200 OK" 1850: PASS test_middleware:176 middleware: paid tag bypasses cost limit check 50% 1851: INFO:httpx:HTTP Request: GET http://testserver/test-get-with-cost-limit "HTTP/1.1 200 OK" 1852: PASS test_middleware:238 middleware: GET request with cost limit exceeded 50% 1853: passes through 1854: INFO:httpx:HTTP Request: POST http://testserver/test-none-cost "HTTP/1.1 403 Forbidden" 1855: PASS test_middleware:270 middleware: cost is None treats as exceeded 50% 1856: limit 1857: INFO:httpx:HTTP Request: POST http://testserver/test-null-tags "HTTP/1.1 403 Forbidden" 1858: PASS test_middleware:305 middleware: null tags field handled properly 50% 1859: INFO:httpx:HTTP Request: GET http://testserver/test-no-developer-id "HTTP/1.1 200 OK" 1860: PASS test_middleware:340 middleware: no developer_id header passes 51% 1861: through 1862: INFO:httpx:HTTP Request: GET http://testserver/test-user-not-found "HTTP/1.1 403 Forbidden" 1863: INFO:httpx:HTTP Request: GET http://testserver/test-404-error "HTTP/1.1 403 Forbidden" 1864: PASS test_middleware:357 middleware: forbidden, if user is not found 51% 1865: INFO:httpx:HTTP Request: GET http://testserver/test-500-error "HTTP/1.1 500 Internal Server Error" 1866: PASS test_middleware:397 middleware: hand over all the http errors except 51% 1867: of 404 ... 1870: INFO:httpx:HTTP Request: GET http://testserver/test-valid-user "HTTP/1.1 200 OK" 1871: PASS test_middleware:442 middleware: valid user passes through 51% 1872: INFO:httpx:HTTP Request: POST http://testserver/sessions "HTTP/1.1 403 Forbidden" 1873: PASS test_middleware:472 middleware: can't create session when cost limit 52% 1874: is reached 1875: INFO:httpx:HTTP Request: POST http://testserver/sessions "HTTP/1.1 201 Created" 1876: INFO:httpx:HTTP Request: DELETE http://testserver/sessions/0682c7dd-5f45-7260-8000-58f265975225 "HTTP/1.1 403 Forbidden" 1877: INFO:httpx:HTTP Request: GET http://testserver/sessions/0682c7dd-5f45-7260-8000-58f265975225 "HTTP/1.1 200 OK" 1878: PASS test_middleware:515 middleware: can't delete session when cost limit 52% 1879: is reached 1880: FAIL test_mmr:24 utility: test to apply_mmr_to_docs 52% 1881: PASS test_mmr:61 utility: test mmr with different mmr_strength values 52% 1882: PASS test_mmr:101 utility: test mmr with empty docs list 53% 1883: PASS test_model_validation:10 validate_model: succeeds when model is 53% 1884: available in model list 1885: PASS test_model_validation:19 validate_model: fails when model is 53% 1886: unavailable in model list 1887: PASS test_model_validation:31 validate_model: fails when model is None 53% 1888: PASS test_nlp_utilities:6 utility: clean_keyword 54% ... 1904: PASS test_prepare_for_step:202 utility: get_workflow_name - raises 56% 1905: PASS test_prepare_for_step:240 utility: get_inputs - 2 parallel 57% 1906: subworkflows 1907: PASS test_query_utils:5 utility: sanitize_string - strings 57% 1908: PASS test_query_utils:15 utility: sanitize_string - nested data 57% 1909: structures 1910: PASS test_query_utils:41 utility: sanitize_string - non-string types 57% 1911: PASS test_secrets_queries:17 query: create secret 57% 1912: PASS test_secrets_queries:44 query: list secrets 58% 1913: PASS test_secrets_queries:90 query: list secrets (decrypt=False) 58% 1914: PASS test_secrets_queries:135 query: get secret by name 58% 1915: PASS test_secrets_queries:163 query: get secret by name (decrypt=False) 58% 1916: PASS test_secrets_queries:191 query: update secret 59% 1917: PASS test_secrets_queries:246 query: delete secret 59% 1918: INFO:httpx:HTTP Request: GET http://testserver/secrets "HTTP/1.1 403 Forbidden" 1919: PASS test_secrets_routes:10 route: unauthorized secrets route should fail 59% 1920: INFO:httpx:HTTP Request: POST http://testserver/secrets "HTTP/1.1 201 Created" 1921: PASS test_secrets_routes:27 route: create secret 59% 1922: INFO:httpx:HTTP Request: POST http://testserver/secrets "HTTP/1.1 201 Created" 1923: INFO:httpx:HTTP Request: GET http://testserver/secrets "HTTP/1.1 200 OK" 1924: PASS test_secrets_routes:52 route: list secrets 60% 1925: INFO:httpx:HTTP Request: POST http://testserver/secrets "HTTP/1.1 201 Created" 1926: INFO:httpx:HTTP Request: PUT http://testserver/secrets/0682c7dd-ae58-7471-8000-0b2b1f6c6b63 "HTTP/1.1 200 OK" 1927: PASS test_secrets_routes:86 route: update secret 60% 1928: INFO:httpx:HTTP Request: POST http://testserver/secrets "HTTP/1.1 201 Created" 1929: INFO:httpx:HTTP Request: DELETE http://testserver/secrets/0682c7dd-ae7f-7278-8000-d2edc19b83e8 "HTTP/1.1 202 Accepted" 1930: INFO:httpx:HTTP Request: GET http://testserver/secrets "HTTP/1.1 200 OK" 1931: PASS test_secrets_routes:131 route: delete secret 60% 1932: INFO:httpx:HTTP Request: POST http://testserver/secrets "HTTP/1.1 201 Created" 1933: INFO:httpx:HTTP Request: POST http://testserver/secrets "HTTP/1.1 409 Conflict" 1934: PASS test_secrets_routes:172 route: create duplicate secret name fails 60% 1935: SKIP test_secrets_usage:27 render: Skipping secrets 60% ... 1942: SKIP test_secrets_usage:2… tasks: Skipping secrets 61% 1943: list_secrets_query in usage tests 1944: StepContext.tools 1945: method 1946: PASS test_session_queries:37 query: create session sql 61% 1947: PASS test_session_queries:60 query: create or update session sql 61% 1948: PASS test_session_queries:84 query: get session exists 62% 1949: PASS test_session_queries:100 query: get session does not exist 62% 1950: PASS test_session_queries:114 query: list sessions 62% 1951: PASS test_session_queries:131 query: list sessions with filters 62% 1952: PASS test_session_queries:150 query: count sessions 63% 1953: PASS test_session_queries:164 query: update session sql 63% 1954: PASS test_session_queries:199 query: patch session sql 63% 1955: PASS test_session_queries:226 query: delete session sql 63% 1956: INFO:httpx:HTTP Request: GET http://testserver/sessions "HTTP/1.1 403 Forbidden" 1957: PASS test_session_routes:7 route: unauthorized should fail 63% 1958: INFO:httpx:HTTP Request: POST http://testserver/sessions "HTTP/1.1 201 Created" ... 2052: PASS test_task_queries:70 query: get task sql - exists 73% 2053: PASS test_task_queries:89 query: get task sql - not exists 73% 2054: PASS test_task_queries:107 query: delete task sql - exists 73% 2055: PASS test_task_queries:143 query: delete task sql - not exists 74% 2056: PASS test_task_queries:162 query: list tasks sql - with filters 74% 2057: PASS test_task_queries:183 query: list tasks sql - no filters 74% 2058: PASS test_task_queries:201 query: list tasks sql, invalid limit 74% 2059: PASS test_task_queries:227 query: list tasks sql, invalid offset 74% 2060: PASS test_task_queries:243 query: list tasks sql, invalid sort by 75% 2061: PASS test_task_queries:259 query: list tasks sql, invalid sort direction 75% 2062: PASS test_task_queries:275 query: update task sql - exists 75% 2063: PASS test_task_queries:311 query: update task sql - not exists 75% 2064: PASS test_task_queries:338 query: patch task sql - exists 76% 2065: PASS test_task_queries:386 query: patch task sql - not exists 76% 2066: INFO:httpx:HTTP Request: POST http://testserver/agents/0682c7df-4e46-771a-8000-2b6673023988/tasks "HTTP/1.1 403 Forbidden" 2067: PASS test_task_routes:27 route: unauthorized should fail 76% 2068: INFO:httpx:HTTP Request: POST http://testserver/agents/0682c7df-545e-7855-8000-88ae2a7f83de/tasks "HTTP/1.1 201 Created" ... 2078: INFO:httpx:HTTP Request: GET http://testserver/tasks/0682c7df-6a1b-7dbb-8000-5a1c791ad397 "HTTP/1.1 200 OK" 2079: PASS test_task_routes:124 route: get task exists 77% 2080: INFO:httpx:HTTP Request: GET http://testserver/executions/0682c7df-769c-7cef-8000-ec177171c9a4/transitions "HTTP/1.1 200 OK" 2081: PASS test_task_routes:134 route: list all execution transition 78% 2082: INFO:httpx:HTTP Request: GET http://testserver/executions/0682c7df-833a-7e94-8000-f650812c0e40/transitions/0682c7df-8654-74d3-8000-901a6aa2617b "HTTP/1.1 200 OK" 2083: PASS test_task_routes:149 route: list a single execution transition 78% 2084: INFO:httpx:HTTP Request: GET http://testserver/tasks/0682c7db-62b9-78b6-8000-7ee310803003/executions "HTTP/1.1 200 OK" 2085: PASS test_task_routes:190 route: list task executions 78% 2086: INFO:httpx:HTTP Request: GET http://testserver/agents/0682c7df-8cdc-7ae7-8000-5c59aedd6224/tasks "HTTP/1.1 200 OK" 2087: INFO:httpx:HTTP Request: POST http://testserver/agents/0682c7df-8cdc-7ae7-8000-5c59aedd6224/tasks "HTTP/1.1 201 Created" 2088: INFO:httpx:HTTP Request: GET http://testserver/agents/0682c7df-8cdc-7ae7-8000-5c59aedd6224/tasks "HTTP/1.1 200 OK" 2089: PASS test_task_routes:205 route: list tasks 78% 2090: SKIP test_task_routes:248 route: update execution Temporal connection 79% 2091: issue 2092: PASS test_task_validation:7 task_validation: Python expression validator 79% 2093: detects syntax errors 2094: PASS test_task_validation:16 task_validation: Python expression validator 79% 2095: detects undefined names 2096: PASS test_task_validation:25 task_validation: Python expression validator 79% 2097: allows steps variable access 2098: PASS test_task_validation:33 task_validation: Python expression validator 80% 2099: detects unsafe operations 2100: PASS test_task_validation:42 task_validation: Python expression validator 80% 2101: detects unsafe dunder attributes 2102: PASS test_task_validation:63 task_validation: Python expression validator 80% 2103: detects potential runtime errors 2104: PASS test_task_validation:72 task_validation: Python expression 80% ... 2183: PASS test_user_queries:156 query: update user with project sql 91% 2184: PASS test_user_queries:193 query: update user, project does not exist 91% 2185: PASS test_user_queries:214 query: get user not exists sql 91% 2186: PASS test_user_queries:230 query: get user exists sql 91% 2187: PASS test_user_queries:245 query: list users sql 92% 2188: PASS test_user_queries:260 query: list users with project filter sql 92% 2189: PASS test_user_queries:287 query: list users sql, invalid limit 92% 2190: PASS test_user_queries:313 query: list users sql, invalid offset 92% 2191: PASS test_user_queries:328 query: list users sql, invalid sort by 93% 2192: PASS test_user_queries:344 query: list users sql, invalid sort direction 93% 2193: PASS test_user_queries:361 query: patch user sql 93% 2194: PASS test_user_queries:381 query: patch user with project sql 93% 2195: PASS test_user_queries:419 query: patch user, project does not exist 94% 2196: PASS test_user_queries:441 query: delete user sql 94% 2197: INFO:httpx:HTTP Request: POST http://testserver/users "HTTP/1.1 403 Forbidden" 2198: PASS test_user_routes:9 route: unauthorized should fail 94% 2199: INFO:httpx:HTTP Request: POST http://testserver/users "HTTP/1.1 201 Created" ... 2215: INFO:httpx:HTTP Request: GET http://testserver/users/0682c7e0-a5a2-7002-8000-1cb00b65728c "HTTP/1.1 200 OK" 2216: PASS test_user_routes:142 route: update user with project 96% 2217: INFO:httpx:HTTP Request: PATCH http://testserver/users/0682c7e0-abd2-7940-8000-02233de0a43f "HTTP/1.1 200 OK" 2218: INFO:httpx:HTTP Request: GET http://testserver/users/0682c7e0-abd2-7940-8000-02233de0a43f "HTTP/1.1 200 OK" 2219: PASS test_user_routes:174 query: patch user 96% 2220: INFO:httpx:HTTP Request: PATCH http://testserver/users/0682c7e0-af0b-7ace-8000-94ce72a6419a "HTTP/1.1 200 OK" 2221: INFO:httpx:HTTP Request: GET http://testserver/users/0682c7e0-af0b-7ace-8000-94ce72a6419a "HTTP/1.1 200 OK" 2222: PASS test_user_routes:205 query: patch user with project 96% 2223: INFO:httpx:HTTP Request: GET http://testserver/users "HTTP/1.1 200 OK" 2224: PASS test_user_routes:238 query: list users 96% 2225: INFO:httpx:HTTP Request: POST http://testserver/users "HTTP/1.1 201 Created" 2226: INFO:httpx:HTTP Request: GET http://testserver/users?project=inflammable_helmholtz_cej "HTTP/1.1 200 OK" 2227: PASS test_user_routes:253 query: list users with project filter 97% 2228: INFO:httpx:HTTP Request: GET http://testserver/users?metadata_filter=%7B%27test%27%3A+%27test%27%7D "HTTP/1.1 200 OK" 2229: PASS test_user_routes:286 query: list users with right metadata filter 97% 2230: PASS test_validation_errors:9 format_location: formats error location 97% 2231: paths correctly 2232: PASS test_validation_errors:31 get_error_suggestions: generates helpful 97% 2233: suggestions for missing fields 2234: PASS test_validation_errors:42 get_error_suggestions: generates helpful 97% 2235: suggestions for type errors 2236: PASS test_validation_errors:64 get_error_suggestions: generates helpful 98% 2237: suggestions for string length errors 2238: PASS test_validation_errors:85 get_error_suggestions: generates helpful 98% 2239: suggestions for number range errors 2240: WARNING:agents_api.web:Validation error: [{'type': 'dict_type', 'msg': 'Input should be a valid dictionary', 'loc': 'metadata', 'received': 'not-an-object'}, {'type': 'missing', 'msg': 'Field required', 'loc': 'name', 'fix': 'Add this required field to your request', 'example': '{ "field_name": "value" }', 'received': "{'about': 'Test agent description', 'model': 'invalid-model-id', 'metadata': 'not-an-object'}"}] 2241: INFO:httpx:HTTP Request: POST http://testserver/agents "HTTP/1.1 422 Unprocessable Entity" 2242: PASS test_validation_errors:107 validation_error_handler: returns 98% 2243: formatted error response for validation 2244: errors 2245: PASS test_validation_errors:148 validation_error_suggestions: function 98% 2246: generates helpful suggestions for all 2247: error types 2248: PASS test_workflow_helpers:25 execute_map_reduce_step_parallel: 99% ... 2255: INFO:httpx:HTTP Request: POST http://testserver/tasks/0682c7e0-c01c-75e6-8000-caba791db258/executions "HTTP/1.1 201 Created" 2256: PASS test_workflow_routes:10 workflow route: evaluate step single 99% 2257: INFO:httpx:HTTP Request: POST http://testserver/agents/0682c7e0-c860-7a45-8000-c8646d61236a/tasks "HTTP/1.1 201 Created" 2258: INFO:httpx:HTTP Request: POST http://testserver/tasks/0682c7e0-ca7d-78f4-8000-5ccc203189a0/executions "HTTP/1.1 201 Created" 2259: PASS test_workflow_routes:41 workflow route: evaluate step single with 100% 2260: yaml 2261: INFO:httpx:HTTP Request: POST http://testserver/agents/0682c7e0-d0fb-74c9-8000-9bee3ed9b339/tasks "HTTP/1.1 201 Created" 2262: INFO:httpx:HTTP Request: POST http://testserver/tasks/0682c7e0-d2f1-76f2-8000-b3ad1eb08aa9/executions "HTTP/1.1 201 Created" 2263: PASS test_workflow_routes:83 workflow route: evaluate step single with 100% 2264: yaml - nested 2265: INFO:httpx:HTTP Request: POST http://testserver/agents/0682c7e0-d933-7ccb-8000-c8647e7560f1/tasks/0682c7e0-d949-7efc-8000-fc00757712bd "HTTP/1.1 201 Created" 2266: INFO:httpx:HTTP Request: POST http://testserver/tasks/0682c7e0-d949-7efc-8000-fc00757712bd/executions "HTTP/1.1 201 Created" 2267: PASS test_workflow_routes:128 workflow route: create or update: evaluate 100% 2268: step single with yaml 2269: ────────────────────── utility: test to apply_mmr_to_docs ────────────────────── 2270: Failed at tests/test_mmr.py:53 2271: 24 @test("utility: test to apply_mmr_to_docs") ... 2302: 55 2303: 56 # Test with limit greater than available docs 2304: 57 result = apply_mmr_to_docs(docs, query_embedding, limit=10, mmr_str 2305: 58 assert len(result) == 5 # Only 5 docs have embeddings 2306: 59 2307: ╭─ Difference (LHS vs RHS) ──────────────────────────────────────────────────╮ 2308: │ │ 2309: │ UUID('550e8400-e29b-41d4-a716-446655441122') │ 2310: │ UUID('550e8400-e29b-41d4-a716-446655440000') │ 2311: │ │ 2312: ╰────────────────────────────────────────────────────────────────────────────╯ 2313: ──────────────────────────────────────────────────────────────────────────────── 2314: ╭───────────── Results ─────────────╮ 2315: │ 435 Tests Encountered │ 2316: │ 402 Passes (92.4%) │ 2317: │ 1 Failures (0.2%) │ 2318: │ 32 Skips (7.4%) │ 2319: ╰───────────────────────────────────╯ 2320: ─────────────────────────── FAILED in 225.13 seconds ─────────────────────────── 2321: ##[error]Process completed with exit code 1. 2322: Post job cleanup.