REPrompt response JSONDecodeError error
(openspg_venv) root@iZrj9i06tz8gmok8v518gyZ:/code/python/knext/knext/examples/medicine# knext builder execute Disease 2024-08-31 05:10:42,489 [] [] [main] INFO c.a.o.c.i.g.GraphStoreClientDriverManager - registerDriver: com.antgroup.openspg.cloudext.impl.graphstore.tugraph.TuGraphStoreClientDriver@7d20d0b 2024-08-31 05:10:42,499 [] [] [main] INFO c.a.o.c.u.DriverManagerUtils - DriverManager.initialize: cloudext.graphstore.drivers = null 2024-08-31 05:10:42,499 [] [] [main] INFO c.a.o.c.i.g.GraphStoreClientDriverManager - graph-store DriverManager initialized 2024-08-31 05:10:43,796 [] [] [main] INFO c.a.o.c.i.s.SearchEngineClientDriverManager - registerDriver: com.antgroup.openspg.cloudext.impl.searchengine.elasticsearch.ElasticSearchEngineClientDriver@2e9fda69 2024-08-31 05:10:43,797 [] [] [main] INFO c.a.o.c.u.DriverManagerUtils - DriverManager.initialize: cloudext.searchengine.drivers = null 2024-08-31 05:10:43,797 [] [] [main] INFO c.a.o.c.i.s.SearchEngineClientDriverManager - search-engine DriverManager initialized 2024-08-31 05:10:44,061 [] [] [main] INFO c.a.o.b.c.p.o.PythonOperatorFactory - pythonExec=/openspg_venv/bin/python3, pythonPaths=[/openspg_venv/bin, /usr/lib/python38.zip, /usr/lib/python3.8, /usr/lib/python3.8/lib-dynload, /openspg_venv/lib/python3.8/site-packages, /code/python/knext/knext/examples/medicine, /code/python/knext/knext/examples/medicine/builder/operator, /openspg_venv/lib/python3.8/site-packages/knext/builder/operator/builtin, /code/python/knext/knext/examples/medicine/builder/job] REPrompt response JSONDecodeError error. 2024-08-31 05:10:52,336 [] [] [main] INFO c.a.o.b.r.l.r.BuilderMetric - type=COUNTER, name=default_job_error, count=0 2024-08-31 05:10:52,346 [] [] [main] INFO c.a.o.b.r.l.r.BuilderMetric - type=METER, name=default_job_total, count=1, m1_rate=0.2, m5_rate=0.2, m15_rate=0.2, mean_rate=0.15013758789470466, rate_unit=events/second
Please provide more context information, configuration information for large models.Make sure the large model returns properly
因为部分ai输出的内容是markdown格式的,json.loads无法正常解析,可以先通过正则去提取pattern = r'json\n([\s\S]*?)\n'
这是我的临时方案
完整方案可以借鉴langchain https://github.com/langchain-ai/langchain/blob/c6350d636e139bd9018f7225d3257c4be6139d54/libs/core/langchain_core/utils/json.py#L124