evidently
evidently copied to clipboard
Incompatible snapshot.json between 0.4.36 and 0.4.38
Hi, I have set up an Evidently project to track my data drift. All of my past snapshot are stored with the version 0.4.36 (or below). Today when I accidentally update to 0.4.38, the snapshots saved to the project directory can not be loaded into Dashboard UI (local).
Quick comparison of two json versions gives me this :
Snapshot generated by 0.4.38:
{
"id": "0192480f-6224-7f94-9c93-0f0372f76cd1",
"suite": {
"metrics": [
{
**"type": "evidently:metric:DataDriftTable",**
"options": {
"color": null,
"render": null,
"data_definition": null
},
Snapshot generated by 0.4.36:
{
"id": "0192480f-6224-7f94-9c93-0f0372f76cd1",
"suite": {
"metrics": [
{
**"type": "evidently.metrics.data_drift.data_drift_table.DataDriftTable",**
"options": {
"color": null,
"render": null,
"data_definition": null
},
Can you confirm the change in metrics type name between two versions (evidently:metric:DataDriftTable
vs. evidently.metrics.data_drift.data_drift_table.DataDriftTable
)?
Can you verify if this change breaks the behavior of the local Dashboard UI ? Because if I have these two versions of snapshot in the project dir, when I restart the web ui, I get a 500 error like this :
INFO: Waiting for application startup.
INFO: Application startup complete.
INFO: Uvicorn running on http://0.0.0.0:8088 (Press CTRL+C to quit)
INFO: 10.192.4.199:60998 - "GET /projects/60aec1ec-0c0d-4865-8a2c-203a5573b779 HTTP/1.1" 200 OK
INFO: 10.192.4.199:60998 - "GET /static/js/index-DrOTuKLf.js HTTP/1.1" 200 OK
INFO: 10.192.4.199:61000 - "GET /static/css/index-_rehp6Bp.css HTTP/1.1" 200 OK
INFO: 10.192.4.199:60998 - "GET /static/js/vendor-Bhc2M4pH.js HTTP/1.1" 200 OK
INFO: 10.192.4.199:61000 - "GET /static/js/index-BMd0dgrZ.js HTTP/1.1" 200 OK
INFO: 10.192.4.199:60998 - "GET /api/version HTTP/1.1" 200 OK
INFO: 10.192.4.199:61001 - "GET /static/js/createSvgIcon-BCx0yKii.js HTTP/1.1" 200 OK
INFO: 10.192.4.199:60998 - "GET /api/projects/60aec1ec-0c0d-4865-8a2c-203a5573b779/info HTTP/1.1" 500 Internal Server Error
INFO: 10.192.4.199:61000 - "GET /api/projects/60aec1ec-0c0d-4865-8a2c-203a5573b779/dashboard HTTP/1.1" 500 Internal Server Error