evidently icon indicating copy to clipboard operation
evidently copied to clipboard

Incompatible snapshot.json between 0.4.36 and 0.4.38

Open giahung24 opened this issue 4 months ago • 2 comments

Hi, I have set up an Evidently project to track my data drift. All of my past snapshot are stored with the version 0.4.36 (or below). Today when I accidentally update to 0.4.38, the snapshots saved to the project directory can not be loaded into Dashboard UI (local).

Quick comparison of two json versions gives me this :

Snapshot generated by 0.4.38:

{
    "id": "0192480f-6224-7f94-9c93-0f0372f76cd1",
    "suite": {
        "metrics": [
            {
                **"type": "evidently:metric:DataDriftTable",**
                "options": {
                    "color": null,
                    "render": null,
                    "data_definition": null
                },

Snapshot generated by 0.4.36:

{
    "id": "0192480f-6224-7f94-9c93-0f0372f76cd1",
    "suite": {
        "metrics": [
            {
                **"type": "evidently.metrics.data_drift.data_drift_table.DataDriftTable",**
                "options": {
                    "color": null,
                    "render": null,
                    "data_definition": null
                },

Can you confirm the change in metrics type name between two versions (evidently:metric:DataDriftTable vs. evidently.metrics.data_drift.data_drift_table.DataDriftTable)?

Can you verify if this change breaks the behavior of the local Dashboard UI ? Because if I have these two versions of snapshot in the project dir, when I restart the web ui, I get a 500 error like this :

INFO:     Waiting for application startup.
INFO:     Application startup complete.
INFO:     Uvicorn running on http://0.0.0.0:8088 (Press CTRL+C to quit)
INFO:     10.192.4.199:60998 - "GET /projects/60aec1ec-0c0d-4865-8a2c-203a5573b779 HTTP/1.1" 200 OK
INFO:     10.192.4.199:60998 - "GET /static/js/index-DrOTuKLf.js HTTP/1.1" 200 OK
INFO:     10.192.4.199:61000 - "GET /static/css/index-_rehp6Bp.css HTTP/1.1" 200 OK
INFO:     10.192.4.199:60998 - "GET /static/js/vendor-Bhc2M4pH.js HTTP/1.1" 200 OK
INFO:     10.192.4.199:61000 - "GET /static/js/index-BMd0dgrZ.js HTTP/1.1" 200 OK
INFO:     10.192.4.199:60998 - "GET /api/version HTTP/1.1" 200 OK
INFO:     10.192.4.199:61001 - "GET /static/js/createSvgIcon-BCx0yKii.js HTTP/1.1" 200 OK
INFO:     10.192.4.199:60998 - "GET /api/projects/60aec1ec-0c0d-4865-8a2c-203a5573b779/info HTTP/1.1" 500 Internal Server Error
INFO:     10.192.4.199:61000 - "GET /api/projects/60aec1ec-0c0d-4865-8a2c-203a5573b779/dashboard HTTP/1.1" 500 Internal Server Error

giahung24 avatar Oct 01 '24 13:10 giahung24