🗺️ Persistence

[mikeldking]

As a user of phoenix, I would like a persistent backend - notably a way to

• Resume phoenix on previous collection of data
• Keep track of evaluation results

Spikes

• [x] #2158
• [x] #2335
• [x] #2704
• [x] #2742
• [x] #2793

Server

• [x] #2336
• [x] #2512
• [x] #2546
• [x] #2687
• [x] #2547
• [x] #2548
• [x] #2559
• [x] #2560
• [x] #2628
• [x] #2721
• [x] #2743
• [x] #2753
• [x] #2776
• [x] #2777
• [x] #2778
• [x] #2806
• [x] #2781
• [x] #2838
• [x] #2807
• [x] #2779
• [x] #2780
• [x] #2782
• [x] #2786
• [x] #2787
• [x] #2810
• [x] #2539
• [x] #2877
• [x] #2878
• [x] #2879
• [x] #2957
• [x] #2961
• [x] #2963
• [x] #2930
• [x] #2931
• [x] #2932
• [x] [persistence] remove defaulting to memory
• [x] [persistence] promote db config out of experimental
• [x] #2894
• [x] #2901
• [x] #2909
• [ ] #2906
• [x] #2913
• [x] #2925
• [x] #2926
• [x] #2922
• [x] #2813
• [x] #2843
• [x] #2889
• [x] #2929
• [x] #2969
• [x] #2975

UI

• [x] #2882
• [x] #2883
• [x] #2540

Metrics / Observability

• [x] #2615
• [ ] #2712
• [x] #2927
• [x] #2970

Infra

• [x] #2676
• [x] #2783
• [x] #2794
• [x] #2795
• [x] #2811
• [x] #2815
• [x] #2921

Remote Session management

• [x] #2136
• [x] #2137
• [x] #2091
• [x] #2138

Performance

• [ ] #3003
• [x] #3016
• [x] #3017
• [ ] #3018
• [ ] #3019
• [ ] #3021
• [ ] #3027
• [x] #3028
• [x] #2123
• [x] #3033
• [ ] #3049

Notebook-Side Persistence

• [x] #2814

Docs

• [ ] #2935
• [ ] #2936

Breaking Changes

• [x] #2933
• [x] #2934

Testing

• [ ] #2880
• [ ] #2881
• [x] #3040
• [ ] Make sure delete cascades work for data retention
• [ ] Make sure delete cascades work for data retention on evals @axiomofjoy
• [ ] Test run some migrations on named constraints
• [ ] Test pandas and parquet endpoints and interactions with the client
• [ ] Filters and Sorting on the UI
• [ ] SpanQuery compatibility
• [ ] Metadata filtering
• [ ] Data volume
• [ ] Data size (large context windows, large IO)
• [ ] Embedding querying

Open Questions

• Storage of embeddings
• Controlling sqlite version explicitly
• [ ] trace retention / management needed?