Diff code/files

[bfirsh]

Why

We record files, but they don't show up in replicate diff. This would be useful to understand what changes in code/files caused changes in your metrics.

How

To start with, we could just add a summary of what files changed to replicate diff. This could be implemented by efficiently by adding file names/hashes to metadata.

We could also have a way of doing a full file diff by downloading the saved data from storage.

User data

https://github.com/replicate/replicate/discussions/381