Maximus

Thank you so much for the quick and thoughtful response. Is there anything i can do at this point to help? Filing a bug maybe?

+1. I'm having the same issue as @joshuablake and @TucoFernandes. Please see question at https://stackoverflow.com/questions/75349810/using-plotly-with-ggpolot2-geom-plot-with-stat-identity-results-in-empty-canvas. Btw, this (using pre-computed quartile values in geom_boxplot) is necessary because plotly is unable to...

--host 0.0.0.0 does seem to be solving the problem. maybe the instruction on the main page should be updated to include this solution: python3 -m fastchat.serve.controller --host 0.0.0.0

replace /path/to/model/weights with actual path to the model weights, for example /mnt/llama

Should the model stay loaded? In my case it seems that it is being unloaded after a few minutes of inactivity. While this might not be a problem with fast...