automaticcat
automaticcat
Can you attach current fixing branch to this issue
current PR https://github.com/janhq/cortex/pull/505
when will we rename @hahuyhoang411 ?
Currently keep this as pending to focus on decoupling and refactoring the current logic first
@CameronNg to help with further debugging
awesome plz go ahead with PR
As far as i remember LOG_INFO and logging utils is not using json? for the schema part i think current version good enough
Currently timestamp and log_id and log level also supported by trantor, can you recheck? for example LOG_INFO -> will be logging for info and so on
right now you can use https://nitro.jan.ai/ it supports an openai compatible endpoint
there is no do_bench function in torch._inductor.autotune_process i