Yuchen Cheng
Yuchen Cheng
Sounds good to me :) Sure. I'm happy to submit a PR after that.
@pawamoy Affirmative.
Could I take this issue?
That's all right. Sorry for my mistake :)
Hi folks! I am actively integrating Kubeflow Trainer in our LLM fine-tuning framework. It would be great to complement the exporter as the missing piece. As an initial and naive...
/assign Here are some more references: - [fw-ai/benchmark](https://github.com/fw-ai/benchmark) - [genai-perf](https://github.com/triton-inference-server/perf_analyzer/tree/main/genai-perf) - [huggingface/inference-benchmarker](https://github.com/huggingface/inference-benchmarker) - llm-d - [llm-d/llm-d-benchmark](https://github.com/llm-d/llm-d-benchmark) - [fmperf-project/fmperf](https://github.com/fmperf-project/fmperf) - [[PUBLIC] llm-d Benchmarking Northstar](https://docs.google.com/document/d/1DtSEMRu3ann5M43TVB3vENPRoRkqBr_UiuwFnzit8mw/preview) - [[External] Standardizing Large Model Server Metrics...
Providing a copy from my previous threads in Slack to get feedbacks from folks on GitHub. I've been exploring the integration with Trainer of other fine-tuning frameworks, including `llamafactory` ,...