FlyAIBox
上午重启后，启动日志信息 `log4j:WARN No appenders could be found for logger (io.netty.util.internal.logging.InternalLoggerFactory). log4j:WARN Please initialize the log4j system properly. [05-17 10:36:45.045] [INFO] [cat] Cat is lazy initialized! java.lang.RuntimeException: Error when initializing modules!...
zsh is latest version
After modifying the yaml format, the InferenceService was successfully deployed ```yaml apiVersion: serving.kserve.io/v1beta1 kind: InferenceService metadata: namespace: kserve-test name: bloom spec: predictor: containers: - args: - --port - "8080" -...
@yuzisun @terrytangyuan Our team likes kserve products very much, Trouble the boss, be free for advice
The call interface has been found ```bash curl -v -H "Host: ${SERVICE_HOSTNAME}" -H "Content-Type: application/json" http://${INGRESS_HOST}:${INGRESS_PORT}/generate -d '{"prompt": "San Francisco is a" }' * About to connect() to localhost port...
the image of docker.io/kserve/vllmserver: Can the Dockerfile be provided for reference @yuzisun
@yuzisun Please ask if there is a complete example of publishing the DeepSpeed model as a reasoning service using kserve
我更换了仓库地址 可以拉取了, 修改tke-market仓库为k8s-big-data