Keming

> Hey Keming, interested in taking a look at this issue, I briefly looked into some rust crates for this feature and found [this crate](https://github.com/jaemk/cached). This crate seems to have...

> Good point. Do you think the cache should be aware of the exact content type? No. Because we don't really parse the HTTP request body on the Rust side....

For the benchmark, you can check https://github.com/tensorchord/inference-benchmark/tree/main/benchmark

SGTM. Let me create PR for this.

I think it requires additional logic to get the latest release version in the [action](https://github.com/lycheeverse/lychee-action/blob/master/action.yml). One possible cmd is: ```bash gh release list --repo lycheeverse/lychee --exclude-drafts --exclude-pre-releases --limit 1 |...

Related to #1132

> Also https://www.usenix.org/conference/osdi22/presentation/yu Will create another issue to track this one.

> @kemingy does `envd` support windows 11? `envd` doesn't have a Windows release. I haven't tried to compile in Windows. It's recommended to use WSL.

- `skip_validation` is introduced in https://github.com/0b01001001/spectree/pull/212 - reason: https://github.com/0b01001001/spectree/issues/160 So `skip` here means skip the response type validation. Not the request validation. May I know why you don't want to...

> BTW would you accept a PR to rename `skip_validation` to `skip_response_validation`? Might save others the confusion I went through I guess we can add some documentation to make it...