LMCache
[Core] Add batched get interface
Add batched get interface. This interface makes the storage backends be able to perform batched get operation.
PR https://github.com/LMCache/LMCache/pull/912 and https://github.com/LMCache/LMCache/pull/863 can leverage this.
PR Checklist (Click to Expand)
Thank you for your contribution to LMCache! Before submitting the pull request, please ensure the PR meets the following criteria. This helps us maintain the code quality and improve the efficiency of the review process.
PR Title and Classification
Please try to classify PRs for easy understanding of the type of changes. The PR title is prefixed appropriately to indicate the type of change. Please use one of the following:
[Bugfix]for bug fixes.[CI/Build]for build or continuous integration improvements.[Doc]for documentation fixes and improvements.[Model]for adding a new model or improving an existing model. Model name should appear in the title.[Core]for changes in the core LMCache logic (e.g.,LMCacheEngine,Backendetc.)[Misc]for PRs that do not fit the above categories. Please use this sparingly.
Note: If the PR spans more than one category, please include all relevant prefixes.
Code Quality
The PR need to meet the following code quality standards:
- The code need to be well-documented to ensure future contributors can easily understand the code.
- Please include sufficient tests to ensure the change is stay correct and robust. This includes both unit tests and integration tests.
What to Expect for the Reviews
To create a new tag for lmcache (Note: v prefix is required):
git tag vx.x.x
git push origin vx.x.x (same version again)
For example:
git tag v0.3.0
git push origin v0.3.0
In case the workflow fails, delete the tag and try again:
git tag -d vx.x.x
git push origin :refs/tags/vx.x.x
For example:
git tag -d v0.3.0
git push origin :refs/tags/v0.3.0
To create a new release and publish lmcache Python package to PyPi:
git remote add upstream [email protected]:LMCache/LMCache.git
gh release create vx.x.x --repo LMCache/LMCache --title "vx.x.x" --notes "<Add description>"
For example:
git remote add upstream [email protected]:LMCache/LMCache.git
gh release create v0.3.0 --repo LMCache/LMCache --title "v0.3.0" --notes "LMCache v0.3.0 is a feature release. Users are encouraged to upgrade for the best experience."
[!TIP] The creation of a release and subsequent tag generation can be done alternatively from the LMCache releases page.
We aim to address all PRs in a timely manner. If no one reviews your PR within 5 days, please @-mention one of KuntaiDu, ApostaC or YaoJiayi.
