milvus icon indicating copy to clipboard operation
milvus copied to clipboard

[Bug]: The data of released partitions may be read

Open yah01 opened this issue 3 years ago • 18 comments

Is there an existing issue for this?

  • [X] I have searched the existing issues

Environment

- Milvus version:
- Deployment mode(standalone or cluster):
- SDK version(e.g. pymilvus v2.0.0rc2):
- OS(Ubuntu or CentOS): 
- CPU/Memory: 
- GPU: 
- Others:

Current Behavior

From QueryCoordV2, The QueryNode has no idea which partitions are released, this results in the QueryNode may load growing segments of released partitions, and Query/Search would see these data.

Note: after the segments are flushed, the segment will be released, because QueryCoord can find the sealed segments of released partitions

Expected Behavior

No response

Steps To Reproduce

No response

Milvus Log

No response

Anything else?

No response

yah01 avatar Sep 28 '22 03:09 yah01

/assign @yah01 /unassign

yanliang567 avatar Sep 28 '22 03:09 yanliang567

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions. Rotten issues close after 30d of inactivity. Reopen the issue with /reopen.

stale[bot] avatar Oct 29 '22 00:10 stale[bot]

/reopen

yah01 avatar Oct 29 '22 05:10 yah01

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions. Rotten issues close after 30d of inactivity. Reopen the issue with /reopen.

stale[bot] avatar Nov 29 '22 01:11 stale[bot]

@czs007 this is a partition related issue that you may take care.

yanliang567 avatar Nov 29 '22 01:11 yanliang567

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions. Rotten issues close after 30d of inactivity. Reopen the issue with /reopen.

stale[bot] avatar Dec 29 '22 03:12 stale[bot]

keep it

xiaofan-luan avatar Dec 29 '22 05:12 xiaofan-luan

/assign @bigsheeper

xiaofan-luan avatar Dec 29 '22 05:12 xiaofan-luan

/reopen

yah01 avatar Jan 06 '23 04:01 yah01

@yah01: Reopened this issue.

In response to this:

/reopen

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

sre-ci-robot avatar Jan 06 '23 04:01 sre-ci-robot

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions. Rotten issues close after 30d of inactivity. Reopen the issue with /reopen.

stale[bot] avatar Feb 05 '23 07:02 stale[bot]

keep it avtive

yanliang567 avatar Feb 06 '23 01:02 yanliang567

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions. Rotten issues close after 30d of inactivity. Reopen the issue with /reopen.

stale[bot] avatar Mar 08 '23 02:03 stale[bot]

keep it active

xiaofan-luan avatar Mar 08 '23 06:03 xiaofan-luan

@bigsheeper Is this solved with the new dynamic load partition?

yah01 avatar Mar 28 '23 06:03 yah01

@bigsheeper Is this solved with the new dynamic load partition?

Yes, I believe it can be solved. Perhaps we should add a test case for this scenario when testing dynamiclly loading partitions @binbinlv

bigsheeper avatar Mar 30 '23 03:03 bigsheeper

/assign @binbinlv

bigsheeper avatar Mar 30 '23 03:03 bigsheeper

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions. Rotten issues close after 30d of inactivity. Reopen the issue with /reopen.

stale[bot] avatar Apr 29 '23 04:04 stale[bot]