milvus icon indicating copy to clipboard operation
milvus copied to clipboard

[Bug]: Crash caused by memory explosion

Open StevenSama opened this issue 2 years ago • 60 comments

Is there an existing issue for this?

  • [X] I have searched the existing issues

Environment

- Milvus version:2.0.2
- Deployment mode(standalone or cluster):standalone
- SDK version(e.g. pymilvus v2.0.0rc2):java 2.0.4
- OS(Ubuntu or CentOS): ubuntu
- CPU/Memory: 24C/32G
- GPU: 
- Others:

Current Behavior

Changing the entity of the collection, adding or deleting it during collection query will cause the memory to continue to rise abnormally and eventually crash

Expected Behavior

Changing entities while querying is not affected

Steps To Reproduce

1、create collection,768DIM,IVF_SQ8 nlist 256 IP
2、insert 10W entities into the collection
3、load entities from collection for query param,do the query with per entity;
5、during the query,adding or deleteing the entities

Milvus Log

No response

Anything else?

No response

StevenSama avatar May 20 '22 02:05 StevenSama

@StevenSama Can you use this script to export milvus log? And it will be very helpful.

JackLCL avatar May 20 '22 03:05 JackLCL

@StevenSama could you please help to upload milvus logs as suggested above?

/assign @StevenSama /unassign

yanliang567 avatar May 20 '22 08:05 yanliang567

https://drive.google.com/file/d/1em4glLpD29wF3tx7Rxz2ojOKNeeMBUWl/view?usp=sharing

StevenSama avatar May 24 '22 10:05 StevenSama

memery useage: image

StevenSama avatar May 24 '22 10:05 StevenSama

@xige-16 could you please take a deep look into the logs? /assign @xige-16

@StevenSama I did not see coredump or panic errors in the logs. I guess Milvus did not crash yet becuase the log ends at 2022/05/24 18:20:08.144 +08:00, and the memery usage diagram above shows it was still runing after 18:25:46. Could you please use this script to export the completed logs(including logs before crash and after crash)

yanliang567 avatar May 24 '22 12:05 yanliang567

during the query,adding or deleteing the entities How many entities are we adding/deleting? delete in milvus is logic delete, and will be purged after 7 days, and if you insert very often you should see the memory consumption increase

xiaofan-luan avatar May 24 '22 12:05 xiaofan-luan

About 100 or so, very few

StevenSama avatar May 25 '22 06:05 StevenSama

@xige-16 could you please take a deep look into the logs? /assign @xige-16

@StevenSama I did not see coredump or panic errors in the logs. I guess Milvus did not crash yet becuase the log ends at 2022/05/24 18:20:08.144 +08:00, and the memery usage diagram above shows it was still runing after 18:25:46. Could you please use this script to export the completed logs(including logs before crash and after crash)

Although there is no coredump yet, it will definitely be coredump if I continue to run. It is difficult for me to obtain logs after coredump.

StevenSama avatar May 25 '22 06:05 StevenSama

image After stopping the insertion, after stopping the query, the memory remains balanced, and the query is started again, and the memory increases all the way!

StevenSama avatar May 25 '22 07:05 StevenSama

@StevenSama thank you for updates. It shall not consume so much memory as only 100000 entities inserted. Could you please share the reproduce code snippet for investigation?

yanliang567 avatar May 25 '22 10:05 yanliang567

@StevenSama thank you for updates. It shall not consume so much memory as only 100000 entities inserted. Could you please share the reproduce code snippet for investigation?

public class MilvusUtilsConsole extends BaseConsole {

static ExecutorService exec;
static Boolean isDone;
static String host;
static String port;
static String collectionName;
static String cmd;
static String param;

public static void main(String[] args) {
	init(args);
	Tick tick = new Tick();
	tick.tick();
	host = ConsoleArgs.getArg("host");
	port = ConsoleArgs.getArg("port");
	collectionName = ConsoleArgs.getArg("collection");
	cmd = ConsoleArgs.getArg("cmd");
	param = ConsoleArgs.getArg(4);
	System.out.println(host + ":" + port + ":" + collectionName + ":" + cmd + ":" + param);
	exec = Executors.newCachedThreadPool();
	isDone = false;
	work();
	exec.shutdown();
	while (!exec.isTerminated()) {
		try {
			System.out.println("-------DONE-------");
			TimeUnit.SECONDS.sleep(1);
		} catch (InterruptedException e) {
			e.printStackTrace();
		}
	}
	tick.toke();
	System.out.println("end finish");
	System.out.println("consume min:" + tick.consume() / 1000 / 60);
	System.exit(0);
}

private static void work() {

	exec.execute(new Runnable() {

		@Override
		public void run() {

			try {
				try {
					MilvusServiceClient milvusClient = new MilvusServiceClient(
							ConnectParam.newBuilder().withHost(host).withPort(Integer.valueOf(port)).build());
					milvusClient.delete(DeleteParam.newBuilder().withCollectionName(collectionName)
							.withExpr("id in [" + param + "]").build());
					milvusClient.close();
				} catch (Exception e) {
					e.printStackTrace();
				}
			} catch (Exception e) {
				e.printStackTrace();
			}
		}
	});
}

}

StevenSama avatar May 26 '22 03:05 StevenSama

everything works fine if i don't delete it at query time via javasdk

StevenSama avatar May 26 '22 03:05 StevenSama

It is very easy to reproduce, as long as you use javasdk to make changes when querying, even if you only change dozens of vectors

StevenSama avatar May 26 '22 03:05 StevenSama

@ThreadDao could you please help to reproduce it with pymilvus as suggested above?

/assign @ThreadDao

yanliang567 avatar May 26 '22 04:05 yanliang567

querying is not

Does this issue only occur when testing with javasdk? @StevenSama

xige-16 avatar May 27 '22 03:05 xige-16

image

2022-05-25 17:57:31,237 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:31,261 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:31,283 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:31,305 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:31,325 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:31,343 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:31,363 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:31,386 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:31,413 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:31,429 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:31,445 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:31,460 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:31,482 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:31,513 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:31,533 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:31,550 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:31,576 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:31,596 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:31,617 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:31,636 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:31,653 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:31,676 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:31,700 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:31,722 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:31,741 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:31,758 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:31,783 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:31,806 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:31,833 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:31,853 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:31,870 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:31,898 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:31,925 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:31,949 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:31,972 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:32,006 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:32,033 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:32,049 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:32,064 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:32,090 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:32,125 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:32,146 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:32,165 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:32,199 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:32,222 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:32,239 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:32,258 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:32,283 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:32,315 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:32,336 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:32,355 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:32,380 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:32,407 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:32,428 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:32,448 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:32,470 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:32,493 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:32,517 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:32,536 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:32,552 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:32,571 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:32,599 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:32,621 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:32,638 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:32,655 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:32,676 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:32,701 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:32,726 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:32,747 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:32,767 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:32,796 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:32,823 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:32,841 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:32,859 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:32,876 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:32,901 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:32,919 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:32,940 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:32,963 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:33,008 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:33,030 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:33,047 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:33,063 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:33,097 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:33,124 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:33,144 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:33,161 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:33,185 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:33,217 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:33,241 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:33,259 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:33,283 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:33,315 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:33,342 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:33,359 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:33,386 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:33,413 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:33,434 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:33,450 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:33,473 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:33,502 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:33,525 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:33,543 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:33,562 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:33,590 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:33,615 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:33,634 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:33,651 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:33,665 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:33,688 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:33,709 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:33,727 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:33,746 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:33,763 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:33,791 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:33,814 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:33,835 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:33,852 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:33,876 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:33,897 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:33,918 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:33,937 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:33,954 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:33,973 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:33,996 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:34,029 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:34,051 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:34,070 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:34,114 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:34,133 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:34,179 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:34,212 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:34,231 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:34,248 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:34,266 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:34,295 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:34,318 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:34,338 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:34,357 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:34,379 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:34,408 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:34,426 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:34,446 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:34,463 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:34,493 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:34,517 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:34,539 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:34,557 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:34,584 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:34,615 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:34,632 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:34,650 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:34,674 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:34,700 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:34,724 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:34,743 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:34,768 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:34,802 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:34,823 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:34,842 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:34,860 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:34,882 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:34,908 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:34,929 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:34,947 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:34,973 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:35,003 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:35,025 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:35,045 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:35,089 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:35,124 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:35,141 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:35,159 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:35,209 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:35,227 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:35,247 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:35,267 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:35,302 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:35,324 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:35,340 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:35,354 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:35,381 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:35,415 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:35,435 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:35,452 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:35,473 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:35,497 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:35,522 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:35,540 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:35,557 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:35,576 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:35,601 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:35,621 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:35,639 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:35,658 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:35,687 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:35,717 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:35,738 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:35,757 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:35,777 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:35,806 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:35,828 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:35,849 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:35,866 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:35,895 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:35,921 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:35,940 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:35,958 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:35,979 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:35,999 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:36,025 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:36,043 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:36,061 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:36,083 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:36,107 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:36,130 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:36,151 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:36,178 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:36,218 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:36,237 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:36,256 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:36,284 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:36,320 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:36,338 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:36,355 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:36,378 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:36,405 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:36,428 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:36,446 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:36,465 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:36,492 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:36,513 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:36,531 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:36,550 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:36,568 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:36,597 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:36,622 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:36,641 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:36,662 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:36,689 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:36,713 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:36,730 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:36,749 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:36,766 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:36,793 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:36,820 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:36,840 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:36,868 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:36,893 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:36,917 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:36,936 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:36,955 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:36,977 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:37,018 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:37,034 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:37,051 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:37,066 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:37,093 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:37,117 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:37,134 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:37,152 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:37,168 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:37,197 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:37,239 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:37,254 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:37,280 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:37,308 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:37,330 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:37,347 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:37,364 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:37,386 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:37,409 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:37,428 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:37,450 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:37,470 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:37,495 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:37,520 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:37,537 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:37,553 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:37,575 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:37,599 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:37,620 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:37,638 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:37,658 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:37,677 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:37,711 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:37,736 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:37,751 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:37,769 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:37,792 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:37,815 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:37,847 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:37,861 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:37,881 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:37,904 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:37,928 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:37,948 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:37,965 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:37,988 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:38,009 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:38,027 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:38,043 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:38,061 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:38,094 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:38,117 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:38,137 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:38,152 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:38,173 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:38,197 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:38,220 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:38,241 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:38,263 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:38,288 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:38,312 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:38,335 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:38,353 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:38,371 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:38,392 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:38,418 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:38,440 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:38,460 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:38,478 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:38,504 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:38,529 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:38,548 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:38,565 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:38,587 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:38,618 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:38,638 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:38,658 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:38,679 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:38,702 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:38,721 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:38,737 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:38,754 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:38,775 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022-05-25 17:57:38,800 DEBUG [default] [void ReduceResultData(std::vector&, int64_t, int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/reduce_c.cpp:131] [SEGCORE][ReduceResultData][milvus] skip duplicated search result, count = 0 2022/05/25 18:02:39 maxprocs: Updating GOMAXPROCS=24: determined from CPU quota

__  _________ _   ____  ______    

/ |/ / / /| | / / / / / __/
/ /|
/ // // /| |/ / // /\ \
// /////_/__/

Welcome to use Milvus! Version: v2.0.2 Built: Sat Apr 2 03:29:24 UTC 2022 GitCommit: 898533c5 GoVersion: go version go1.16.9 linux/amd64

open pid file: /run/milvus/standalone.pid lock pid file: /run/milvus/standalone.pid [2022/05/25 18:02:39.527 +08:00] [DEBUG] [base_table.go:78] ["config directory"] [configDir=/milvus/configs/] [2022/05/25 18:02:39.528 +08:00] [DEBUG] [component_param.go:592] ["init cacheSize"] ["cacheSize (GB)"=0] [2022/05/25 18:02:39.528 +08:00] [DEBUG] [component_param.go:624] ["query node init gracefulTime"] [gracefulTime=0] [2022/05/25 18:02:39.528 +08:00] [DEBUG] [base_table.go:78] ["config directory"] [configDir=/milvus/configs/] [2022/05/25 18:02:39.529 +08:00] [DEBUG] [global_rmq.go:55] ["initializing global rmq"] [path=/data/milvus/rdb_data] [2022/05/25 18:02:39.530 +08:00] [DEBUG] [global_rmq.go:98] [RocksmqRetentionTimeInMinutes=1440] [RocksmqRetentionSizeInMB=8192] [RocksmqPageSize=2147483648] [2022/05/25 18:02:39.530 +08:00] [DEBUG] [rocksmq_impl.go:157] ["Start rocksmq "] ["max proc"=24] [parallism=2] [2022/05/25 18:02:39.573 +08:00] [INFO] [tso.go:121] ["sync and save timestamp"] [last=0001/01/01 00:00:00.000 +00:00] [save=2022/05/25 18:02:42.573 +08:00] [next=2022/05/25 18:02:39.573 +08:00] [2022/05/25 18:02:39.573 +08:00] [DEBUG] [rocksmq_retention.go:88] ["Rocksmq retention goroutine start!"] [2022/05/25 18:02:39.574 +08:00] [DEBUG] [base_table.go:78] ["config directory"] [configDir=/milvus/configs/] [2022/05/25 18:02:39.576 +08:00] [DEBUG] [component_param.go:592] ["init cacheSize"] ["cacheSize (GB)"=0] [2022/05/25 18:02:39.576 +08:00] [DEBUG] [component_param.go:624] ["query node init gracefulTime"] [gracefulTime=0] [2022/05/25 18:02:39.576 +08:00] [DEBUG] [base_table.go:78] ["config directory"] [configDir=/milvus/configs/] [2022/05/25 18:02:39.576 +08:00] [DEBUG] [base_table.go:78] ["config directory"] [configDir=/milvus/configs/] [2022/05/25 18:02:39.578 +08:00] [DEBUG] [grpc_param.go:118] [initServerMaxSendSize] [role=rootcoord] [grpc.serverMaxSendSize=2147483647] [2022/05/25 18:02:39.578 +08:00] [DEBUG] [grpc_param.go:141] [initServerMaxRecvSize] [role=rootcoord] [grpc.serverMaxRecvSize=2147483647] [2022/05/25 18:02:39.578 +08:00] [DEBUG] [service.go:156] ["init params done.."] [2022/05/25 18:02:39.579 +08:00] [DEBUG] [service.go:168] ["etcd connect done ..."] [2022/05/25 18:02:39.579 +08:00] [DEBUG] [service.go:241] ["start grpc "] [port=53100] [2022/05/25 18:02:39.580 +08:00] [DEBUG] [component_param.go:592] ["init cacheSize"] ["cacheSize (GB)"=0] [2022/05/25 18:02:39.580 +08:00] [DEBUG] [component_param.go:624] ["query node init gracefulTime"] [gracefulTime=0] [2022/05/25 18:02:39.580 +08:00] [DEBUG] [proxy.go:115] ["create a new Proxy instance"] [module=Proxy] [state=Abnormal] [2022/05/25 18:02:39.580 +08:00] [DEBUG] [service.go:170] ["init Proxy server"] [2022/05/25 18:02:39.581 +08:00] [DEBUG] [base_table.go:78] ["config directory"] [configDir=/milvus/configs/] [2022/05/25 18:02:39.581 +08:00] [DEBUG] [base_table.go:78] ["config directory"] [configDir=/milvus/configs/] [2022/05/25 18:02:39.583 +08:00] [DEBUG] [component_param.go:592] ["init cacheSize"] ["cacheSize (GB)"=0] [2022/05/25 18:02:39.583 +08:00] [DEBUG] [component_param.go:624] ["query node init gracefulTime"] [gracefulTime=0] [2022/05/25 18:02:39.584 +08:00] [DEBUG] [query_coord.go:302] ["query coordinator"] [queryChannels="[{}]"] [2022/05/25 18:02:39.584 +08:00] [DEBUG] [base_table.go:78] ["config directory"] [configDir=/milvus/configs/] [2022/05/25 18:02:39.584 +08:00] [DEBUG] [grpc_param.go:118] [initServerMaxSendSize] [role=proxy] [grpc.serverMaxSendSize=536870912] [2022/05/25 18:02:39.584 +08:00] [DEBUG] [grpc_param.go:141] [initServerMaxRecvSize] [role=proxy] [grpc.serverMaxRecvSize=536870912] [2022/05/25 18:02:39.584 +08:00] [DEBUG] [service.go:189] ["Proxy init service's parameter table done"] [2022/05/25 18:02:39.584 +08:00] [DEBUG] [base_table.go:78] ["config directory"] [configDir=/milvus/configs/] [2022/05/25 18:02:39.584 +08:00] [DEBUG] [base_table.go:78] ["config directory"] [configDir=/milvus/configs/] [2022/05/25 18:02:39.586 +08:00] [DEBUG] [service.go:191] ["Proxy init http server's parameter table done"] [2022/05/25 18:02:39.586 +08:00] [DEBUG] [service.go:200] ["init Proxy's parameter table done"] [address=10.164.1.86:19530] [2022/05/25 18:02:39.586 +08:00] [DEBUG] [service.go:205] ["init Proxy's tracer done"] ["service name"="Proxy ip: 10.164.1.86, port: 19530"] [2022/05/25 18:02:39.586 +08:00] [DEBUG] [component_param.go:592] ["init cacheSize"] ["cacheSize (GB)"=0] [2022/05/25 18:02:39.587 +08:00] [DEBUG] [component_param.go:624] ["query node init gracefulTime"] [gracefulTime=0] [2022/05/25 18:02:39.587 +08:00] [DEBUG] [service.go:216] ["waiting for grpc server of Proxy to be started"] [2022/05/25 18:02:39.587 +08:00] [DEBUG] [service.go:131] ["Proxy server listen on tcp"] [port=19530] [2022/05/25 18:02:39.587 +08:00] [DEBUG] [service.go:138] ["Proxy server already listen on tcp"] [port=19530] [2022/05/25 18:02:39.587 +08:00] [DEBUG] [service.go:154] ["create Proxy grpc server"] ["enforcement policy"="{"MinTime":5000000000,"PermitWithoutStream":true}"] ["server parameters"="{"MaxConnectionIdle":0,"MaxConnectionAge":0,"MaxConnectionAgeGrace":0,"Time":60000000000,"Timeout":10000000000}"] [2022/05/25 18:02:39.587 +08:00] [DEBUG] [service.go:158] ["waiting for Proxy grpc server to be ready"] [2022/05/25 18:02:39.587 +08:00] [DEBUG] [service.go:161] ["Proxy grpc server has been ready, serve grpc requests on listen"] [2022/05/25 18:02:39.587 +08:00] [DEBUG] [base_table.go:78] ["config directory"] [configDir=/milvus/configs/] [2022/05/25 18:02:39.587 +08:00] [DEBUG] [base_table.go:78] ["config directory"] [configDir=/milvus/configs/] [2022/05/25 18:02:39.589 +08:00] [DEBUG] [grpc_param.go:118] [initServerMaxSendSize] [role=querycoord] [grpc.serverMaxSendSize=2147483647] [2022/05/25 18:02:39.589 +08:00] [DEBUG] [grpc_param.go:141] [initServerMaxRecvSize] [role=querycoord] [grpc.serverMaxRecvSize=2147483647] [2022/05/25 18:02:39.589 +08:00] [DEBUG] [service.go:244] [network] [port=19531] [2022/05/25 18:02:39.589 +08:00] [DEBUG] [grpc_param.go:118] [initServerMaxSendSize] [role=querynode] [grpc.serverMaxSendSize=2147483647] [2022/05/25 18:02:39.589 +08:00] [DEBUG] [grpc_param.go:141] [initServerMaxRecvSize] [role=querynode] [grpc.serverMaxRecvSize=2147483647] [2022/05/25 18:02:39.589 +08:00] [DEBUG] [service.go:99] [QueryNode] [port=21123] [2022/05/25 18:02:39.590 +08:00] [DEBUG] [service.go:108] ["QueryNode connect to etcd successfully"] [2022/05/25 18:02:39.590 +08:00] [DEBUG] [component_param.go:592] ["init cacheSize"] ["cacheSize (GB)"=0] [2022/05/25 18:02:39.590 +08:00] [DEBUG] [component_param.go:624] ["query node init gracefulTime"] [gracefulTime=0] [2022/05/25 18:02:39.590 +08:00] [DEBUG] [base_table.go:78] ["config directory"] [configDir=/milvus/configs/] [2022/05/25 18:02:39.590 +08:00] [DEBUG] [base_table.go:78] ["config directory"] [configDir=/milvus/configs/] [2022/05/25 18:02:39.594 +08:00] [DEBUG] [grpc_param.go:118] [initServerMaxSendSize] [role=datacoord] [grpc.serverMaxSendSize=2147483647] [2022/05/25 18:02:39.594 +08:00] [DEBUG] [grpc_param.go:141] [initServerMaxRecvSize] [role=datacoord] [grpc.serverMaxRecvSize=2147483647] [2022/05/25 18:02:39.594 +08:00] [DEBUG] [service.go:125] ["network port"] [port=13333] [2022/05/25 18:02:39.595 +08:00] [DEBUG] [component_param.go:592] ["init cacheSize"] ["cacheSize (GB)"=0] [2022/05/25 18:02:39.595 +08:00] [DEBUG] [component_param.go:624] ["query node init gracefulTime"] [gracefulTime=0] [2022/05/25 18:02:39.595 +08:00] [DEBUG] [base_table.go:78] ["config directory"] [configDir=/milvus/configs/] [2022/05/25 18:02:39.595 +08:00] [DEBUG] [base_table.go:78] ["config directory"] [configDir=/milvus/configs/] [2022/05/25 18:02:39.596 +08:00] [DEBUG] [component_param.go:592] ["init cacheSize"] ["cacheSize (GB)"=0] [2022/05/25 18:02:39.596 +08:00] [DEBUG] [component_param.go:624] ["query node init gracefulTime"] [gracefulTime=0] [2022/05/25 18:02:39.596 +08:00] [DEBUG] [grpc_param.go:118] [initServerMaxSendSize] [role=datanode] [grpc.serverMaxSendSize=2147483647] [2022/05/25 18:02:39.596 +08:00] [DEBUG] [grpc_param.go:141] [initServerMaxRecvSize] [role=datanode] [grpc.serverMaxRecvSize=2147483647] [2022/05/25 18:02:39.596 +08:00] [DEBUG] [base_table.go:78] ["config directory"] [configDir=/milvus/configs/] [2022/05/25 18:02:39.596 +08:00] [DEBUG] [base_table.go:78] ["config directory"] [configDir=/milvus/configs/] [2022/05/25 18:02:39.597 +08:00] [DEBUG] [service.go:238] ["DataNode address"] [address=10.164.1.86:21124] [2022/05/25 18:02:39.598 +08:00] [DEBUG] [grpc_param.go:118] [initServerMaxSendSize] [role=indexcoord] [grpc.serverMaxSendSize=2147483647] [2022/05/25 18:02:39.598 +08:00] [DEBUG] [grpc_param.go:141] [initServerMaxRecvSize] [role=indexcoord] [grpc.serverMaxRecvSize=2147483647] [2022/05/25 18:02:39.598 +08:00] [DEBUG] [service.go:215] [IndexCoord] ["network address"=10.164.1.86] ["network port"=31000] [2022/05/25 18:02:39.598 +08:00] [DEBUG] [component_param.go:592] ["init cacheSize"] ["cacheSize (GB)"=0] [2022/05/25 18:02:39.598 +08:00] [DEBUG] [component_param.go:624] ["query node init gracefulTime"] [gracefulTime=0] [2022/05/25 18:02:39.598 +08:00] [DEBUG] [indexnode.go:105] ["New IndexNode ..."] [2022/05/25 18:02:39.599 +08:00] [DEBUG] [base_table.go:78] ["config directory"] [configDir=/milvus/configs/] [2022/05/25 18:02:39.600 +08:00] [DEBUG] [grpc_param.go:118] [initServerMaxSendSize] [role=indexnode] [grpc.serverMaxSendSize=2147483647] [2022/05/25 18:02:39.600 +08:00] [DEBUG] [grpc_param.go:141] [initServerMaxRecvSize] [role=indexnode] [grpc.serverMaxRecvSize=2147483647] [2022/05/25 18:02:39.600 +08:00] [DEBUG] [service.go:82] [IndexNode] ["network address"=10.164.1.86:21121] ["network port: "=21121] [2022/05/25 18:02:39.681 +08:00] [DEBUG] [service.go:174] ["grpc init done ..."] [2022/05/25 18:02:39.681 +08:00] [DEBUG] [service.go:177] [RootCoord] [State=Initializing] [2022/05/25 18:02:39.681 +08:00] [DEBUG] [service.go:195] ["RootCoord start to create DataCoord client"] [2022/05/25 18:02:39.681 +08:00] [DEBUG] [session_util.go:86] ["Session try to connect to etcd"] [2022/05/25 18:02:39.683 +08:00] [DEBUG] [session_util.go:101] ["Session connect to etcd success"] [2022/05/25 18:02:39.683 +08:00] [DEBUG] [base_table.go:78] ["config directory"] [configDir=/milvus/configs/] [2022/05/25 18:02:39.685 +08:00] [DEBUG] [grpc_param.go:186] [initClientMaxSendSize] [role=datacoord] [grpc.clientMaxSendSize=104857600] [2022/05/25 18:02:39.685 +08:00] [DEBUG] [grpc_param.go:209] [initClientMaxRecvSize] [role=datacoord] [grpc.clientMaxRecvSize=104857600] [2022/05/25 18:02:39.685 +08:00] [DEBUG] [service.go:203] ["RootCoord start to create IndexCoord client"] [2022/05/25 18:02:39.685 +08:00] [DEBUG] [session_util.go:86] ["Session try to connect to etcd"] [2022/05/25 18:02:39.685 +08:00] [DEBUG] [root_coord.go:588] ["RootCoord connected to DataCoord"] [2022/05/25 18:02:39.686 +08:00] [DEBUG] [session_util.go:101] ["Session connect to etcd success"] [2022/05/25 18:02:39.686 +08:00] [DEBUG] [base_table.go:78] ["config directory"] [configDir=/milvus/configs/] [2022/05/25 18:02:39.689 +08:00] [DEBUG] [service.go:221] ["grpc server of proxy has been started"] [2022/05/25 18:02:39.689 +08:00] [INFO] [service.go:223] ["start http server of proxy"] [port=8080] [2022/05/25 18:02:39.689 +08:00] [DEBUG] [service.go:230] ["create RootCoord client for Proxy"] [2022/05/25 18:02:39.689 +08:00] [DEBUG] [session_util.go:86] ["Session try to connect to etcd"] [GIN-debug] [WARNING] Creating an Engine instance with the Logger and Recovery middleware already attached.

[GIN-debug] [WARNING] Running in "debug" mode. Switch to "release" mode in production.

  • using env: export GIN_MODE=release
  • using code: gin.SetMode(gin.ReleaseMode)

[GIN-debug] GET /api/v1/health --> github.com/milvus-io/milvus/internal/distributed/proxy/httpserver.wrapHandler.func1 (3 handlers) [GIN-debug] POST /api/v1/dummy --> github.com/milvus-io/milvus/internal/distributed/proxy/httpserver.wrapHandler.func1 (3 handlers) [2022/05/25 18:02:39.690 +08:00] [DEBUG] [service.go:118] [QueryNode] [State=Initializing] [2022/05/25 18:02:39.690 +08:00] [DEBUG] [query_node.go:261] ["QueryNode session info"] [metaPath=by-dev-test-test/meta] [2022/05/25 18:02:39.690 +08:00] [DEBUG] [session_util.go:86] ["Session try to connect to etcd"] [2022/05/25 18:02:39.690 +08:00] [DEBUG] [session_util.go:86] ["Session try to connect to etcd"] [2022/05/25 18:02:39.690 +08:00] [DEBUG] [session_util.go:101] ["Session connect to etcd success"] [2022/05/25 18:02:39.691 +08:00] [DEBUG] [base_table.go:78] ["config directory"] [configDir=/milvus/configs/] [2022/05/25 18:02:39.692 +08:00] [DEBUG] [session_util.go:101] ["Session connect to etcd success"] [2022/05/25 18:02:39.692 +08:00] [DEBUG] [session_util.go:101] ["Session connect to etcd success"] [2022/05/25 18:02:39.693 +08:00] [DEBUG] [grpc_param.go:186] [initClientMaxSendSize] [role=indexcoord] [grpc.clientMaxSendSize=104857600] [2022/05/25 18:02:39.693 +08:00] [DEBUG] [grpc_param.go:209] [initClientMaxRecvSize] [role=indexcoord] [grpc.clientMaxRecvSize=104857600] [2022/05/25 18:02:39.693 +08:00] [DEBUG] [service.go:211] ["RootCoord start to create QueryCoord client"] [2022/05/25 18:02:39.693 +08:00] [DEBUG] [session_util.go:86] ["Session try to connect to etcd"] [2022/05/25 18:02:39.693 +08:00] [DEBUG] [root_coord.go:728] ["RootCoord connected to IndexCoord"] [2022/05/25 18:02:39.693 +08:00] [DEBUG] [grpc_param.go:186] [initClientMaxSendSize] [role=rootcoord] [grpc.clientMaxSendSize=104857600] [2022/05/25 18:02:39.693 +08:00] [DEBUG] [grpc_param.go:209] [initClientMaxRecvSize] [role=rootcoord] [grpc.clientMaxRecvSize=104857600] [2022/05/25 18:02:39.693 +08:00] [DEBUG] [service.go:236] ["create RootCoord client for Proxy done"] [2022/05/25 18:02:39.694 +08:00] [DEBUG] [service.go:239] ["init RootCoord client for Proxy"] [2022/05/25 18:02:39.694 +08:00] [DEBUG] [service.go:244] ["init RootCoord client for Proxy done"] [2022/05/25 18:02:39.694 +08:00] [DEBUG] [service.go:246] ["Proxy wait for RootCoord to be healthy"] [2022/05/25 18:02:39.694 +08:00] [DEBUG] [service.go:153] ["QueryCoord try to wait for RootCoord ready"] [2022/05/25 18:02:39.695 +08:00] [DEBUG] [session_util.go:101] ["Session connect to etcd success"] [2022/05/25 18:02:39.696 +08:00] [WARN] [client.go:93] ["RootCoordClient mess key not exist"] [key=rootcoord] [2022/05/25 18:02:39.696 +08:00] [WARN] [client.go:93] ["RootCoordClient mess key not exist"] [key=rootcoord] [2022/05/25 18:02:39.696 +08:00] [DEBUG] [base_table.go:78] ["config directory"] [configDir=/milvus/configs/] [2022/05/25 18:02:39.696 +08:00] [ERROR] [client.go:131] ["failed to get client address"] [error="find no available rootcoord, check rootcoord state"] [stack="github.com/milvus-io/milvus/internal/util/grpcclient.(*ClientBase).connect\n\t/go/src/github.com/milvus-io/milvus/internal/util/grpcclient/client.go:131\ngithub.com/milvus-io/milvus/internal/util/grpcclient.(*ClientBase).GetGrpcClient\n\t/go/src/github.com/milvus-io/milvus/internal/util/grpcclient/client.go:103\ngithub.com/milvus-io/milvus/internal/util/grpcclient.(*ClientBase).callOnce\n\t/go/src/github.com/milvus-io/milvus/internal/util/grpcclient/client.go:193\ngithub.com/milvus-io/milvus/internal/util/grpcclient.(*ClientBase).ReCall\n\t/go/src/github.com/milvus-io/milvus/internal/util/grpcclient/client.go:239\ngithub.com/milvus-io/milvus/internal/distributed/rootcoord/client.(*Client).GetComponentStates\n\t/go/src/github.com/milvus-io/milvus/internal/distributed/rootcoord/client/client.go:117\ngithub.com/milvus-io/milvus/internal/util/funcutil.WaitForComponentStates.func1\n\t/go/src/github.com/milvus-io/milvus/internal/util/funcutil/func.go:59\ngithub.com/milvus-io/milvus/internal/util/retry.Do\n\t/go/src/github.com/milvus-io/milvus/internal/util/retry/retry.go:34\ngithub.com/milvus-io/milvus/internal/util/funcutil.WaitForComponentStates\n\t/go/src/github.com/milvus-io/milvus/internal/util/funcutil/func.go:83\ngithub.com/milvus-io/milvus/internal/util/funcutil.WaitForComponentHealthy\n\t/go/src/github.com/milvus-io/milvus/internal/util/funcutil/func.go:98\ngithub.com/milvus-io/milvus/internal/distributed/proxy.(*Server).init\n\t/go/src/github.com/milvus-io/milvus/internal/distributed/proxy/service.go:247\ngithub.com/milvus-io/milvus/internal/distributed/proxy.(*Server).Run\n\t/go/src/github.com/milvus-io/milvus/internal/distributed/proxy/service.go:171\ngithub.com/milvus-io/milvus/cmd/components.(*Proxy).Run\n\t/go/src/github.com/milvus-io/milvus/cmd/components/proxy.go:49\ngithub.com/milvus-io/milvus/cmd/roles.(*MilvusRoles).runProxy.func1\n\t/go/src/github.com/milvus-io/milvus/cmd/roles/roles.go:147"] [2022/05/25 18:02:39.696 +08:00] [ERROR] [client.go:131] ["failed to get client address"] [error="find no available rootcoord, check rootcoord state"] [stack="github.com/milvus-io/milvus/internal/util/grpcclient.(*ClientBase).connect\n\t/go/src/github.com/milvus-io/milvus/internal/util/grpcclient/client.go:131\ngithub.com/milvus-io/milvus/internal/util/grpcclient.(*ClientBase).GetGrpcClient\n\t/go/src/github.com/milvus-io/milvus/internal/util/grpcclient/client.go:103\ngithub.com/milvus-io/milvus/internal/util/grpcclient.(*ClientBase).callOnce\n\t/go/src/github.com/milvus-io/milvus/internal/util/grpcclient/client.go:193\ngithub.com/milvus-io/milvus/internal/util/grpcclient.(*ClientBase).ReCall\n\t/go/src/github.com/milvus-io/milvus/internal/util/grpcclient/client.go:239\ngithub.com/milvus-io/milvus/internal/distributed/rootcoord/client.(*Client).GetComponentStates\n\t/go/src/github.com/milvus-io/milvus/internal/distributed/rootcoord/client/client.go:117\ngithub.com/milvus-io/milvus/internal/util/funcutil.WaitForComponentStates.func1\n\t/go/src/github.com/milvus-io/milvus/internal/util/funcutil/func.go:59\ngithub.com/milvus-io/milvus/internal/util/retry.Do\n\t/go/src/github.com/milvus-io/milvus/internal/util/retry/retry.go:34\ngithub.com/milvus-io/milvus/internal/util/funcutil.WaitForComponentStates\n\t/go/src/github.com/milvus-io/milvus/internal/util/funcutil/func.go:83\ngithub.com/milvus-io/milvus/internal/util/funcutil.WaitForComponentHealthy\n\t/go/src/github.com/milvus-io/milvus/internal/util/funcutil/func.go:98\ngithub.com/milvus-io/milvus/internal/distributed/querycoord.(*Server).init\n\t/go/src/github.com/milvus-io/milvus/internal/distributed/querycoord/service.go:154\ngithub.com/milvus-io/milvus/internal/distributed/querycoord.(*Server).Run\n\t/go/src/github.com/milvus-io/milvus/internal/distributed/querycoord/service.go:95\ngithub.com/milvus-io/milvus/cmd/components.(*QueryCoord).Run\n\t/go/src/github.com/milvus-io/milvus/cmd/components/query_coord.go:50\ngithub.com/milvus-io/milvus/cmd/roles.(*MilvusRoles).runQueryCoord.func1\n\t/go/src/github.com/milvus-io/milvus/cmd/roles/roles.go:178"] [2022/05/25 18:02:39.696 +08:00] [WARN] [client.go:245] ["rootcoord ClientBase ReCall grpc first call get error "] [error="err: find no available rootcoord, check rootcoord state\n, /go/src/github.com/milvus-io/milvus/internal/util/trace/stack_trace.go:51 github.com/milvus-io/milvus/internal/util/trace.StackTrace\n/go/src/github.com/milvus-io/milvus/internal/util/grpcclient/client.go:244 github.com/milvus-io/milvus/internal/util/grpcclient.(*ClientBase).ReCall\n/go/src/github.com/milvus-io/milvus/internal/distributed/rootcoord/client/client.go:117 github.com/milvus-io/milvus/internal/distributed/rootcoord/client.(*Client).GetComponentStates\n/go/src/github.com/milvus-io/milvus/internal/util/funcutil/func.go:59 github.com/milvus-io/milvus/internal/util/funcutil.WaitForComponentStates.func1\n/go/src/github.com/milvus-io/milvus/internal/util/retry/retry.go:34 github.com/milvus-io/milvus/internal/util/retry.Do\n/go/src/github.com/milvus-io/milvus/internal/util/funcutil/func.go:83 github.com/milvus-io/milvus/internal/util/funcutil.WaitForComponentStates\n/go/src/github.com/milvus-io/milvus/internal/util/funcutil/func.go:98 github.com/milvus-io/milvus/internal/util/funcutil.WaitForComponentHealthy\n/go/src/github.com/milvus-io/milvus/internal/distributed/proxy/service.go:247 github.com/milvus-io/milvus/internal/distributed/proxy.(*Server).init\n/go/src/github.com/milvus-io/milvus/internal/distributed/proxy/service.go:171 github.com/milvus-io/milvus/internal/distributed/proxy.(*Server).Run\n/go/src/github.com/milvus-io/milvus/cmd/components/proxy.go:49 github.com/milvus-io/milvus/cmd/components.(*Proxy).Run\n"] [2022/05/25 18:02:39.696 +08:00] [WARN] [client.go:245] ["rootcoord ClientBase ReCall grpc first call get error "] [error="err: find no available rootcoord, check rootcoord state\n, /go/src/github.com/milvus-io/milvus/internal/util/trace/stack_trace.go:51 github.com/milvus-io/milvus/internal/util/trace.StackTrace\n/go/src/github.com/milvus-io/milvus/internal/util/grpcclient/client.go:244 github.com/milvus-io/milvus/internal/util/grpcclient.(*ClientBase).ReCall\n/go/src/github.com/milvus-io/milvus/internal/distributed/rootcoord/client/client.go:117 github.com/milvus-io/milvus/internal/distributed/rootcoord/client.(*Client).GetComponentStates\n/go/src/github.com/milvus-io/milvus/internal/util/funcutil/func.go:59 github.com/milvus-io/milvus/internal/util/funcutil.WaitForComponentStates.func1\n/go/src/github.com/milvus-io/milvus/internal/util/retry/retry.go:34 github.com/milvus-io/milvus/internal/util/retry.Do\n/go/src/github.com/milvus-io/milvus/internal/util/funcutil/func.go:83 github.com/milvus-io/milvus/internal/util/funcutil.WaitForComponentStates\n/go/src/github.com/milvus-io/milvus/internal/util/funcutil/func.go:98 github.com/milvus-io/milvus/internal/util/funcutil.WaitForComponentHealthy\n/go/src/github.com/milvus-io/milvus/internal/distributed/querycoord/service.go:154 github.com/milvus-io/milvus/internal/distributed/querycoord.(*Server).init\n/go/src/github.com/milvus-io/milvus/internal/distributed/querycoord/service.go:95 github.com/milvus-io/milvus/internal/distributed/querycoord.(Server).Run\n/go/src/github.com/milvus-io/milvus/cmd/components/query_coord.go:50 github.com/milvus-io/milvus/cmd/components.(QueryCoord).Run\n"] [2022/05/25 18:02:39.696 +08:00] [DEBUG] [session_util.go:86] ["Session try to connect to etcd"] [2022/05/25 18:02:39.696 +08:00] [DEBUG] [session_util.go:175] ["Session get serverID success"] [key=id] [ServerId=1] [2022/05/25 18:02:39.696 +08:00] [DEBUG] [base_table.go:438] ["Set logger "] [id=1] [role=standalone] [2022/05/25 18:02:39.696 +08:00] [INFO] [base_table.go:425] ["Set log file to "] [path=/data/milvus/standalone-1.log] [2022/05/25 18:02:39.717 +08:00] [DEBUG] [server.go:300] ["startup success"] [module=DataCoord] 2022-05-25 18:02:39,732 DEBUG [default] [static std::__cxx11::string milvus::engine::KnowhereConfig::SetSimdType(milvus::engine::KnowhereConfig::SimdType)] [../3rdparty_download/knowhere-subbuild/src/knowhere_ep/knowhere/knowhere/archive/KnowhereConfig.cpp:45] [KNOWHERE][SetSimdType][milvus] FAISS expect simdType::AUTO FAISS SQ8 hook AVX512 2022-05-25 18:02:39,733 DEBUG [default] [static std::__cxx11::string milvus::engine::KnowhereConfig::SetSimdType(milvus::engine::KnowhereConfig::SimdType)] [../3rdparty_download/knowhere-subbuild/src/knowhere_ep/knowhere/knowhere/archive/KnowhereConfig.cpp:65] [KNOWHERE][SetSimdType][milvus] FAISS hook AVX512 2022-05-25 18:02:39,741 DEBUG [default] [void milvus::segcore::SegcoreSetChunkRows(int64_t)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/segcore_init_c.cpp:39] [SEGCORE][SegcoreSetChunkRows][milvus] set config chunk_size: 32768 2022-05-25 18:02:39,741 DEBUG [default] [char milvus::segcore::SegcoreSetSimdType(const char)] [/go/src/github.com/milvus-io/milvus/internal/core/src/segcore/segcore_init_c.cpp:45] [SEGCORE][SegcoreSetSimdType][milvus] set config simd_type: auto 2022-05-25 18:02:39,741 DEBUG [default] [static std::__cxx11::string milvus::engine::KnowhereConfig::SetSimdType(milvus::engine::KnowhereConfig::SimdType)] [../3rdparty_download/knowhere-subbuild/src/knowhere_ep/knowhere/knowhere/archive/KnowhereConfig.cpp:45] [KNOWHERE][SetSimdType][milvus] FAISS expect simdType::AUTO FAISS SQ8 hook AVX512 2022-05-25 18:02:39,741 DEBUG [default] [static std::__cxx11::string milvus::engine::KnowhereConfig::SetSimdType(milvus::engine::KnowhereConfig::SimdType)] [../3rdparty_download/knowhere-subbuild/src/knowhere_ep/knowhere/knowhere/archive/KnowhereConfig.cpp:65] [KNOWHERE][SetSimdType][milvus] FAISS hook AVX512

StevenSama avatar May 27 '22 06:05 StevenSama

The above memory usage graph and the corresponding log output are as above

StevenSama avatar May 27 '22 06:05 StevenSama

querying is not

Does this issue only occur when testing with javasdk? @StevenSama

Just reproduced, this situation can also be reproduced through milvus_cli

StevenSama avatar May 27 '22 06:05 StevenSama

@yanliang567 @xige-16 @StevenSama I tried to reproduce in both pymilvus and milvus-sdk-java 2.0.4, but neither reproduced. Could you take a look at how this reproduction step differs from yours? Below are my steps to reproduce:

  1. Deploy milvus standalone v2.0.2 and limit resources
cpu:     24
memory:  32Gi
  1. Create a collection with a int64 filed and a float vector filed, which dim is 768. Then insert 100000 entities and create index with param {"index_type": "IVF_SQ8", "metric_type": "IP", "params": {"nlist": 256}}
  2. Load collection
  3. Start multiple threads to loop query and delete
import io.milvus.client.MilvusServiceClient;
import io.milvus.grpc.DataType;
import io.milvus.grpc.GetCollectionStatisticsResponse;
import io.milvus.grpc.MutationResult;
import io.milvus.grpc.QueryResults;
import io.milvus.param.ConnectParam;
import io.milvus.param.R;
import io.milvus.param.collection.*;
import io.milvus.param.dml.DeleteParam;
import io.milvus.param.dml.InsertParam;
import io.milvus.param.dml.QueryParam;
import io.milvus.response.GetCollStatResponseWrapper;

import java.util.ArrayList;
import java.util.Collections;
import java.util.List;
import java.util.Random;
import java.util.concurrent.ExecutorService;
import java.util.concurrent.Executors;


public class MyMilvus {
    private String  collectionName;
    int dim = 768;
    int nb = 100000;

    public MyMilvus(String collectionName) {
        this.collectionName = collectionName;
    }

    private void insert (MilvusServiceClient milvusClient, int nb){
        Random ran = new Random();
        List<Long> ids_values = new ArrayList<>();
        List<List<Float>> float_vec_values = new ArrayList<>();
        for (long i = 0L; i < nb; ++i) {
            ids_values.add(i);
            List<Float> vector = new ArrayList<>();
            for (int k = 0; k < dim; ++k) {
                vector.add(ran.nextFloat());
            }
            float_vec_values.add(vector);
        }

        List<InsertParam.Field> fields = new ArrayList<>();
        fields.add(new InsertParam.Field("int64", DataType.Int64, ids_values));
        fields.add(new InsertParam.Field("float_vec", DataType.FloatVector, float_vec_values));

        InsertParam insertParam = InsertParam.newBuilder()
                .withCollectionName(collectionName)
                .withFields(fields)
                .build();
        milvusClient.insert(insertParam);
    }

    private void query (MilvusServiceClient milvusClient) {
        for(int i=0; i<1000; i++) {
            int randId = new Random().nextInt(nb + 1);
            System.out.println("Query id: " + randId);
            String expr = "int64 in [" + randId + "]";
            QueryParam queryParam = QueryParam.newBuilder()
                    .withCollectionName(collectionName)
                    .withExpr(expr)
                    .withOutFields(Collections.singletonList("int64"))
                    .build();
            R<QueryResults> respQuery = milvusClient.query(queryParam);
            System.out.println(respQuery);
        }
    }

    private void delete (MilvusServiceClient milvusClient) {
        for(int i=0; i<1000; i++) {
            int randId = new Random().nextInt(nb + 1);
            System.out.println("Delete id: " + randId);
            String expr = "int64 in [" + randId + "]";
            DeleteParam deleteParam = DeleteParam.newBuilder().withCollectionName(collectionName).withExpr(expr).build();
            R<MutationResult> resDelete = milvusClient.delete(deleteParam);
            System.out.println(resDelete);
        }
    }

    private void load (MilvusServiceClient milvusClient) {
        milvusClient.loadCollection(
                LoadCollectionParam.newBuilder()
                        .withCollectionName(collectionName)
                        .build()
        );
    }

    public static void main(String[] args)
    {
        String host = "10.98.0.8";
        int port = 19530;
        String collectionName = "test_issue";

        MyMilvus myMilvus = new MyMilvus(collectionName);
        System.out.println("hello milvus");
        final MilvusServiceClient milvusClient = new MilvusServiceClient(
                ConnectParam.newBuilder()
                        .withHost(host)
                        .withPort(port)
                        .build()
        );
        R <GetCollectionStatisticsResponse> respCollectionStatistics = milvusClient.getCollectionStatistics(
                // Return the statistics information of the collection.
                GetCollectionStatisticsParam.newBuilder()
                        .withCollectionName(collectionName)
                        .build()
        );
        GetCollStatResponseWrapper wrapperCollectionStatistics = new GetCollStatResponseWrapper(respCollectionStatistics.getData());
        System.out.println("Collection row count: " + wrapperCollectionStatistics.getRowCount());

        myMilvus.load(milvusClient);
        myMilvus.query(milvusClient);

        ExecutorService executor= Executors.newFixedThreadPool(4);
        executor.submit(() -> {
            System.out.println("thread id is: " + Thread.currentThread().getId());
            myMilvus.query(milvusClient);
        });
        executor.submit(() -> {
            System.out.println("thread id is: " + Thread.currentThread().getId());
            myMilvus.delete(milvusClient);
        });
        executor.shutdown();
    }
}

The standalone pod memory usage: image

ThreadDao avatar May 27 '22 11:05 ThreadDao

@StevenSama could you please check the reproduce code above?

/assign @StevenSama

yanliang567 avatar May 27 '22 11:05 yanliang567

@StevenSama could you please check the reproduce code above?

/assign @StevenSama

Increase the number of concurrent queries and the total number of queries, so that the queries are fully loaded at the same time, and then delete or add a batch of vectors. Do not stop the query, and the memory will explode directly.

StevenSama avatar May 28 '22 06:05 StevenSama

@StevenSama could you please check the reproduce code above?

/assign @StevenSama

The number of concurrent queries in the sample code is not enough, and the total number of queries is not enough. First, start high-concurrency queries and keep them all the time, and then change the set, and the memory increase is more obvious.

StevenSama avatar May 28 '22 06:05 StevenSama

@StevenSama so how much concurrent queries did you run to reproduce the issue?

yanliang567 avatar May 28 '22 09:05 yanliang567

@StevenSama so how much concurrent queries did you run to reproduce the issue?

What I tested is about 200 concurrency, and it is reasonable to say that this concurrency should also appear. It may be a little later. Can you provide your complete code and I will run it on my environment to see if it can be reproduced?

StevenSama avatar May 30 '22 01:05 StevenSama

/assign @yelusion2 could you please take a look at this issue, it seems to be a java sdk specific issue.

yanliang567 avatar May 30 '22 05:05 yanliang567

@yanliang567: GitHub didn't allow me to assign the following users: yelusion2.

Note that only milvus-io members, repo collaborators and people who have commented on this issue/PR can be assigned. Additionally, issues/PRs can only have 10 assignees at the same time. For more information please see the contributor guide

In response to this:

/assign @yelusion2 could you please take a look at this issue, it seems to be a java sdk specific issue.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

sre-ci-robot avatar May 30 '22 05:05 sre-ci-robot

this situation also be reproduced through milvus_cli, so it seems not a java sdk specific issue.

yelusion2 avatar May 30 '22 06:05 yelusion2

@StevenSama so how much concurrent queries did you run to reproduce the issue?

might because pymilvus doesn't support true concurrency?

xiaofan-luan avatar May 30 '22 06:05 xiaofan-luan

@yelusion2 could you list a way to reproduce this case?

xiaofan-luan avatar May 30 '22 06:05 xiaofan-luan

I just saw this issue, I will reproduce the problem as soon as possible.

yelusion2 avatar May 30 '22 06:05 yelusion2