milvus icon indicating copy to clipboard operation
milvus copied to clipboard

Published 20 hours ago • verified publisher icon milvus-io

[Bug]: CI num_entities=0

Open XuanYang-cn opened this issue 9 months ago • 3 comments

Is there an existing issue for this?

  • [X] I have searched the existing issues

Environment

- Milvus version:
- Deployment mode(standalone or cluster):
- MQ type(rocksmq, pulsar or kafka):    
- SDK version(e.g. pymilvus v2.0.0rc2):
- OS(Ubuntu or CentOS): 
- CPU/Memory: 
- GPU: 
- Others:

Current Behavior

https://jenkins.milvus.io:18080/blue/organizations/jenkins/Milvus%20HA%20CI/detail/PR-32788/2/pipeline/


[2024-05-08T07:28:54.646Z] =================================== FAILURES ===================================

[2024-05-08T07:28:54.646Z] __________ TestIndexString.test_create_index_with_string_before_load ___________

[2024-05-08T07:28:54.646Z] [gw1] linux -- Python 3.8.17 /usr/local/bin/python3

[2024-05-08T07:28:54.646Z] [gw1] linux -- Python 3.8.17 /usr/local/bin/python3[gw1] linux -- Python 3.8.17 /usr/local/bin/python3

[2024-05-08T07:28:54.647Z] 

[2024-05-08T07:28:54.647Z] self = <test_index.TestIndexString object at 0x7efbf99eedf0>

[2024-05-08T07:28:54.647Z] 

[2024-05-08T07:28:54.647Z]     @pytest.mark.tags(CaseLabel.L1)

[2024-05-08T07:28:54.647Z]     def test_create_index_with_string_before_load(self):

[2024-05-08T07:28:54.647Z]         """

[2024-05-08T07:28:54.647Z]         target: test create index with string field before load

[2024-05-08T07:28:54.647Z]         method: 1.create collection and insert data

[2024-05-08T07:28:54.647Z]                 2.create an index with string field before load

[2024-05-08T07:28:54.647Z]         expected: create index successfully

[2024-05-08T07:28:54.647Z]         """

[2024-05-08T07:28:54.647Z]         c_name = cf.gen_unique_str(prefix)

[2024-05-08T07:28:54.647Z]         collection_w = self.init_collection_wrap(name=c_name)

[2024-05-08T07:28:54.647Z]         data = cf.gen_default_list_data(ct.default_nb)

[2024-05-08T07:28:54.647Z]         collection_w.insert(data=data)

[2024-05-08T07:28:54.647Z]         index, _ = self.index_wrap.init_index(collection_w.collection, default_string_field_name,

[2024-05-08T07:28:54.647Z]                                               default_string_index_params)

[2024-05-08T07:28:54.647Z]         cf.assert_equal_index(index, collection_w.indexes[0])

[2024-05-08T07:28:54.647Z]         collection_w.create_index(ct.default_float_vec_field_name, index_params=ct.default_flat_index, index_name="vector_flat")

[2024-05-08T07:28:54.647Z]         collection_w.load()

[2024-05-08T07:28:54.647Z] >       assert collection_w.num_entities == default_nb

[2024-05-08T07:28:54.647Z] E       assert 0 == 2000

[2024-05-08T07:28:54.647Z] E        +  where 0 = <base.collection_wrapper.ApiCollectionWrapper object at 0x7efbc40a2d60>.num_entities

[2024-05-08T07:28:54.647Z] 

[2024-05-08T07:28:54.647Z] testcases/test_index.py:1782: AssertionError

[2024-05-08T07:28:54.647Z] ------------------------------ Captured log setup ------------------------------

[2024-05-08T07:28:54.647Z] [2024-05-08 07:28:33 - INFO - ci_test]: *********************************** setup *********************************** (client_base.py:44)

[2024-05-08T07:28:54.647Z] [2024-05-08 07:28:33 - INFO - ci_test]: [setup_method] Start setup test case test_create_index_with_string_before_load. (client_base.py:45)

[2024-05-08T07:28:54.647Z] ------------------------------ Captured log call -------------------------------

[2024-05-08T07:28:54.647Z] [2024-05-08 07:28:33 - DEBUG - ci_test]: (api_request)  : [FieldSchema] args: ['int64', <DataType.INT64: 5>, ''], kwargs: {'is_primary': False} (api_request.py:62)

[2024-05-08T07:28:54.647Z] [2024-05-08 07:28:33 - DEBUG - ci_test]: (api_response) : {'name': 'int64', 'description': '', 'type': <DataType.INT64: 5>}  (api_request.py:37)

[2024-05-08T07:28:54.647Z] [2024-05-08 07:28:33 - DEBUG - ci_test]: (api_request)  : [FieldSchema] args: ['varchar', <DataType.VARCHAR: 21>, ''], kwargs: {'max_length': 65535, 'is_primary': False} (api_request.py:62)

[2024-05-08T07:28:54.647Z] [2024-05-08 07:28:33 - DEBUG - ci_test]: (api_response) : {'name': 'varchar', 'description': '', 'type': <DataType.VARCHAR: 21>, 'params': {'max_length': 65535}}  (api_request.py:37)

[2024-05-08T07:28:54.647Z] [2024-05-08 07:28:33 - DEBUG - ci_test]: (api_request)  : [FieldSchema] args: ['float', <DataType.FLOAT: 10>, ''], kwargs: {'is_primary': False} (api_request.py:62)

[2024-05-08T07:28:54.647Z] [2024-05-08 07:28:33 - DEBUG - ci_test]: (api_response) : {'name': 'float', 'description': '', 'type': <DataType.FLOAT: 10>}  (api_request.py:37)

[2024-05-08T07:28:54.647Z] [2024-05-08 07:28:33 - DEBUG - ci_test]: (api_request)  : [FieldSchema] args: ['json_field', <DataType.JSON: 23>, ''], kwargs: {'is_primary': False} (api_request.py:62)

[2024-05-08T07:28:54.647Z] [2024-05-08 07:28:33 - DEBUG - ci_test]: (api_response) : {'name': 'json_field', 'description': '', 'type': <DataType.JSON: 23>}  (api_request.py:37)

[2024-05-08T07:28:54.647Z] [2024-05-08 07:28:33 - DEBUG - ci_test]: (api_request)  : [FieldSchema] args: ['float_vector', <DataType.FLOAT_VECTOR: 101>, ''], kwargs: {'dim': 128, 'is_primary': False} (api_request.py:62)

[2024-05-08T07:28:54.647Z] [2024-05-08 07:28:33 - DEBUG - ci_test]: (api_response) : {'name': 'float_vector', 'description': '', 'type': <DataType.FLOAT_VECTOR: 101>, 'params': {'dim': 128}}  (api_request.py:37)

[2024-05-08T07:28:54.647Z] [2024-05-08 07:28:33 - DEBUG - ci_test]: (api_request)  : [CollectionSchema] args: [[{'name': 'int64', 'description': '', 'type': <DataType.INT64: 5>}, {'name': 'float', 'description': '', 'type': <DataType.FLOAT: 10>}, {'name': 'varchar', 'description': '', 'type': <DataType.VARCHAR: 21>, 'params': {'max_length': 65535}}, {'name': 'json_field', 'description': '', 'type': <DataTyp......, kwargs: {'primary_field': 'int64', 'auto_id': False, 'enable_dynamic_field': False} (api_request.py:62)

[2024-05-08T07:28:54.647Z] [2024-05-08 07:28:33 - DEBUG - ci_test]: (api_response) : {'auto_id': False, 'description': '', 'fields': [{'name': 'int64', 'description': '', 'type': <DataType.INT64: 5>, 'is_primary': True, 'auto_id': False}, {'name': 'float', 'description': '', 'type': <DataType.FLOAT: 10>}, {'name': 'varchar', 'description': '', 'type': <DataType.VARCHAR: 21>, 'params......  (api_request.py:37)

[2024-05-08T07:28:54.647Z] [2024-05-08 07:28:33 - DEBUG - ci_test]: (api_request)  : [Connections.has_connection] args: ['default'], kwargs: {} (api_request.py:62)

[2024-05-08T07:28:54.647Z] [2024-05-08 07:28:33 - DEBUG - ci_test]: (api_response) : False  (api_request.py:37)

[2024-05-08T07:28:54.647Z] [2024-05-08 07:28:33 - DEBUG - ci_test]: (api_request)  : [Connections.connect] args: ['default', '', '', 'default', ''], kwargs: {'host': 'md-32788-2-pr-milvus.milvus-ci', 'port': '19530'} (api_request.py:62)

[2024-05-08T07:28:54.647Z] [2024-05-08 07:28:33 - DEBUG - ci_test]: (api_response) : None  (api_request.py:37)

[2024-05-08T07:28:54.647Z] [2024-05-08 07:28:33 - DEBUG - ci_test]: (api_request)  : [Collection] args: ['index_8hTNpXJz', {'auto_id': False, 'description': '', 'fields': [{'name': 'int64', 'description': '', 'type': <DataType.INT64: 5>, 'is_primary': True, 'auto_id': False}, {'name': 'float', 'description': '', 'type': <DataType.FLOAT: 10>}, {'name': 'varchar', 'description': '', 'type': <DataType.VA......, kwargs: {'consistency_level': 'Strong'} (api_request.py:62)

[2024-05-08T07:28:54.647Z] [2024-05-08 07:28:34 - DEBUG - ci_test]: (api_response) : <Collection>:

[2024-05-08T07:28:54.647Z] -------------

[2024-05-08T07:28:54.647Z] <name>: index_8hTNpXJz

[2024-05-08T07:28:54.647Z] <description>: 

[2024-05-08T07:28:54.647Z] <schema>: {'auto_id': False, 'description': '', 'fields': [{'name': 'int64', 'description': '', 'type': <DataType.INT64: 5>, 'is_primary': True, 'auto_id': False}, {'name': 'float', 'description': '', 'type': <DataType.FLOAT: 10>}, {......  (api_request.py:37)

[2024-05-08T07:28:54.647Z] [2024-05-08 07:28:34 - DEBUG - ci_test]: (api_request)  : [Collection.insert] args: [[[0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76,......, kwargs: {'timeout': 180} (api_request.py:62)

[2024-05-08T07:28:54.647Z] [2024-05-08 07:28:34 - DEBUG - ci_test]: (api_response) : (insert count: 2000, delete count: 0, upsert count: 0, timestamp: 449617150505123856, success count: 2000, err count: 0, cost: 0)  (api_request.py:37)

[2024-05-08T07:28:54.647Z] [2024-05-08 07:28:34 - DEBUG - ci_test]: (api_request)  : [Index] args: [<Collection>:

[2024-05-08T07:28:54.647Z] -------------

[2024-05-08T07:28:54.647Z] <name>: index_8hTNpXJz

[2024-05-08T07:28:54.647Z] <description>: 

[2024-05-08T07:28:54.647Z] <schema>: {'auto_id': False, 'description': '', 'fields': [{'name': 'int64', 'description': '', 'type': <DataType.INT64: 5>, 'is_primary': True, 'auto_id': False}, {'name': 'float', 'description': '', 'type': <DataType.FLOAT: 10>}, ......, kwargs: {'timeout': 1200, 'index_name': ''} (api_request.py:62)

[2024-05-08T07:28:54.647Z] [2024-05-08 07:28:35 - DEBUG - ci_test]: (api_response) : <pymilvus.orm.index.Index object at 0x7efbc47cedc0>  (api_request.py:37)

[2024-05-08T07:28:54.647Z] [2024-05-08 07:28:35 - DEBUG - ci_test]: (api_request)  : [Collection.create_index] args: ['float_vector', {'index_type': 'FLAT', 'params': {}, 'metric_type': 'COSINE'}, 1200], kwargs: {'index_name': 'vector_flat'} (api_request.py:62)

[2024-05-08T07:28:54.647Z] [2024-05-08 07:28:36 - DEBUG - ci_test]: (api_response) : Status(code=0, message=)  (api_request.py:37)

[2024-05-08T07:28:54.647Z] [2024-05-08 07:28:36 - DEBUG - ci_test]: (api_request)  : [Collection.load] args: [None, 1, 180], kwargs: {} (api_request.py:62)

[2024-05-08T07:28:54.647Z] [2024-05-08 07:28:38 - DEBUG - ci_test]: (api_response) : None  (api_request.py:37)

[2024-05-08T07:28:54.647Z] [2024-05-08 07:28:38 - DEBUG - ci_test]: (api_request)  : [Collection.flush] args: [], kwargs: {'timeout': 180} (api_request.py:62)

[2024-05-08T07:28:54.647Z] [2024-05-08 07:28:43 - DEBUG - ci_test]: (api_response) : None  (api_request.py:37)

Expected Behavior

ci would pass

Steps To Reproduce

No response

Milvus Log

No response

Anything else?

No response

XuanYang-cn avatar May 08 '24 09:05 XuanYang-cn

/assign @congqixia

XuanYang-cn avatar May 08 '24 09:05 XuanYang-cn

https://jenkins.milvus.io:18080/blue/organizations/jenkins/Milvus%20HA%20CI/detail/PR-32821/1/pipeline

XuanYang-cn avatar May 08 '24 09:05 XuanYang-cn

https://grafana-4am.zilliz.cc/explore?orgId=1&panes=%7B%22oX5%22:%7B%22datasource%22:%22vhI6Vw67k%22,%22queries%22:%5B%7B%22refId%22:%22A%22,%22expr%22:%22%7Bpod%3D~%5C%22md-32788-2-pr-milvus-proxy.%2A%5C%22%7D%20%7C%3D%5C%22index_8hTNpXJz%5C%22%22,%22datasource%22:%7B%22type%22:%22loki%22,%22uid%22:%22vhI6Vw67k%22%7D,%22editorMode%22:%22code%22,%22queryType%22:%22range%22,%22hide%22:true%7D,%7B%22refId%22:%22B%22,%22expr%22:%22%7Bpod%3D%5C%22md-32788-2-pr-milvus-datacoord-68b747b695-48m2q%5C%22%7D%20%7C%3D%20%5C%22449616837402792737%5C%22%22,%22datasource%22:%7B%22type%22:%22loki%22,%22uid%22:%22vhI6Vw67k%22%7D,%22editorMode%22:%22code%22,%22queryType%22:%22range%22,%22hide%22:false%7D,%7B%22refId%22:%22C%22,%22expr%22:%22%7Bpod%3D~%5C%22md-32788-2-pr-milvus-datanode.%2A%5C%22%7D%20%7C%3D%5C%22449616837402792775%5C%22%22,%22datasource%22:%7B%22type%22:%22loki%22,%22uid%22:%22vhI6Vw67k%22%7D,%22editorMode%22:%22code%22,%22queryType%22:%22range%22,%22hide%22:false%7D%5D,%22range%22:%7B%22from%22:%22now-12h%22,%22to%22:%22now%22%7D%7D%7D&schemaVersion=1

XuanYang-cn avatar May 08 '24 09:05 XuanYang-cn