aiverify icon indicating copy to clipboard operation
aiverify copied to clipboard

[Report errors using the data and models provided on the official website] <Test Error>

Open 2414466154 opened this issue 1 year ago • 2 comments

Is there an existing issue for this?

  • [X] I have searched the existing issues

Description

No response

Current Behavior

No response

Expected Behavior

No response

Steps To Reproduce

No response

Environment

- Operating System and Version:
- AI Verify Version:
- Any other relevant information (e.g. version of related package dependencies installed):

Did you build using source code or from docker file? If from source code, please provide the below information:
- Python Version:
- Node Version:
- Redis Version:
- Mongo Version: 
- Screen Resolution:

Screenshots/ Code snippets

2023-10-22 17:27:14,055 [INFO][app_logger.py::add_to_log(116)] [task_processing.py:run_task_processing_in_process(66)]: The task validation is successful: task:6534bdf13585ef039a5ac224-6534eaf23585ef039a5c137d 2023-10-22 17:27:14,056 [INFO][app_logger.py::add_to_log(116)] [task_processing.py:run_task_processing_in_process(71)]: Working on task: message_id 1697966834021-0, message_args {"mode":"upload","id":"task:6534bdf13585ef039a5ac224-6534eaf23585ef039a5c137d","algorithmId":"algo:aiverify.stock.shap_toolbox:shap_toolbox","algorithmArgs":{"explain_type":"global","background_path":"/app/aiverify/uploads/data/pickle_pandas_mock_binary_classification_credit_risk_testing.sav","background_samples":23,"data_samples":25},"testDataset":"/app/aiverify/uploads/data/pickle_pandas_mock_binary_classification_credit_risk_testing.sav","modelFile":"/app/aiverify/uploads/model/my_binary_classification_mock_credit_risk_sklearn.linear_model._logistic.LogisticRegression.sav","groundTruthDataset":"/app/aiverify/uploads/data/pickle_pandas_mock_binary_classification_credit_risk_testing.sav","modelType":"classification","groundTruth":"gender"}, task_type: TaskType.NEW 2023-10-22 17:27:14,056 [INFO][app_logger.py::add_to_log(116)] [task_result.py:set_status(146)]: The current task has changed status to TaskStatus.RUNNING 2023-10-22 17:27:14,056 [INFO][app_logger.py::add_to_log(116)] [task_processing.py:process_new_task(110)]: Sending task update 2023-10-22 17:27:14,062 [INFO][app_logger.py::add_to_log(116)] [stream_processing.py:detect_pipeline(30)]: Attempting to detect pipeline model from the given path 2023-10-22 17:27:14,062 [INFO][log_utils.py::log_message(31)] [pipeline_manager.py:read_pipeline_path(55)]: Attempting to read pipeline: /app/aiverify/uploads/model/my_binary_classification_mock_credit_risk_sklearn.linear_model._logistic.LogisticRegression.sav 2023-10-22 17:27:14,062 [INFO][log_utils.py::log_message(31)] [pipeline_manager.py:read_pipeline_path(83)]: Pipeline validation successful 2023-10-22 17:27:14,063 [ERROR][log_utils.py::log_message(37)] [pipeline_manager.py:read_pipeline_path(101)]: There was an error getting pipeline files in the folder 2023-10-22 17:27:14,063 [INFO][app_logger.py::add_to_log(116)] [task_processing.py:_load_instances(277)]: Unable to find pipeline model. Loading non-pipeline instances 2023-10-22 17:27:14,063 [INFO][log_utils.py::log_message(31)] [data_manager.py:read_data(56)]: Attempting to read data: /app/aiverify/uploads/data/pickle_pandas_mock_binary_classification_credit_risk_testing.sav 2023-10-22 17:27:14,064 [INFO][log_utils.py::log_message(31)] [data_manager.py:read_data(81)]: Data validation successful 2023-10-22 17:27:14,064 [INFO][log_utils.py::log_message(31)] [data_manager.py:read_data(89)]: Attempting to deserialize data: /app/aiverify/uploads/data/pickle_pandas_mock_binary_classification_credit_risk_testing.sav 2023-10-22 17:27:14,068 [INFO][app_logger.py::add_to_log(116)] [task.py:_send_task_update(278)]: Task has received notification to send task update 2023-10-22 17:27:14,070 [INFO][log_utils.py::log_message(31)] [data_manager.py:read_data(157)]: Consolidation results: {pandasdata.Plugin object at 0x7f4d45f2f890} {class 'pickleserializer.Plugin'} 2023-10-22 17:27:14,070 [INFO][log_utils.py::log_message(31)] [data_manager.py:read_data(181)]: Supported data format: DataPluginType.PANDAS[SerializerPluginType.PICKLE] 2023-10-22 17:27:14,070 [INFO][app_logger.py::add_to_log(116)] [stream_processing.py:load_data(75)]: Data Instance: {pandasdata.Plugin object at 0x7f4d45f2f890}, Data Deserializer: SerializerPluginType.PICKLE 2023-10-22 17:27:14,070 [INFO][app_logger.py::add_to_log(116)] [worker.py:_send_update(614)]: The update sent successfully: task:6534bdf13585ef039a5ac224-6534eaf23585ef039a5c137d:{'type': 'TaskResponse', 'status': 'Running', 'elapsedTime': 0, 'startTime': '2023-10-22T17:27:14.055111', 'output': '""', 'logFile': '/app/aiverify/test-engine-app/logs/task:6534bdf13585ef039a5ac224-6534eaf23585ef039a5c137d.log', 'taskProgress': 0} 2023-10-22 17:27:14,071 [INFO][log_utils.py::log_message(31)] [model_manager.py:read_model_file(51)]: Attempting to read model: /app/aiverify/uploads/model/my_binary_classification_mock_credit_risk_sklearn.linear_model._logistic.LogisticRegression.sav 2023-10-22 17:27:14,071 [INFO][log_utils.py::log_message(31)] [model_manager.py:read_model_file(78)]: Model validation successful 2023-10-22 17:27:14,071 [INFO][log_utils.py::log_message(31)] [model_manager.py:read_model_file(84)]: Attempting to deserialize model: /app/aiverify/uploads/model/my_binary_classification_mock_credit_risk_sklearn.linear_model._logistic.LogisticRegression.sav 2023-10-22 17:27:14,096 [INFO][log_utils.py::log_message(31)] [model_manager.py:read_model_file(107)]: Attempting to identify model format: {class 'sklearn.linear_model._logistic.LogisticRegression'} 2023-10-22 17:27:14,096 [INFO][log_utils.py::log_message(31)] [model_manager.py:read_model_file(117)]: Supported model format: {class 'sklearn.linear_model._logistic.LogisticRegression'}, ModelPluginType.SKLEARN[sklearn.linear_model._logistic.LogisticRegression] 2023-10-22 17:27:14,096 [INFO][app_logger.py::add_to_log(116)] [stream_processing.py:load_model(201)]: Model Instance: {sklearnmodel.Plugin object at 0x7f4d44aaea90}, Model Deserializer: SerializerPluginType.PICKLE 2023-10-22 17:27:14,096 [INFO][log_utils.py::log_message(31)] [data_manager.py:read_data(56)]: Attempting to read data: /app/aiverify/uploads/data/pickle_pandas_mock_binary_classification_credit_risk_testing.sav 2023-10-22 17:27:14,096 [INFO][log_utils.py::log_message(31)] [data_manager.py:read_data(81)]: Data validation successful 2023-10-22 17:27:14,097 [INFO][log_utils.py::log_message(31)] [data_manager.py:read_data(89)]: Attempting to deserialize data: /app/aiverify/uploads/data/pickle_pandas_mock_binary_classification_credit_risk_testing.sav 2023-10-22 17:27:14,097 [INFO][log_utils.py::log_message(31)] [data_manager.py:read_data(157)]: Consolidation results: {pandasdata.Plugin object at 0x7f4d44da93d0} {class 'pickleserializer.Plugin'} 2023-10-22 17:27:14,098 [INFO][log_utils.py::log_message(31)] [data_manager.py:read_data(181)]: Supported data format: DataPluginType.PANDAS[SerializerPluginType.PICKLE] 2023-10-22 17:27:14,098 [INFO][app_logger.py::add_to_log(116)] [stream_processing.py:load_ground_truth(259)]: GroundTruth Instance: {pandasdata.Plugin object at 0x7f4d44da93d0}, GroundTruth Deserializer: SerializerPluginType.PICKLE 2023-10-22 17:27:14,102 [ERROR][log_utils.py::log_message(37)] [algorithm_manager.py:get_algorithm(126)]: There was an error getting algorithm instance (not found): algo:aiverify.stock.shap_toolbox:shap_toolbox 2023-10-22 17:27:14,102 [INFO][app_logger.py::add_to_log(116)] [plugin_controller.py:get_plugin_instance(112)]: Attempting to find algo:aiverify.stock.shap_toolbox:shap_toolbox in the algorithm registry 2023-10-22 17:27:14,104 [INFO][app_logger.py::add_to_log(116)] [plugin_controller.py:get_plugin_instance(141)]: algo:aiverify.stock.shap_toolbox:shap_toolbox is in the algorithm registry. Attempting to re-discover algorithm 2023-10-22 17:27:14,110 [ERROR][log_utils.py::log_message(37)] [algorithm_manager.py:get_algorithm(126)]: There was an error getting algorithm instance (not found): algo:aiverify.stock.shap_toolbox:shap_toolbox 2023-10-22 17:27:14,110 [WARNING][app_logger.py::add_to_log(121)] [task_processing.py:process_new_task(189)]: The task terminated: Unable to get algorithm instance: There was an error loading algorithm: There was an error getting algorithm instance (not found): algo:aiverify.stock.shap_toolbox:shap_toolbox 2023-10-22 17:27:14,111 [INFO][app_logger.py::add_to_log(116)] [task_result.py:set_progress(114)]: The current task completion progress is 100 2023-10-22 17:27:14,111 [INFO][app_logger.py::add_to_log(116)] [task_result.py:set_status(146)]: The current task has changed status to TaskStatus.ERROR 2023-10-22 17:27:14,141 [INFO][app_logger.py::add_to_log(116)] [worker.py:_send_update(614)]: The update sent successfully: task:6534bdf13585ef039a5ac224-6534eaf23585ef039a5c137d:{'type': 'TaskResponse', 'status': 'Error', 'elapsedTime': 0, 'startTime': '2023-10-22T17:27:14.055111', 'output': '', 'errorMessages': '[{"category": "SYSTEM_ERROR", "code": "CSYSx00146", "description": "Task Terminated: Unable to get algorithm instance: There was an error loading algorithm: There was an error getting algorithm instance (not found): algo:aiverify.stock.shap_toolbox:shap_toolbox", "severity": "warning", "component": "task_processing.py"}]', 'logFile': '/app/aiverify/test-engine-app/logs/task:6534bdf13585ef039a5ac224-6534eaf23585ef039a5c137d.log', 'taskProgress': 100} 2023-10-22 17:27:14,141 [INFO][app_logger.py::add_to_log(116)] [worker.py:_send_acknowledgement(659)]: The acknowledgement sent successfully - 1697966834021-0 2023-10-22 17:27:14,141 [INFO][app_logger.py::add_to_log(116)] [task.py:cleanup(104)]: The system has received notification to clean up task

Additional Context

No response

Possible Solution (Optional)

No response

2414466154 avatar Oct 22 '23 09:10 2414466154