installation failed -- api display error

[ziqingwang]

Hello, I am very interested in your project, but I installed it myself without success，I want to know 1.this project is still alive? 2.Is there a more detailed installation document, can you provide it? 3.I visit http://127.0.0.1:5000/display/teststring/, it shows api display error 4.I visit http://127.0.0.1:3000/, the page display does not look normal

[ljcljc]

Have you resolved this issue?

[azizullah2017]

@ziqingwang have you resolved the problem ? @Jovonni @kaiiyer @skopula can you please guys assist, resolving the issue ?

when I visit http://127.0.0.1:5000/display/teststring/, it shows api display error and below is terminal Error

2022-07-06 17:47:45 lap-0243 root[37730] WARNING run_model(), attempting to run: model_1
model_test testing... before disk
INSIDE DISK MODULE...
model end run..................
2022-07-06 17:47:45 lap-0243 root[37730] INFO Model Session: finishing job: 100000
2022-07-06 17:47:45 lap-0243 root[37730] INFO dataset session
2022-07-06 17:47:45 lap-0243 root[37730] INFO Dataset_Session: read_es_index
2022-07-06 17:47:45 lap-0243 root[37730] INFO Reading ES index
2022-07-06 17:47:45 lap-0243 root[37730] INFO ES: status code: 400
2022-07-06 17:47:45 lap-0243 root[37730] INFO HTTPHeaderDict({'X-elastic-product': 'Elasticsearch', 'Warning': '299 Elasticsearch-7.17.5-8d61b4f7ddf931f219e3745f295ed2bbc50c8e84 "Elasticsearch built-in security features are not enabled. Without authentication, your cluster could be accessible to anyone. See https://www.elastic.co/guide/en/elasticsearch/reference/7.17/security-minimal-setup.html to enable security."', 'content-type': 'application/json; charset=UTF-8', 'content-encoding': 'gzip', 'content-length': '146'})
<dataset.CoreDataFrame object at 0x7fb634c41410>
2022-07-06 17:47:45 lap-0243 root[37730] INFO model engine execute model: {'model_name': 'model_test', 'description': 'blank', 'mitre_tactic': '', 'mitre_technique_name': '', 'mitre_technique_id': 'T1010', 'enabled': True, 'root': 'ANJKD8aioh8wonsLAS9HWOI', 'return': {'return_type': 'user_risks', 'artifacts': []}, 'score': 10, 'model_context': {}, 'components': [{'type': 'external', 'filename': '__init__.py', 'data_hash': 'bb359488ff009930fdb409b2e37d2770fa302e249aae9fb277ed56a04f1ce750', 'file_hash': '8856500188054fcfc51011fbc57bd667b8f9a70d58b5ce40d4ca3ade9b5caac6', 'file_payload': 'IyBuZWVkIHRvIGltcG9ydCAuTU9ERUwKZnJvbSAuTU9ERUwgaW1wb3J0IGV4ZWN1dGUK'}, {'type': 'external', 'filename': 'MODEL.py', 'data_hash': 'c91569ef18120310e433645d54eaddc4fa72bf5a0613a1e13a3e75d2abda665f', 'file_hash': '585a2c07d4644acb0da61202490cafb99a58570dc9861b14426576f54350fdc6', 'file_payload': 'IyBuZWVkIHRvIGV4cG9zZSBleGVjdXRlCmRlZiBleGVjdXRlKCk6CglwcmludCgibW9kZWxfdGVzdCB0ZXN0aW5nLi4uIikKCXJldHVybl9vYmplY3Q6IGRpY3QgPSB7fQoKCWZvciB4IGluIHJhbmdlKDAsMTAwMDAwKToKCQlyZXR1cm5fb2JqZWN0W3hdID0gewoJCQkidmFsdWUiOiAidGVzdCIKCQl9CgoJcHJpbnQoIm1vZGVsIGVuZCBydW4uLiIpCglyZXR1cm4gcmV0dXJuX29iamVjdAo='}]}
2022-07-06 17:47:45 lap-0243 root[37730] INFO Model enabled: model_test
2022-07-06 17:47:45 lap-0243 root[37730] INFO Model Session: starting job
2022-07-06 17:47:47 lap-0243 root[37730] INFO {'model_name': 'model_test', 'description': 'blank', 'mitre_tactic': '', 'mitre_technique_name': '', 'mitre_technique_id': 'T1010', 'enabled': True, 'root': 'ANJKD8aioh8wonsLAS9HWOI', 'return': {'return_type': 'user_risks', 'artifacts': []}, 'score': 10, 'model_context': {}, 'components': [{'type': 'external', 'filename': '__init__.py', 'data_hash': 'bb359488ff009930fdb409b2e37d2770fa302e249aae9fb277ed56a04f1ce750', 'file_hash': '8856500188054fcfc51011fbc57bd667b8f9a70d58b5ce40d4ca3ade9b5caac6', 'file_payload': 'IyBuZWVkIHRvIGltcG9ydCAuTU9ERUwKZnJvbSAuTU9ERUwgaW1wb3J0IGV4ZWN1dGUK'}, {'type': 'external', 'filename': 'MODEL.py', 'data_hash': 'c91569ef18120310e433645d54eaddc4fa72bf5a0613a1e13a3e75d2abda665f', 'file_hash': '585a2c07d4644acb0da61202490cafb99a58570dc9861b14426576f54350fdc6', 'file_payload': 'IyBuZWVkIHRvIGV4cG9zZSBleGVjdXRlCmRlZiBleGVjdXRlKCk6CglwcmludCgibW9kZWxfdGVzdCB0ZXN0aW5nLi4uIikKCXJldHVybl9vYmplY3Q6IGRpY3QgPSB7fQoKCWZvciB4IGluIHJhbmdlKDAsMTAwMDAwKToKCQlyZXR1cm5fb2JqZWN0W3hdID0gewoJCQkidmFsdWUiOiAidGVzdCIKCQl9CgoJcHJpbnQoIm1vZGVsIGVuZCBydW4uLiIpCglyZXR1cm4gcmV0dXJuX29iamVjdAo='}]}
2022-07-06 17:47:47 lap-0243 root[37730] INFO is_installed: model_test
2022-07-06 17:47:47 lap-0243 root[37730] INFO is_installed(): __init__.py
2022-07-06 17:47:47 lap-0243 root[37730] INFO is_installed(): MODEL.py
2022-07-06 17:47:47 lap-0243 root[37730] INFO Model Session, model [IS] installed: model_test
2022-07-06 17:47:47 lap-0243 root[37730] WARNING Computed Component file hash: 8856500188054fcfc51011fbc57bd667b8f9a70d58b5ce40d4ca3ade9b5caac6
2022-07-06 17:47:47 lap-0243 root[37730] INFO verify_model_files, Model is VALID: model_test
2022-07-06 17:47:47 lap-0243 root[37730] INFO Valid Component: __init__.py
2022-07-06 17:47:47 lap-0243 root[37730] WARNING Computed Component file hash: 585a2c07d4644acb0da61202490cafb99a58570dc9861b14426576f54350fdc6
2022-07-06 17:47:47 lap-0243 root[37730] INFO verify_model_files, Model is VALID: model_test
2022-07-06 17:47:47 lap-0243 root[37730] INFO Valid Component: MODEL.py
2022-07-06 17:47:47 lap-0243 root[37730] WARNING run_model(), attempting to run: model_test
model_test testing...
model end run..
2022-07-06 17:47:47 lap-0243 root[37730] INFO Model Session: finishing job: 100000
2022-07-06 17:49:36 lap-0243 root[37730] INFO Getting display info with type: teststring
2022-07-06 17:49:36 lap-0243 root[37730] INFO PriorGetDisplay OF TYPE -- __call__: teststring
2022-07-06 17:49:36 lap-0243 root[37730] INFO Display init
2022-07-06 17:49:36 lap-0243 root[37730] ERROR Display Type: teststring
2022-07-06 17:49:36 lap-0243 root[37730] ERROR Display types 1: get_all_entities
2022-07-06 17:49:36 lap-0243 root[37730] ERROR Display types 2: get_all_users
2022-07-06 17:49:36 lap-0243 root[37730] ERROR Display types 3: get_system_log
2022-07-06 17:49:36 lap-0243 root[37730] ERROR Unsupported API Display type
2022-07-06 17:49:36 lap-0243 werkzeug[37730] INFO 127.0.0.1 - - [06/Jul/2022 17:49:36] "GET /display/teststring/ HTTP/1.1" 200 -

requirements.txt file

flask==2.1.2
flask_cors
keras==2.3.1 
pandas==0.25.3
jinja2==3.1.1
numpy
tensorflow==2.5.3 
coloredlogs==10.0 
pymongo==3.10.1 
mypy==0.761

manually installed ELK and spark

cannot find spark_env.sh file

make run_ui this command is also not working, it is not in make file