Oleksandr Popovych
Oleksandr Popovych
@nnshah1 Sorry, I was little in a hurry and missed some key details. 1. I'm launching my triton instance with an empty model repository, which translates into my commands looking...
@nnshah1 You are pointing your server to the folder with models that already in there. As far as I understand documentation index will return the list of all model, loaded...
@nnshah1 Understood, I'm working on launching your code. Meanwhile here is a server log you asked for ``` I0409 14:33:20.431590 1 cache_manager.cc:480] Create CacheManager with cache_dir: '/opt/tritonserver/caches' I0409 14:33:20.569581 1...
@nnshah1 logs above obtained by launching everything my way with empty repository
@nnshah1 FYI: I've run your code and got: ``` POST /v2/repository/models/simple/load, headers {} {} Loaded model 'simple' POST /v2/repository/index, headers {} bytearray(b'[{"name":"densenet_onnx"},{"name":"inception_graphdef"},{"name":"simple","version":"1","state":"READY"},{"name":"simple_dyna_sequence"},{"name":"simple_identity"},{"name":"simple_int8"},{"name":"simple_sequence"},{"name":"simple_string"}]') ``` Sanity test - checked
> I'm suspecting that since the models get loaded into a temp directory and not /home - there is a difference in how they are listed out in the index....
> @ogvalt I've filed an internal ticket to track - let us know if there timeline / priority for this it's not urgent, but I hope it won't take months...
@nnshah1 thanks for an update. I was wondering what kind of side effects to expect after dynamically loaded model was unloaded? Like some amount of ram or disk space will...
@cyberhardt here is youtube video demonstrating what happened: https://youtu.be/RGSRIfAk_mQ Sorry, app is localized in ukrainian, but I suppose it still quite self explanatory.
hey, @lordlightman I've bought the same device and encountered the same issue. I'm thinking about writing zha quirk and add it to my hass, but I'm new to this. Are...