trackme icon indicating copy to clipboard operation
trackme copied to clipboard

Latest version of TrackMe takes a while to load the data

Open 11gods opened this issue 3 years ago • 14 comments

Hi,

version 1.2.31 of TrackMe, takes a while to load the page. PRevious version on tRackMe was much more quicker

11gods avatar Mar 10 '21 11:03 11gods

Hi @11gods

Thanks for reporting, do you which version exactly you came from?

As well, do you have a testing environment? If you do, I would be glad if you could verify if the very last version that is currently under development has improved it, I have identified and fixes a issues, but I am still chasing for anything heavy that would explain it.

https://github.com/guilhemmarchand/trackme/tree/testing

If you don't, that's not a problem.

Working on this question.

guilhemmarchand avatar Mar 10 '21 13:03 guilhemmarchand

Hi Guilhem,

Thank you so much for your quick response.

Yes we have a test environment.

In our test environment we have version 1.2.34 and we are still having the same issues. I don't recall which version we had previously which was loading TrackMe quickly.

On my DEV environment, it takes 40 seconds to obtain the screen. And I only have 16 Data sources.

@.***D71589.D29D5C70]

Thanks

@.***D71589.D2ABDB60][xx]

George Christianis Conseiller senior Centre d'expertise - Outils de Surveillance TI / Center of Expertise IT Monitoring Tools Transformation TI / IT Transformation Transit 4857-1 Tél. : 514 412-1363 Téléc. : 514 394-6291 @.@.> Portail Support Transfo TIhttps://can01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwiki.bnc.ca%2Fdisplay%2FTITTI%2FJira%2BService%2BDesk%2B%2528JSD%2529%2Bpour%2Bla%2BTransformation-TI%23expand-Accompagnement&data=02%7C01%7Cgeorge.christianis%40bnc.ca%7C88b4f5a2d94e44844c6208d80b9b7d47%7Cc21157cabce341a88aa7a23c4639610a%7C0%7C0%7C637272109739413975&sdata=wa1hJ4z6EsozJ1QtjsaI0dQ%2BcU3Bz%2Fe%2B0mYbBFxJUj8%3D&reserved=0

@.***D71589.D2ABDB60]

Banque Nationale du Canada 700, rue De La Gauchetière Ouest, 8e étage Montréal, QC H3B 3B5

From: Guilhem Marchand @.> Sent: Wednesday, March 10, 2021 8:22 AM To: guilhemmarchand/trackme @.> Cc: Christianis, George @.>; Mention @.> Subject: Re: [guilhemmarchand/trackme] Latest version of TrackMe takes a while to load the data (#282)


PRUDENCE/CAUTION - EXTERNE/EXTERNAL


Hi @11godshttps://can01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2F11gods&data=04%7C01%7Cgeorge.christianis%40bnc.ca%7C3a5d6e11cde1436daee408d8e3c78e7c%7Cc21157cabce341a88aa7a23c4639610a%7C0%7C0%7C637509793513636264%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=UEzvsFZn86c227Xhgpza4vLFQC31a%2BjMrWyMrQA%2BJpw%3D&reserved=0

Thanks for reporting, do you which version exactly you came from?

As well, do you have a testing environment? If you do, I would be glad if you could verify if the very last version that is currently under development has improved it, I have identified and fixes a issues, but I am still chasing for anything heavy that would explain it.

https://github.com/guilhemmarchand/trackme/tree/testinghttps://can01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fguilhemmarchand%2Ftrackme%2Ftree%2Ftesting&data=04%7C01%7Cgeorge.christianis%40bnc.ca%7C3a5d6e11cde1436daee408d8e3c78e7c%7Cc21157cabce341a88aa7a23c4639610a%7C0%7C0%7C637509793513646262%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=cDK0LQuD9iqejY3d9Tk1nL2n9aXuPNnQz427iZHewv8%3D&reserved=0

If you don't, that's not a problem.

Working on this question.

You are receiving this because you were mentioned. Reply to this email directly, view it on GitHubhttps://can01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fguilhemmarchand%2Ftrackme%2Fissues%2F282%23issuecomment-795406579&data=04%7C01%7Cgeorge.christianis%40bnc.ca%7C3a5d6e11cde1436daee408d8e3c78e7c%7Cc21157cabce341a88aa7a23c4639610a%7C0%7C0%7C637509793513646262%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=dqn6Ox5XEj3Wu5OwGh5Kp6g%2FUcg3w2YskOl4pimtTyo%3D&reserved=0, or unsubscribehttps://can01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAS6MOGKCL5JIOVPGVMQFGLTTC5XBLANCNFSM4Y5ZJZLA&data=04%7C01%7Cgeorge.christianis%40bnc.ca%7C3a5d6e11cde1436daee408d8e3c78e7c%7Cc21157cabce341a88aa7a23c4639610a%7C0%7C0%7C637509793513656252%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=ITQ1X%2B%2FM9%2FwIKr2G7K6kd32cGcX0cunL9pTht0iTRwI%3D&reserved=0.

CONFIDENTIALITÉ : Ce document est destiné uniquement à la personne ou à l'entité à qui il est adressé. L'information apparaissant dans ce document est de nature légalement privilégiée et confidentielle. Si vous n'êtes pas le destinataire visé ou la personne chargée de le remettre à son destinataire, vous êtes, par la présente, avisé que toute lecture, usage, copie ou communication du contenu de ce document est strictement interdit. De plus, vous êtes prié de communiquer avec l'expéditeur sans délai et de détruire ce document immédiatement. CONFIDENTIALITY: This document is intended solely for the individual or entity to whom it is addressed. The information contained in this document is legally privileged and confidential. If you are not the intended recipient or the person responsible for delivering it to the intended recipient, you are hereby advised that you are strictly prohibited from reading, using, copying or disseminating the contents of this document. Please inform the sender immediately and delete this document immediately.

11gods avatar Mar 10 '21 13:03 11gods

HI Guillem,

I just updated TrackMe to version 1.2.36 on our Splunk test environment and it still taking a while to load it. ☹ I am not sure if its normal. But as I mentioned it the past it was loading right away.

Thanks

@.***D7158B.4AB51DA0][xx]

George Christianis Conseiller senior Centre d’expertise – Outils de Surveillance TI / Center of Expertise IT Monitoring Tools Transformation TI / IT Transformation Transit 4857-1 Tél. : 514 412-1363 Téléc. : 514 394-6291 @.@.> Portail Support Transfo TIhttps://can01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwiki.bnc.ca%2Fdisplay%2FTITTI%2FJira%2BService%2BDesk%2B%2528JSD%2529%2Bpour%2Bla%2BTransformation-TI%23expand-Accompagnement&data=02%7C01%7Cgeorge.christianis%40bnc.ca%7C88b4f5a2d94e44844c6208d80b9b7d47%7Cc21157cabce341a88aa7a23c4639610a%7C0%7C0%7C637272109739413975&sdata=wa1hJ4z6EsozJ1QtjsaI0dQ%2BcU3Bz%2Fe%2B0mYbBFxJUj8%3D&reserved=0

@.***D7158B.4AB51DA0]

Banque Nationale du Canada 700, rue De La Gauchetière Ouest, 8e étage Montréal, QC H3B 3B5

From: Guilhem Marchand @.> Sent: Wednesday, March 10, 2021 8:22 AM To: guilhemmarchand/trackme @.> Cc: Christianis, George @.>; Mention @.> Subject: Re: [guilhemmarchand/trackme] Latest version of TrackMe takes a while to load the data (#282)


PRUDENCE/CAUTION - EXTERNE/EXTERNAL


Hi @11godshttps://can01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2F11gods&data=04%7C01%7Cgeorge.christianis%40bnc.ca%7C3a5d6e11cde1436daee408d8e3c78e7c%7Cc21157cabce341a88aa7a23c4639610a%7C0%7C0%7C637509793513636264%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=UEzvsFZn86c227Xhgpza4vLFQC31a%2BjMrWyMrQA%2BJpw%3D&reserved=0

Thanks for reporting, do you which version exactly you came from?

As well, do you have a testing environment? If you do, I would be glad if you could verify if the very last version that is currently under development has improved it, I have identified and fixes a issues, but I am still chasing for anything heavy that would explain it.

https://github.com/guilhemmarchand/trackme/tree/testinghttps://can01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fguilhemmarchand%2Ftrackme%2Ftree%2Ftesting&data=04%7C01%7Cgeorge.christianis%40bnc.ca%7C3a5d6e11cde1436daee408d8e3c78e7c%7Cc21157cabce341a88aa7a23c4639610a%7C0%7C0%7C637509793513646262%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=cDK0LQuD9iqejY3d9Tk1nL2n9aXuPNnQz427iZHewv8%3D&reserved=0

If you don't, that's not a problem.

Working on this question.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHubhttps://can01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fguilhemmarchand%2Ftrackme%2Fissues%2F282%23issuecomment-795406579&data=04%7C01%7Cgeorge.christianis%40bnc.ca%7C3a5d6e11cde1436daee408d8e3c78e7c%7Cc21157cabce341a88aa7a23c4639610a%7C0%7C0%7C637509793513646262%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=dqn6Ox5XEj3Wu5OwGh5Kp6g%2FUcg3w2YskOl4pimtTyo%3D&reserved=0, or unsubscribehttps://can01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAS6MOGKCL5JIOVPGVMQFGLTTC5XBLANCNFSM4Y5ZJZLA&data=04%7C01%7Cgeorge.christianis%40bnc.ca%7C3a5d6e11cde1436daee408d8e3c78e7c%7Cc21157cabce341a88aa7a23c4639610a%7C0%7C0%7C637509793513656252%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=ITQ1X%2B%2FM9%2FwIKr2G7K6kd32cGcX0cunL9pTht0iTRwI%3D&reserved=0.

CONFIDENTIALITÉ : Ce document est destiné uniquement à la personne ou à l'entité à qui il est adressé. L'information apparaissant dans ce document est de nature légalement privilégiée et confidentielle. Si vous n'êtes pas le destinataire visé ou la personne chargée de le remettre à son destinataire, vous êtes, par la présente, avisé que toute lecture, usage, copie ou communication du contenu de ce document est strictement interdit. De plus, vous êtes prié de communiquer avec l'expéditeur sans délai et de détruire ce document immédiatement. CONFIDENTIALITY: This document is intended solely for the individual or entity to whom it is addressed. The information contained in this document is legally privileged and confidential. If you are not the intended recipient or the person responsible for delivering it to the intended recipient, you are hereby advised that you are strictly prohibited from reading, using, copying or disseminating the contents of this document. Please inform the sender immediately and delete this document immediately.

11gods avatar Mar 10 '21 13:03 11gods

Hi @11gods

Right, can you update to 1.2.37 instead please? (1.2.36 is latest stable, not the testing)

https://github.com/guilhemmarchand/trackme/releases/tag/1.2.37

I've published a pre-release to make your life easier.

Guilhem

guilhemmarchand avatar Mar 10 '21 14:03 guilhemmarchand

Hi @11gods

Version 1.2.37 (and now 1.2.38 which included an hotfix for non privileged users) adresses some issues with searches that were starting at the load time, and should't have started.

Let me know if there are any improvements, I keep the topic opened as I am still working on this.

Guilhem

guilhemmarchand avatar Mar 16 '21 21:03 guilhemmarchand

Hi Guilhem,

Thanks again for the updates. I installed version 1.2.38 on our Dev environment, but the app still takes 40 seconds to load.

Thanks

@.***D71AFC.5266F980][xx]

George Christianis Conseiller senior Centre d'expertise - Outils de Surveillance TI / Center of Expertise IT Monitoring Tools Transformation TI / IT Transformation Transit 4857-1 Tél. : 514 412-1363 Téléc. : 514 394-6291 @.@.> Portail Support Transfo TIhttps://can01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwiki.bnc.ca%2Fdisplay%2FTITTI%2FJira%2BService%2BDesk%2B%2528JSD%2529%2Bpour%2Bla%2BTransformation-TI%23expand-Accompagnement&data=02%7C01%7Cgeorge.christianis%40bnc.ca%7C88b4f5a2d94e44844c6208d80b9b7d47%7Cc21157cabce341a88aa7a23c4639610a%7C0%7C0%7C637272109739413975&sdata=wa1hJ4z6EsozJ1QtjsaI0dQ%2BcU3Bz%2Fe%2B0mYbBFxJUj8%3D&reserved=0

@.***D71AFC.5266F980]

Banque Nationale du Canada 700, rue De La Gauchetière Ouest, 8e étage Montréal, QC H3B 3B5

From: Guilhem Marchand @.> Sent: Tuesday, March 16, 2021 5:11 PM To: guilhemmarchand/trackme @.> Cc: Christianis, George @.>; Mention @.> Subject: Re: [guilhemmarchand/trackme] Latest version of TrackMe takes a while to load the data (#282)


PRUDENCE/CAUTION - EXTERNE/EXTERNAL


Hi @11godshttps://can01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2F11gods&data=04%7C01%7Cgeorge.christianis%40bnc.ca%7C2b5e117b631e4d47fdb208d8e8bff79d%7Cc21157cabce341a88aa7a23c4639610a%7C0%7C0%7C637515258475904305%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=ZgmKejnxtAQ8nJcL66fGpYBWU0n1Gyncb5AMBLjuuZc%3D&reserved=0

Version 1.2.37 (and now 1.2.38 which included an hotfix for non privileged users) adresses some issues with searches that were starting at the load time, and should't have started.

Let me know if there are any improvements, I keep the topic opened as I am still working on this.

Guilhem

You are receiving this because you were mentioned. Reply to this email directly, view it on GitHubhttps://can01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fguilhemmarchand%2Ftrackme%2Fissues%2F282%23issuecomment-800606953&data=04%7C01%7Cgeorge.christianis%40bnc.ca%7C2b5e117b631e4d47fdb208d8e8bff79d%7Cc21157cabce341a88aa7a23c4639610a%7C0%7C0%7C637515258475914299%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=exiLH%2FHjxS4GzAvs3ky0OUmgKo3wr0jX4pHqfgYyY5M%3D&reserved=0, or unsubscribehttps://can01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAS6MOGMGUQZ543JKT43KLG3TD7CNLANCNFSM4Y5ZJZLA&data=04%7C01%7Cgeorge.christianis%40bnc.ca%7C2b5e117b631e4d47fdb208d8e8bff79d%7Cc21157cabce341a88aa7a23c4639610a%7C0%7C0%7C637515258475914299%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=b05ksZmFKSKSvIfiwEBhBBHQdlD2ABgrErb%2Bbk6cAFE%3D&reserved=0.

CONFIDENTIALITÉ : Ce document est destiné uniquement à la personne ou à l'entité à qui il est adressé. L'information apparaissant dans ce document est de nature légalement privilégiée et confidentielle. Si vous n'êtes pas le destinataire visé ou la personne chargée de le remettre à son destinataire, vous êtes, par la présente, avisé que toute lecture, usage, copie ou communication du contenu de ce document est strictement interdit. De plus, vous êtes prié de communiquer avec l'expéditeur sans délai et de détruire ce document immédiatement. CONFIDENTIALITY: This document is intended solely for the individual or entity to whom it is addressed. The information contained in this document is legally privileged and confidential. If you are not the intended recipient or the person responsible for delivering it to the intended recipient, you are hereby advised that you are strictly prohibited from reading, using, copying or disseminating the contents of this document. Please inform the sender immediately and delete this document immediately.

11gods avatar Mar 17 '21 11:03 11gods

Thanks @11gods yes 40 seconds is what I benchmarked on several environments too! Interestling 40 seconds exactly.

I believe the html UI reached some level of complexity that makes its code quite massive currently, I have the plan to migrate it over React JS but that is not going to be for tomorrow.

I am still on the question, there might be some updates between the version that added some specific config items that take too long to load.

Thanks for keeping an eye on it

guilhemmarchand avatar Mar 18 '21 18:03 guilhemmarchand

Excellent thank you for looking into it and I am glad its not just on our environment

@.***D71C0C.73F06A80][xx]

George Christianis Conseiller senior Centre d'expertise - Outils de Surveillance TI / Center of Expertise IT Monitoring Tools Transformation TI / IT Transformation Transit 4857-1 Tél. : 514 412-1363 Téléc. : 514 394-6291 @.@.> Portail Support Transfo TIhttps://can01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwiki.bnc.ca%2Fdisplay%2FTITTI%2FJira%2BService%2BDesk%2B%2528JSD%2529%2Bpour%2Bla%2BTransformation-TI%23expand-Accompagnement&data=02%7C01%7Cgeorge.christianis%40bnc.ca%7C88b4f5a2d94e44844c6208d80b9b7d47%7Cc21157cabce341a88aa7a23c4639610a%7C0%7C0%7C637272109739413975&sdata=wa1hJ4z6EsozJ1QtjsaI0dQ%2BcU3Bz%2Fe%2B0mYbBFxJUj8%3D&reserved=0

@.***D71C0C.73F06A80]

Banque Nationale du Canada 700, rue De La Gauchetière Ouest, 8e étage Montréal, QC H3B 3B5

From: Guilhem Marchand @.> Sent: Thursday, March 18, 2021 2:06 PM To: guilhemmarchand/trackme @.> Cc: Christianis, George @.>; Mention @.> Subject: Re: [guilhemmarchand/trackme] Latest version of TrackMe takes a while to load the data (#282)


PRUDENCE/CAUTION - EXTERNE/EXTERNAL


Thanks @11godshttps://can01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2F11gods&data=04%7C01%7Cgeorge.christianis%40bnc.ca%7C466d0af24dc94eeee16408d8ea388d36%7Cc21157cabce341a88aa7a23c4639610a%7C0%7C0%7C637516875890639966%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=9hf0pBi6gemwT1vYwSrS51Lpe3aW4WOZEtSqSy7EhIc%3D&reserved=0 yes 40 seconds is what I benchmarked on several environments too! Interestling 40 seconds exactly.

I believe the html UI reached some level of complexity that makes its code quite massive currently, I have the plan to migrate it over React JS but that is not going to be for tomorrow.

I am still on the question, there might be some updates between the version that added some specific config items that take too long to load.

Thanks for keeping an eye on it

You are receiving this because you were mentioned. Reply to this email directly, view it on GitHubhttps://can01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fguilhemmarchand%2Ftrackme%2Fissues%2F282%23issuecomment-802171644&data=04%7C01%7Cgeorge.christianis%40bnc.ca%7C466d0af24dc94eeee16408d8ea388d36%7Cc21157cabce341a88aa7a23c4639610a%7C0%7C0%7C637516875890639966%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=ppf%2BTNV0eXUUSHDG9mjrYsc37Sk%2FtbVgLDnYoCvvhm8%3D&reserved=0, or unsubscribehttps://can01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAS6MOGN43IUGFXW7Y2Y3Y4LTEI6KHANCNFSM4Y5ZJZLA&data=04%7C01%7Cgeorge.christianis%40bnc.ca%7C466d0af24dc94eeee16408d8ea388d36%7Cc21157cabce341a88aa7a23c4639610a%7C0%7C0%7C637516875890649957%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=c9b%2F7oCoV65gGoxpCCp9ZY1Z17If0l54kswnku9pgNo%3D&reserved=0.

CONFIDENTIALITÉ : Ce document est destiné uniquement à la personne ou à l'entité à qui il est adressé. L'information apparaissant dans ce document est de nature légalement privilégiée et confidentielle. Si vous n'êtes pas le destinataire visé ou la personne chargée de le remettre à son destinataire, vous êtes, par la présente, avisé que toute lecture, usage, copie ou communication du contenu de ce document est strictement interdit. De plus, vous êtes prié de communiquer avec l'expéditeur sans délai et de détruire ce document immédiatement. CONFIDENTIALITY: This document is intended solely for the individual or entity to whom it is addressed. The information contained in this document is legally privileged and confidential. If you are not the intended recipient or the person responsible for delivering it to the intended recipient, you are hereby advised that you are strictly prohibited from reading, using, copying or disseminating the contents of this document. Please inform the sender immediately and delete this document immediately.

11gods avatar Mar 18 '21 19:03 11gods

Hi I came across this thread as I have the same issue on our development system. Its a single instance of Splunk running under VMware. Cores are 24/24 The issue has been apparent from when we first trialed this under version 1.2.46. It takes 3 min (yes, 3 minutes) to load the application then and now. I wonder if you could advise on where to look for issues as I see no specific load on the system when the app is loading. CPU utilization remains low throughout. Please advise if you wish me to log a separate post.

Currently using Ver 1.2.50 but still taking around 3 mins to load.

I have updated the pre-requisites where possible to latest versions too.

I ran the application a few times since and happen to catch a message on the browser address bar after several attempts. It appears in yellow...

"A web page is slowing down your browser"

FireFox: 3:00 mins to load app (now down to 2:30 after clearing all cookies) Google Chrome: 1min 40 to load app

juslisnen avatar Aug 08 '21 17:08 juslisnen

Hi @juslisnen !

All right, there is an uncompressible time to load the UI I agree, which is something I am working on for the future version of TrackMe, but this is a huge amount of work which is going to take time.

However, 3 minutes is excessive, you shouldn't be getting more than 50-90 seconds to load the main UI, from both Firefox / Chrome. Which is consistent with what I observed in a number of Production customer deployments too.

So, unless you have very specific things slowing you down (like a VPN poor connection before getting to Splunk Web), one option would be that you have unpexectly a really high number of records in the KVstores.

I have seen it by the past with customers for example having unknown issues with index time override creating toons and toons of sourcetypes or host, handing in the KVstore to have either a terribly high number of entities, or huge multivalue entites in the data hosts / metric hosts.

Can you report:

data source:

| inputlookup trackme_data_source_monitoring | eval keyid=_key
| stats count

data host:

| inputlookup trackme_host_monitoring | eval keyid=_key
| stats dc(data_host), dc(data_sourcetype)

metric host:

| inputlookup trackme_metric_host_monitoring | eval keyid=_key
| stats dc(metric_host) dc(metric_category)

One thing I would advise to see if it is related with the number of records, especially in a dev / testing, would to add one index only in allow list per category (so one allow list in each), then reset each collection (in the config UI) and see if it reduces the loading time. It could be that by the time you have lots of things hidden due to allow lists / block lists that are having some impacts on the load time.

Let me know

guilhemmarchand avatar Aug 08 '21 17:08 guilhemmarchand

Thank you for prompt response, much appreciated.

  • data source : 62 (most of them are inactive, only 7 active)
  • data host: 10 | data source type: 08
  • metric host: 04 | metric category: 01

Set allow list for the few data sources we have but made no change on load time. We do use a VPN before connecting to host. It could have a bearing.

FireFox: 3:00 Chrome: 1m:50s

juslisnen avatar Aug 08 '21 19:08 juslisnen

@juslisnen

I see, so yes indeed unlikely due to the number of entities, very tiny and nothing abormal.

I blame your VPN and the speed of the connectivity, likely this is very visible on TrackMe because the app has already a certain loading time in normal circumstances, so that makes it visible. But most likely you have a poor bandwidth and you would suffer from loading time in more than just TrackMe but aything that is a large enough.

guilhemmarchand avatar Aug 08 '21 19:08 guilhemmarchand

Thank you @guilhemmarchand

Yes you have described the scenario well. The screen is populated with all the fields within 30-40 secs but sits there for a further few mins before the screen is live. (if that makes sense).

Thanks for your input. Hopefully we wont see theses issues in live.

juslisnen avatar Aug 08 '21 19:08 juslisnen

@11gods with pleasure, you will let me know That time you described between the inputs loaded and when the screen is ready (the spinner disappears) is in normal circumstances quick. There is definitively a loading time which won't be bellow a minute or so, but more is not normal. I have had a customer with multiple env each running TrackMe where we access behind VPN but loading times were not that abnormal and close to what I described

Keep me informed 👍

guilhemmarchand avatar Aug 08 '21 20:08 guilhemmarchand