postman-app-support
postman-app-support copied to clipboard
postmanlabs
Postman 8.0 Runner performance issue
Describe the Issue
After running my collection, Postman froze up for a couple minutes. It then unfroze, but started responding very slowly. Memory usage was almost 2GB. About 5 minutes after that, it started running normally and memory usage dropped down to about 1GB. My collection has about 1000 requests and over 2.5k assertions. I did have save responses checked off.
This did not happen with prior versions of Postman.
Steps to Reproduce
Run a large collection, Postman will become unresponsive.
Screenshots or Videos
Environment Information
- Platform Type: Native Desktop App
- Postman Version: 8.0.2
- Operating System: Windows 10
Also noticed today that after running a collection, CPU usage seems to never drop:
Even after closing the runner tab:
Can you check if Postman keeps logging to Postman Console even after the collection has executed all the requests? I believe that is the issue for me at least.
Yep, after the console finally finished logging everything, the CPU usage went down. It appears the console is lagging way behind the actual requests.
I created a feature-request to have a way of disabling the logging: https://github.com/postmanlabs/postman-app-support/issues/9544#issuecomment-774499873
Update: We have released some Performance Improvements in Collection Runner in Postman version. 10.9.3. This should improve memory usage by runner (by freeing up memory during the run).
Our internal benchmarking suggests that this should improve the usage by 2x( the same amount of memory to be consumed for double the no.of iterations or double the size of the collection)
Please let us know your feedback on the above and if this helps your workflows.
We are trying to gather more information on the performance challenges that you face, please feel free to setup some time with me using this calendly link, if you would like to share more information or walk us through your usecase.
Note: We are evaluating having the option to suppress console logs too meanwhile. Will share more updates on the https://github.com/postmanlabs/postman-app-support/issues/9476#:~:text=May%2020%2C%202021-,Postman%20console%20lags%20behind%20Collection%20Runner%20on%20Desktop%20Application%20%239929,-Open regarding this.
feature-request 9544 as mentioned above is finally implemented and might solve this problem as well.
Hi all 👋
Glad to inform you that we have made some Performance Improvements to collection runner to reduce the CPU utilization/overhead especially while running large collections.
Please let us know if you still see any issues while running large collections. I will be closing this ticket, but please feel free to reopen if your issues still persists.
Cheers! Malvika
@malvika-chaudhary Starting from which release is this feature implemented?
@NelemaniA you will be able to find this feature from version 11.29.5 onwards
