Auto-save to har/proxyman log

[wabiloo]

Description

I have to execute long-running processes (ABR video streaming sessions for example), which I later on analyse through scripting, from .HAR or Proxyman logs. The sessions can be several hours, sometimes even overnight.

I would like to be able to to have Proxyman auto-save selected traffic into HAR/logs, such that whenever a new request matches the current filters, it gets saved into the output file.

It's important that I'm able to do this based on filters I apply to all traffic being monitored, so that the export file doesn't grow too large too quickly and contain all sorts of irrelevant information.

Why this feature/change is important?

Currently, it is a manual process to select the logs I want in proxyman, and then export them to .HAR/Proxyman Log. If my computer crashes, or the Proxyman proxy stops working for any reason, I run the risk of losing all data.

[NghiaTranUIT]

@wabiloo You can export with proxyman-cli command line. All you need it write a bash script to call this command after a period of time that you wish.

For now, only ProxymanSession format is supported. I will add HAR or Raw Requests/Response mode this week 👍

• Export all (ProxymanSession)

/Applications/Proxyman.app/Contents/MacOS/proxyman-cli export-log -m all -o "~/desktop/all"

• Export certain domains (Only Host, no scheme, no port, no paths, and no Query)

/Applications/Proxyman.app/Contents/MacOS/proxyman-cli export-log -m domains -o "~/desktop/twitterlog" --domains 'api.twitter.com' --domains 'www.producthunt.com'

[wabiloo]

Brilliant, thanks.

A couple of questions though:

• When using the ProxymanSession format, how can I process this outside of Proxyman? This is not the format as the Proxyman Log v2...
• HAR and Raw will be useful, but I'd really like if it could also support your Log v2 format (as I already have built a Python module to parse and process it)

[update]

• On the other hand, if I use -m domains, the output becomes then proxymanlogv2. I'm not quite sure I understand the difference in behaviour (but - assuming it's not a mistake - suits me well)...