John Berlin
John Berlin
@machawk1 > Very large payloads, as described in this ticket (and potentially generated per #66), should be a test case in WARCreate. We currently have no test suite integration but...
@machawk1 You mighy have better luck using https://github.com/feross/buffer It's nodes buffer module but for the browser. I found it useful for stuffing content into blobs.
@machawk1 I would assume the "right" way would be to turn the HTTP/2 protocols into HTTP/1.1. Reasoning: - currently no existing replay system handles replay of HTTP/2 - tools like...
PRs welcome :wink:
`node-warc` welcomes all contributions! My guess is that you are not writing a single warc info record using [writeWebrecorderBookmarksInfoRecord](https://github.com/N0taN3rd/node-warc/blob/77fc6574e47d30b1ba0b30f578ef86119334cde8/lib/writers/warcWriterBase.js#L248) that contains all all the URLs of the pages you wish...
Have you tried to use [puppeteer](https://github.com/GoogleChrome/puppeteer) rather than electron? I have found that using a full browser either Chrome or Chromium (brought in via puppeteer) controllable via puppeteer or [chrome-remote-interface](https://github.com/cyrus-and/chrome-remote-interface)...
Ultimately the best advice I can give without seeing how you are doing the capturing (either src or minimal working example) is to treat each page as a standalone WARC...
Did the electron request [capturer](https://github.com/N0taN3rd/node-warc/blob/master/lib/requestCapturers/electron.js) and [writer](https://github.com/N0taN3rd/node-warc/blob/master/lib/writers/electron.js) not work for you?
`maybeNetworkMessage` is a utility function in order to allow you to not have to add an additional `message` listener to the `debugger` :smile: As far as your shared src code...
You are not adding the pages array, and the warc is not being written to in appending mode. See the electron generator [docs](https://n0tan3rd.github.io/node-warc/class/lib/writers/electron.js~ElectronWARCGenerator.html) for more details. Correcting those issues should...