warcio.js

warcio.js copied to clipboard

Fixes #58 This PR modifies canonicalization of non-GET request bodies into query strings to be consistent across Webrecorder projects. It introduces a new test case that is also in pywb...

tw4l

running example in browser leads to import error

1

running [the first example](https://github.com/webrecorder/warcio.js#reading-warc-files) in the browser leads to an import error: ``` Uncaught TypeError: Failed to resolve module specifier "hash-wasm". Relative references must start with either "/", "./", or...

msramalho

tsc build issue when including warcio in esm project

1

I'm including `warcio` in an ESM Node.js 20 monorepo with TypeScript 5.3.2 and am experiencing build failure when running `tsc --build`. The relevant `tsconfig.json` entries are: ```json "compilerOptions": { "module":...

andrewmackrodt

It looks like the transpiled warcio index.cjs is attempting to use a require( ) for the base32-encode module. However, base32-encode has stopped supporting cjs. Our own project used babel to...

halmos

Specifically: - [x] Errors from `pako` and `stream-buffers` when used in a project with Typescript where `compilerOptions.skipLibCheck` is `false` - [ ] Similar errors from `hash-wasm`, also when imported in...

emma-sg

Bumps [@babel/traverse](https://github.com/babel/babel/tree/HEAD/packages/babel-traverse) from 7.19.4 to 7.23.2. Release notes Sourced from @​babel/traverse's releases. v7.23.2 (2023-10-11) NOTE: This release also re-publishes @babel/core, even if it does not appear in the linked release...

dependabot[bot]

Related to https://github.com/webrecorder/specs/issues/141 warcio.js and pywb have slightly different behavior in terms of how keys are handled. For example for an input `{"a": [[], {}, true, false, null, "", "...

tw4l

Node JS: crypto import polyfill not taken into account?

2

Hi there 👋 ! I see that there is now a [polyfill to automatically import and declare `crypto` in the global scope](https://github.com/webrecorder/warcio.js/blob/main/src/polyfills.cjs#L10). Unfortunately, I'm getting the following error when using...

matteocargnelutti

There are a couple of `console` calls in `warcio.js`' codebase that make it difficult to keep the verbosity of software using it under control. - https://github.com/webrecorder/warcio.js/blob/main/src/lib/warcparser.ts#L88 - https://github.com/webrecorder/warcio.js/blob/main/src/lib/readers.ts#L232 It would...

matteocargnelutti

Multiple WARC-Concurrent-To fields

1

Hey Ilya - in the spec a record can have multiple WARC-Concurrent-To fields, e.g. ``` WARC-Record-ID: WARC-Concurrent-To: WARC-Concurrent-To: ``` > As an exception to the general rule, several WARC-Concurrent-To fields...

mattfysh