ipwb icon indicating copy to clipboard operation
ipwb copied to clipboard

Potential integration with WASAPI?

Open machawk1 opened this issue 7 years ago • 4 comments

There is currently some work being done on an IMLS Grant for the WASAPI project, which I believe initially involves Archive-It. There was also some talk awhile back of webrecorder supporting it for WARC upload.

We should investigate any advantages that adhering to this protocol may provide. Interoperability may facilitate new users trying out ipwb.

machawk1 avatar Aug 23 '18 00:08 machawk1

Use case, allowing a user to authenticate with their Archive-It credentials (using A-It's OAuth, I presume) and single-click to pull in all their remotely stored WARCs into their local ipwb instance.

machawk1 avatar Aug 23 '18 00:08 machawk1

There exists a Python (3) client for Archive-It's WASAPI implementation, see https://github.com/unt-libraries/py-wasapi-client/issues/19.

machawk1 avatar Aug 23 '18 00:08 machawk1

Webrecorder now has a WASAPI endpoint.

See https://webrecorder.io/docs/api (via @N0taN3rd) or access by collection at https://webrecorder.io/api/v1/download/webdata.

If you log into your account, doing something like https://webrecorder.io/api/v1/download/webdata?collection=my_collection would should give you a JSON response. (thx @ldko)

machawk1 avatar Oct 15 '19 18:10 machawk1

I have developed a private integration of ipwb with WASAPI that hooks into the admin interface for importing WARCs. I hope to submit a PR and get this merged soon.

However, it might also be useful to allow this functionality to be invoked at startup of ipwb replay, e.g., allow a user to submit the parameters via the CLI and initiate the web access points with data pulled from WASAPI endpoints by default. This flow would also be interesting for automated testing.

machawk1 avatar May 25 '21 14:05 machawk1