Ivan Kozik

Results 135 comments of Ivan Kozik

Implementing this in grab-site means duplicating some wpull logic (e.g. knowing not to go up above any of the start URLs; parsing and getting the parent URL; making up `inline=0,...

No immediate plans to do this in grab-site partly for the reasons mentioned above. Maybe someone can try to do this in wpull, or if that doesn't work out, finish...

That `http_proxy = session.args.http_proxy.split(':', 1)` makes me think something set an environmental variable to use an HTTP proxy. Try `env | grep -i proxy` and maybe unset the variable? Please...

I recommend deleting this line in your local copy to avoid grabbing any page requisites: https://github.com/ArchiveTeam/grab-site/blob/fe3cc6ab1465f4c8ea1f83255187085c43a95e0c/libgrabsite/main.py#L241

When I removed that (I think because wpull 2.0 changed the APIs too much), the idea was that the user could still make a copy of `wpull_hooks.py` and then use...

I haven't used Docker, so bear with me... 1) Why `COPY` to `/app/` if you still subsequently do a `pip3 install .`? If you `pip3 install .`, then `grab-site`, `gs-server`,...

`pip3 install .` should install grab-site in addition to the dependencies, though. `pip3 install` puts things in `/usr/local/bin` while `pip3 install --user` puts things in `~/.local/bin`, unless there's some extra...

Is there an issue filed somewhere for py-lmdb's failure to compile on Alpine Linux's gcc?

Thanks for the fixes. I am currently somewhat busy and under-dockered, can a grab-site user please give the Docker instructions a try and see if they work? (And let me...