Dimitri Fontaine

You can try to play with batch size options, and in particular reduce the *prefetch rows* setting, which defaults to 100000 rows (see https://pgloader.readthedocs.io/en/latest/pgloader.html#with).

The problem is with SBCL Garbage Collector, and I don't have proper answers for how to avoid it in general. I guess at some point we should get back to...

I'm not sure if it's possible to set that to a saved image at run-time, my understanding was that it needs to happen when cooking the image somehow?

Nice! Do you want to try to hack `./src/save.lisp` so that we can pass a dynamic space size either when building the docker container, or maybe to the resulting pgloader...

Have a look at https://github.com/dimitri/pgloader/blob/master/Makefile#L9 for how to define the dynamic space size in the build process for pgloader. Currently, this only works for the _legacy_ build system that relies...

You can also try to limit the amount of memory that's used by pgloader by tweaking the batch size parameters, starting with `prefetch rows = 10000` (it defaults to 100...

> @dimitri How does one produce a Lisp backtrace with pgloader? Using `--debug` triggers a condition handling that uses trivial-backtrace and provides some level of information. The code being multi-threaded...

Hi, to be able to reproduce I would need the CREATE TABLE sql definition and also a sample data file, please. I tried reproducing with SBCL 2.2.6 and the load...

I believe the problem lies in the MS SQL driver that pgloader depends on. Specifically see: https://github.com/archimag/cl-mssql/blob/045602a19a32254108f2b75871049293f49731eb/src/connection.lisp#L73 Could you please open an issue there and follow-up when we have a...

Do we know if release 3.6.2 is good now?