Use `reraise` and verify that full stack traces are preserved

[lukstafi]

I wasted some time debugging, and only discovered the problem by switching to the flushing backend, where I got a nice stack trace.