DB gets corrupted very often

[rmax]

In a high load environment, where spiders can be killed due to memory issues, the DB can get corrupted.

It would be nice to load to override the DB via a setting (i.e.: DELTAFETCH_DBM)