Destroy borrowed resources during cleanup

[iRevive]

My attempt to fix #291

[ChristopherDavenport]

I've been working on something that takes this to a much further degree. The one major takeaway I've had is that you don't want this to be always true. It seems in line with the current implementation though. But this current implementation needs a lot more power to handle even more complex pooling scenarios.