Input size checks

[WardBrian]

Would close #239

I only timed this in Python, where I was not really able to consistently time a difference even in a very simple log density.

Note: Some existing code will fail after this is merged, even if that code is technically buggy. Worth noting in the release notes.