Unify deser impl

[ijackson]

As part of my efforts to try to make #[deser(flatten)] work correctly (#336) I did some refactoring. Although the deser work is unfinished, I think these two commits are worth submitting separately.