Maybe have the 'add as a reviewer' checkbox turn into a 'remove me as a reviewer' when you're in the list

[riannucci]

It's a bit annoying to have to manually remove yourself from the authors list... it's also annoying when you do that and then get re-added automatically :P