Multi-line command history inconsistent behavior

[leventp]

When pressing up-arrow a previous command is displayed as expected, again pressing up-arrow the cursor moves to the beginning of the command line. It should display the next command in history. Third up-arrow displays the next command in history. This behavior repeats for each command in history. Down-arrow seems to work fine.