jump list polluted when use multiple split window

[theidexisted]

It works like a char in a single window.

But when I split the windows with vsp and use easy motion to jump between windows, then I can't use ctr-o to jump back, is there something wrong?