`wezterm cli` commands are very slow, for example when switching panes

[pprotas]

What Operating System(s) are you seeing this problem on?

macOS

Which Wayland compositor or X11 Window manager(s) are you using?

No response

WezTerm version

20240609-095134-f5e496eb

Did you try the latest nightly build to see if the issue is better (or worse!) than your current version?

Yes, and I updated the version box above to show the version of the nightly that I tried

Describe the bug

I am trying to use wezterm cli to switch panes (from neovim using keybinds), but it's very slow. There is a very noticeable delay when switching panes, and this is frustrating in real-world usage because I expect an action like this to be instant when navigating between panes with my keyboard.

In particular, I am referring to wezterm cli activate-pane-direction, but it seems like the delay is present even when running wezterm cli

To Reproduce

1. Open two panes next to each other, in a split
2. On the rightmost pane type wezterm cli activate-pane-direction Left
3. Notice that the cursor doesn't appear in the left panne immediately
4. Notice that after a delay, the cursor becomes active in the right pane

Configuration

no config

Expected Behavior

The pane switching should be instant with no delay

Logs

No response

Anything else?

Video recording to showcase this issue, I ran wezterm -n to skip my config

https://github.com/wez/wezterm/assets/30273418/90851e7e-f13b-4428-b832-ed2d3e35f39f