How to pan the fullscreen map with controller?

[Mister-Curious]

I'm loving this mod and its usefulness, however I am struggling to pan the fullscreen map with my controller. The right stick does a great job of controlling the zoom level, but the left stick doesn't do anything. It was my hope that I could simply pan the map in whatever direction using the left stick but it doesn't work.

Is this a bug, or is it something that is configurable somewhere ?

Thank you!