Fix visibility check on subrepos

[peterebden]

Looks like this never got added when we added the subrepo concept.

This is of course fixing a bug so we can call it not a breaking change, but it probably will break things out there that are incorrect. Arguably it may be safer to do this at a major version.

[stale[bot]]

This issue has been automatically marked as stale because it has not had any recent activity in the past 90 days. It will be closed if no further activity occurs. If you require additional support, please reply to this message. Thank you for your contributions.