Gumball alignment to object

Hi, thanks. It’s not that big of a deal normally, but when mixed with this issue: Wrong selection of VA Objects in different display modes
it can be annoying.

When I can’t properly select a window inside the wall, I can window-select (pun intended) both of them and deselect the wall. The outcome is that I am left with a selected window, but with undesired gumball alignment.