See video
First I thought this was a bug. But then I realized it’s because I have AutoAlignCplane activated, turning it off fixes it. I’m not sure if this is wanted behaviour. I haven’t used the tool a lot yet but I’d find AutoAlignCplane only useful for Perspective view, but maybe other think differently?
I’m posting this here anyways so that you guys are aware that this is something that currently happens and should be considered and if anybody runs into it they can retrieve this info.