(This appears to be at least partly a problem with a specific file or configuration here see below…)
They are just too inflexible, I can rarely put them exactly where I want.
In cyan above, what I can get. In red, what I want to have (simulated with a leader).
Basically the radius dimensions are missing a control point. When you turn on points, they have a center “grip”, an arrow “grip” and a text “grip”. But moving the text grip only changes the position and/or length of the arrow section, it cannot change the tail of the leader and bring the text with it.
We really need that 4th control point to make them work more like a leader.