ESC key works fine... Deleting components works, too.
In this second I found the cause:
there's this (new?) mode, when objects are selected, their points are displayed automatically without having turned on 'point display'.
It's called "Turn on control points when selecting a curve", under Options > Mouse.
In that case, the object cannot be deleted! Makes sense actually...
Sorry for the noise!