Any time I’m replacing an icon and want to change this setting I have to do it two times (and press OK in between each time and open the dialog again).
(Also, just noticed, if you’re changing the default icon on an existing toolbar, and want to change this setting, even the light side icon doesn’t get saved. You have to do that twice too.)