Hello- it depernds on the object - if the box is an extrusion, then ‘by object’ should works as you expect, however, objects that do not have an inherent plane do not remember unless the gumball placement on the object has been modified. If the box is a polysurface, there is no inherent plane and Gumby will not find an orientation to the object.
-Pascal