This was previously mentioned here and I still run into this issue almost every day using Rhino in just 2D.
As I mentioned before, my theory is each zoom level is stored in cache to prevent redraws and the more you move in and out of your drawing, the more renders as stored.
What is interesting is I never run into this issue when I am using Rhino for modelling, only whilst drafting.