It has to do with floating point representation in a computer. Most of the geometry is represented by double precision floating point numbers, but meshes by single precision floating point numbers.
As numbers become larger and larger, the gaps between consecutive floating point numbers becomes larger too. If you are far from the origin, these gaps can become of the same magnitude as the size of your object. Then you start to see jagged edges.