Try adding a little thickness to the surface then remesh. Afterwards, select and delete the additional faces. The small holes are going to try to be looped as open edges. This in combination with your edge length size mean that loops can’t be created since the edge length is as long as the hole. All of this together means you end up with unwanted noise.
So for this case having some additional face data from some extrusion surfaces helps the algorithm understand how these holes work and how to better preserve them.
srf to test remeshed.3dm (1.0 MB)