I noticed that for surfaces that have thickness enabled in properties (Rendered display mode), the clipping plane ignores the void that needs to be filled.
I see how that could be useful to have. I put it on the list as RH-66274 but am not sure how feasible this is.
For the time being, you could use
ExtractRenderMesh to show a filled section.