It depends on what you are trying to achieve.
If you have a very large wall, you won’t be able to see details on each individual brick. You might therefore consider to use a simplified version of the brick to build the wall.
Something else you could try is to mesh one brick and use that mesh to build the wall. Then join all (disjoint) meshes into one. That way, the overhead will be much lower.
Your “update 2” file performs rather well here on my PC (Windows). So, if that is the file that you are working with and giving you problems, it might also be worth looking into updating your hardware.