I have tried and failed for ~5 years to solve this problem with bricks.
One area can look fine but it falls apart somewhere else when all rows are not the same length.