Lofting with complex curves

I am trying to turn a orthogonal form in to a more organic singular surface geometry. I have tried lofting but it has issues as it has both internal and external surfaces that connect as well bridges connecting these blocks. Is there a way of doing this so it appears as one continuous form or is it best to as a series of smaller loft and network surfaces?
.

Hi Ross- if the sides are all vertical. use ExtrudeCrv > Solid=Yes on the base curve of each blocky shape and extrude to the height of the top curve. BooleanUnion as needed to make it one object. Does that make sense with what you have?

-Pascal