How to create a boundary line from objects? (trees)

You can get the tree mesh vertices and compute their boundary using the native Convex Hull Grasshopper component. For concave hulls (i.e. like in your sketch) you can use alpha shapes:

Or dynamic relaxation (i.e. Kangaroo2):