RealityScan and Rhino

Gallery Art Sculpture
1

Using RealityScan on iPhone 12. Based on approx. 70 images. The original mesh model has been cleaned up slightly in Rhino and Photoshop and the base replaced by nurbs model. Sculpture by Danish artist Hans Oldau Krull. Quick animation showing the cleaned up mesh from the scan with no diffuse map on - amazing detail, considering it took ~5 minutes to scan/photograph it. This is great for getting custom assets into your render scenes in almost no time.

Krull 01
Krull 012473Ă—1540 425 KB


-Jakob
Edit: Original sculpture is soapstone

2

Jakob,

Do you know if RealityCapture is using the depth maps captured directly from the iPhone or is it computing depth maps based on the images only?

A related question would be if you are using JPGs or Raw / HDR images to import into RealityCapture?

3

Hi @cdordoni
Note that this was made with the “simpler” IOS-only (Android is coming!) app RealityScan, which - as far as I understand it - is based on the same tech as RealityCapture, but in an easy-to-use interface. Since I’m using an ordinary iPhone 12, there’s no Lidar involved. No idea if they use the Lidar data on the phones that support it :grimacing: The app is great (but eats your battery up in no time, so bring a power bank!). And it’s (for now) free to use. Final model, after server’s done computing it, is uploaded to Sketchfab and you download it from there.
-Jakob

4

FWIW, if you have a mac running Apple Silicon, the “Object capture from photos” might do the same thing?
-wim

5

Hello Jakob,

Thank you for posting this model. This is a very interesting and [yes] appears to be a quite useful visualization technique.

Thank you,

Andy

6

I made a scan on iPhone the other day using Scaniverse. The speed is incredible, and the meshes it generates are fairly detailed. It seems to work best with objects that have a matte texture but that is to be expected.

7

Nice work! I just did a scan with my old IPhone SE of this gadget (a camber/caster tool for front wheels).
I used an app called PolyCam. I also have IRhino on the phone and tried it to scan but it needs one of the LIDAR phones.

8

Awesome! :sunglasses:

9

How do you get Scaniverse files into Rhino. I have tried importing but it only brings in the obj file and no mareials.

10

Export fbx to dropbox is what we do.

11

Thank you. I tried this but it still doesn’t work.

12

Mesh or splat? We process all as mesh.

13

I scan and export scanned model as a mesh as an obj file. When I open the zip file I find I have three files. An obj file, a mtl file and a jpg. If I import the obj file into rhino all I get is the mesh. Can’t seem to be able to import the mesh and other files together.

14

We use fbx, but you must rename the textures if you work with multiple in a document since the exporter reuses the texture name.

15

I use Import command to import textured .obj files with associated .mtl and .jpg files into Rhino, The .obj, .mtl and .jpg files are in the same directory and have the same name. Files in a directory I import from, as seen in File Explorer:

image
image1167Ă—744 33 KB

What see when I start Import: Note that the Import command dialog only displays the .obj files. It does not display the associated .mtl and .obj files.

image
image1062Ă—327 11.5 KB

Import command setting used.

image
image567Ă—573 22.9 KB

What I see in Rendered display mode: The textures are not displayed in other display modes such as Shaded.

image
image1920Ă—883 130 KB

image
image1920Ă—1100 118 KB

16

This is an intentional bechaviour.
You can manage this setting in the viewport stile option or setting this object to display as rendered mode in the object properties.

17

@skysurfer My post was intended to be informational about how I display photo textures, not a report of a problem.