Extreme save times of large files (more than 8 min) but

Hi @pascal ,

I suppose so you got my example file. I have a new information for this issue - if I use incremental save instead save than the scene is saved in 38s instead 8:30min.

I hope the save time can be nearly so fast like incremental save.

Best -
Micha

Hi Micha - try changing the advanced setting here:

-Pascal

Hi Pascal,

the option was disabled and I disabled it now. The save time is ~6min, still much to slow.

Micha

Hi Micha - you can also try turning off compession -

-Pascal

Great, this bring down the time a lot. Only could I get both - a small file size and a fast save? 8 min for compression looks like something is wrong.

Why was the incremental save so much faster than the standard save? Are not both using compression?

@pascal Something is not working properly. When I turn off compression, standard storage is fast like incremental storage, but incremental storage is much smaller than standard storage.

Simple test - I save my current project with incremental storage: after a few seconds I get 1250 MB. Now I save the file with standard memory: after a few seconds I get 1800MB.

So, turning off compression is not a solution, incremetal save shows that speed and high compression are possible in combination.

It would be nice if we could find out what is going wrong here. Or is someone else from the team the better contact?

Iā€™m going to hasard a guess hereā€¦

The normal Rhino ā€œSaveā€ function works like this - for a file that has been saved at least once:

  1. Write a temporary file to disk
  2. Make sure that the temp file has been written correctly
  3. If so, delete the original file, and rename the temp file to the original file name

IncrementalSave, as it is saving the current state of the file as a new file, does not need to write the temp file and check/rename it to the original name afterward. It just simply saves the file. So maybe the time problem is steps 2 and 3 above, especially if the file has compression enabled.

Thatā€™s my theory at least, but I could be way off in left field.

Iā€™m curious for someone of the McNeel team who will test it and found the reason for the big difference (save is more than 10 times slower than incremental save).

I doubt theyā€™re seeing it, or other people would be seeing it too. Iā€™ve never seen such a thing, Iā€™ve seen kind of the opposite, but that was until I figured out how to make IncrementalSave use SaveSmall.

I got an idea and I did some more tests - I found the problem was that ā€˜save texturesā€™ was enabled. Maybe incremental save doesnā€™t save textures. I suppose so the texture collecting progress is so horrible slow.

Itā€™s a pitfall - if I open a new Rhino task and try to save the scene than ā€˜save texturesā€™ is automatic enabled. Nearly never I need this function and so I must careful disable it always. Iā€™m working on very large files and this option cause a slow down and that the hard disk is faster filled.

Iā€™m glad to have a solution now. :slight_smile:

@pascal Is ā€˜save texturesā€™ enabled per Rhino default or is it at my machine only? I think this options should be disabled per default.

It seems to be a default for new files. Maybe itā€™s in the template? Yeah I donā€™t recommend using it by default either, yes it was years ago I was in a situation where it was ā€˜neededā€™ but it was not reliable.

I thought it was supposed to remember the last used settingā€¦

It does for a particular file, but new files have it on by defaultā€¦so maybe itā€™s a document setting thatā€™s saved in the template?

Hi Micha - There used to be a setting in Document Propertiesā€¦ it was removed because, ā€˜when would you not want to save the textures?ā€™ Well, in general, why not, but this would be a caseā€¦ I still think it is the exception to have files with so many or so large textures that it is a problem. (PBRs may change that)

In the meantime, if you -Save you can set that even after the file has been saved - is that not sufficient?

-Pascal

Yes, for me itā€™s ok to disable it all the time. Itā€™s one more thing I have to keep in mind :wink:

I see no reason to always save the textures in a Rhino file. The textures are on my hard drive and I only save them to the file when I need to send a Rhino file with textures to a client. But thatā€™s not necessary on a daily basis. But daily I have to save my work.

My needs are a fast save and not so big Rhino files.

Hi Micha - I guess the underlying thought is that it makes file sharing a mess if textures are not saved by default, and that would be a far more common problem.

@Micha - I understand it is a bit awkward - for now, you can make an alias or button that has -_Save _SaveTextures=_No and click on Browse at the command line the first time a file is saved.

-Pascal

1 Like

Sureā€¦but it inflates file sizes (which does matter with SSDs or network locations,) leaves extraneous temp files scattered around, and my experience saving textures a while back is that sooner or later Rhino will lose track of them and you have to rebuild all your materials.

If we look at say, InDesign, which is all about linked external files and the workflow of passing things along to other people, it doesnā€™t normally embed anything unless you explicitly do it, and when you want to package everything up to send downstream thereā€™s a separate command for that.

1 Like

Hi Jim - I can imagine it may need fixing, but as a default, it still seems more certain to work. If I were king, I would simply restore the document setting, then it could be in a template, and for the most part weā€™d be done. Iā€™ll see what we can do.

@Micha - if you use -_SaveAsTemplate it looks like you can make a template that works as you want.

-Pascal

@pascal One more thought - could it be that the code for packing the textures is unusual slow? All textures are opened at the current scene. Also starting a rendering doeā€™s need so much time (in this case all textures are loaded too), so why is saving with textures so extreme slow?

Thank you for the hint with the template.