Split file saving doesn't work

External Email - Use Caution

Dear list

Every now and then I cannot save my epochs objects due to this error.
This happens only for one of my subjects (out of thirty) and only on one
particular (bandpass filtered and hilbert transformed) raw file. I have
tried both the development version and newest stable version.

I guess it should take care of it automatically as I didn't change the
default split size of 2GB of epochs_hilbert.save()

All the best

Lau

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mail.nmr.mgh.harvard.edu/pipermail/mne_analysis/attachments/20200506/c26b5c43/attachment-0001.html
-------------- next part --------------
A non-text attachment was scrubbed...
Name: jopebdpemhbdokdd.png
Type: image/png
Size: 85241 bytes
Desc: not available
Url : http://mail.nmr.mgh.harvard.edu/pipermail/mne_analysis/attachments/20200506/c26b5c43/attachment-0001.png

External Email - Use Caution

hi Lau,

please open an issue and make the file available.

you can save it in .h5 format so we can debug the fif IO

Alex

External Email - Use Caution

I suspect I understand why this can happen from the code -- we calculate
the splits using just the size of the actual data, but end up writing that
plus other things (drop log, metadata, etc.) which can push it beyond the
2GB limit. For now you can do something like `split_size='1.9GB'` to work
around the problem, but hopefully we can cook up a proper fix for it soon.

Eric

External Email - Use Caution

Hi Eric

That actually make the trick, so it is likely it is as you describe.
Thanks a lot for your suggestion!

@Alex: are you still interested in having an anonymous copy of the file?

All the best

Lau

External Email - Use Caution

@Alex: are you still interested in having an anonymous copy of the file?

no need. Just confirm that the fix from Eric

does the job.

Alex

External Email - Use Caution

it indeed fixed my issue - thanks for your quick response!