Silently skips a file!

[lucuma13]

I'm consistently having a very text small file (19 bytes) consistently skipped silently when making either one or two copies, with or without mhl. It does appear on the mhl manifest, but it does not get copied across. It's probably a bug with small files, but I'm attaching the particular one that is failing just in case.

SDINFO.TXT

[cbenhagen]

Thanks for the report!

The file is part of the default ignore list found in https://github.com/ottomatic-io/ocopy/blob/main/ocopy/ignored.py. This ignore list is also included in the MHL file as per the spec. But if we also create a <hash> entry for ignored files that would be a bug.

The file is used internally by Sound Devices recorders to track which file they last played or last recorded. It has no value outside the recorder and can quickly cause issues if a card is not erased after backup and gets filled with more audio files. This was a common issue.

I opened #49 to track that we need to provide more info why a pattern ended up on the ignore list.

Also we should make the ignore list configurable: #48

[lucuma13]

Makes sense! The configurable file is a great idea, and any defaults ignored could be listed in the README too.

I haven't experienced issues myself with SDINFO.TXT (nor SONYCARD.IND or .SD_PROJECT) but I'm always happy to future-proof my workflow! What kind of issues did you encounter when a card got filled with more audio files?

In either case, I feel like ocopy has an incredible potential as a transfer tool also outside of the DIT world, and different people in different fields might have differences about what they feel comfortable ignoring. If the ignore list becomes configurable, it'd be safer to make a recommendation to ignore certain files in the README.md instead of include them by default in that list.

Aside of that argument, a potential points of failure within the DIT world:

1. a DIT makes a backup on-set using Silverstack and does not ignore any files (SDINFO.TXT gets copied as a file, and makes it's way into an MHL, legacy or ASCMHL)
2. a media manager then backs up the transport drive into two GRAIDS or a server using ocopy - SDINFO.TXT gets skipped and the mhl manifest is not verifying anymore.