We observed that some tools, e.g.
sentieon driver ...
create many temporary files (>>1k) written and deleted during the run. Syncing these files with S3 takes a lot of computing time and often results in Fusion errors or process timeouts that require a process restart.
I suggest creating a mechanism that will allow us to define (using pattern matching) which files are not synchronised by Fusion. This can be done via an ignore list, similar to the .gitignore file: