Record time metrics for stageIn / stageOut
acknowledged
F
Flax Beetle
This is a feature request and the work probably applies to both the Seqera Platform and Nextflow. We would like to capture the time being spent on
stageIn
and stageOut
and make them visible in Seqera Platform/Tower. Right now we can see there's a difference in
duration
and realtime
, but we can't drill down into how much is actually spent on waiting
vs stageIn
vs stageOut
.The timeline has some visualization that helps, but still doesn't distinguish
waiting
vs stageIn
. Knowing how long stageIn
and stageOut
take will inform whether we decide to use scratch/stageInMode
or not.Rob Newman
acknowledged
C
Charcoal Mandrill
I think you should be able to determine some of this from the time-stamps on the files in the work dir? Assuming you are using a stage-in method that copies the files instead of symlink