GCP: Allow specifying zones, not just regions, for Google Batch compute environments
acknowledged
C
Coral reef Lamprey
GCP has a new feature designed for AI/ML use, zonal buckets, which promise lower read/write latency but are pinned to one specific zone. We can accomplish this by adding a clause to the
nextflow.config
override for the compute environment, but it would be good to be able to just set this on the compute environment directly.C
Coral reef Lamprey
Note having tested the zonal buckets, they're still early beta and currently have limited ways to interact with them, which means they don't currently work with Tower. I think this is a good idea for the medium term - faster gcs access makes a big difference - but it's low priority for the time being.
Rob Newman
Coral reef Lamprey: We appreciate the update! Knowing this is very helpful as we plan 2025 Q3/Q4.
Rob Newman
acknowledged