Compute Environment creator as stand-alone tool
complete
C
Charcoal Mandrill
It would be really helpful if the method for creating a Compute Environment in AWS for use with Nextflow could be performed outside of Nextflow Tower / Seqera Platform, as some sort of standalone tool. So that users who want to execute with AWS Batch could easily get a Nextflow-ready compute env without needing an entire Tower instance set up to do it.
Not sure how feasible this is but it would be really really helpful to have. Let me know what you think.
Rob Newman
marked this post as
complete
There are now multiple ways of achieving this:
- Tower CLI (tw)
- seqerakit
- Terraform framework
Rob Newman
Hi Charcoal Mandrill - this can currently be achieved using the AWS CLI command create-compute-environment. This returns the CE name and ARN. Does this satisfy your request or are you needing something different/more specific?
C
Charcoal Mandrill
Rob Newman honestly I had never tried that before, I was kinda assuming that Nextflow Tower must be doing something special behind the scenes due to all its extra buttons available for things like using Wave containers, etc..
Rob Newman
Charcoal Mandrill: Did you have a chance to look at this option?
C
Charcoal Mandrill
Rob Newman using the aws cli really is not sufficient, Tower Forge is creating a lot of resources. An example Terraform that was sent over needed roughly 700 lines of code to replicate what Tower Forge is doing. Right now we are likely going to use Terraform for this. Thus, we need a Seqera Platform Terraform Provider, and some public Terraform configs for AWS + Seqera Platform would likely be needed (we are developing some but cannot post them publicly for others who likely need this too)
Rob Newman
marked this post as
acknowledged