AWS HealthOmics now supports ephemeral storage for private workflows

AWS HealthOmics Ephemeral Storage for Private Workflows

AWS HealthOmics now offers ephemeral storage for private workflows, providing bioinformatics workloads with dedicated scratch space for more consistent run performance and lower costs. Each workflow task receives a dedicated local volume mounted at /tmp, enhancing the performance of tasks like genomic sequence alignment, BAM sorting, and variant calling.

Key Features

• Dedicated Scratch Space: Each workflow task gets a dedicated local volume at /tmp.
• Performance Improvement: Tasks generating significant scratch data experience faster run times.
• Isolation: Scratch I/O is isolated from shared run storage.
• Default Storage: Each task includes 16 GiB of ephemeral storage at no additional charge.
• Customizable Storage: You can increase ephemeral storage up to 3,072 GiB per task.
• Encryption: All ephemeral storage volumes are encrypted and deleted when a task terminates.
• Regions: Available in US East (N. Virginia), US West (Oregon), Europe (Frankfurt, Ireland, London), Israel (Tel Aviv), and Asia Pacific (Singapore, Seoul).

What to do

• Enable ephemeral storage at runtime using the StartRun API.
• Update your WDL, Nextflow, or CWL workflow definitions to allocate more ephemeral storage if needed.
• Refer to the AWS HealthOmics User Guide for more details.

Source: AWS release notes

If you need further guidance on AWS, our experts are available at AWS@westloop.io. You may also reach us by submitting the Contact Us form.