Skip to main content
OpenSRE integrates with WDL (Workflow Description Language) pipelines executed through engines like Cromwell or miniWDL. It automatically traces all WDL tasks as they run, giving per-task performance data and cross-node visibility without modifying workflow definitions.

​
Why use OpenSRE in combination with WDL

While WDL focuses on portability and reproducibility, it lacks system-level telemetry. OpenSRE adds observability that helps teams debug and optimize large WDL workflows:
  • Step-level execution graphs for each WDL task
  • Real-time metrics for CPU, memory, I/O, and storage
  • Correlated logs and system traces even if task logs are minimal
  • Cost and resource attribution by sample, node, or step
  • Works locally, in HPC, or in cloud environments (AWS, GCP, Azure)

​
Getting Started

​
Prerequisites

  • WDL engine installed and working (e.g., Cromwell or miniWDL)
  • OpenSRE installed on your operating system

​
Just run your pipeline, OpenSRE will automatically attach

If OpenSRE is already installed on your operating system, you only need to enable the OpenSRE agent for pipelines that have not been run with OpenSRE before.
In that case, run the following command: 
sudo tracer init --token <your-token>
Go to our onboarding to get your own personal token
When running this command, you will be asked to name your pipeline for clear labeling in the dashboard.

​
Examples

Launch the OpenSRE demo workflow: 
sudo tracer demo
Or run your WDL pipeline as usual. Once the pipeline starts, open the OpenSRE dashboard, and you’ll see each WDL task as a timeline step updating in real time.

OpenSRE Logo
Watch your pipeline run in the OpenSRE dashboard
View real-time metrics, resource usage, and performance insights for your pipeline runs.