TD Workflow is designed to provide a scalable and flexible solution for you to manage your data pipelines in a cloud hosted environment
Limits of Use
To ensure optimal and fair processing, we set the following standard limits.
- We set a maximum of 100 tasks running concurrently, per account. All other tasks get queued, and are issued on a first come first served basis.
- 1000 Saved Workflows. Over 1000, and not all workflows will load within our Workflow UI. They are still accessible via CLI.
Advised Limits of Use
We advise customers to stay below the following limits, for fast page-load time within our Workflow UI in the Treasure Data console.
- 200 Saved Workflows
- 400 Tasks in a Workflow
We hope to expand these recommended limits in the future, based on improvements to our backend to support efficient page-load time for larger amounts of resources.