There is experimental functionality that we are looking into, and have available for private beta users interested in helping to shape the functionality of Arm Treasure Data Workflows.
Some of these features include:
- Setting of a workflow based on the unscheduled arrival of data to a particular source
- Testing frameworks for helping to build and managing changing workflows over time
- Collecting metadata regarding aspects of your workflow
- Ability to run processing scripts in workflows such as Python, Ruby, Shell Commands, Embulk, Redshift, and more
You can review www.digdag.io. This is Digdag’s documentation website for the open sourced foundation that Treasure Workflows is based on.
The Digdag program you have is capable of running the full set of experimental functionality on your local machine.
| Much of this experimental functionality does not work if you submit the workflow to Treasure Data – Treasure Workflows. |
Comments
0 comments
Please sign in to leave a comment.