Workflow Experimental Functionality

We have a new docs home, this page is in Workflow

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

There is experimental functionality that we are looking into, and have available for private beta users interested in helping to shape the functionality of Arm Treasure Data Workflows.

Some of these features include:

• Setting of a workflow based on the unscheduled arrival of data to a particular source
• Testing frameworks for helping to build and managing changing workflows over time
• Collecting metadata regarding aspects of your workflow
• Ability to run processing scripts in workflows such as Python, Ruby, Shell Commands, Embulk, Redshift, and more

You can review www.digdag.io. This is Digdag’s documentation website for the open sourced foundation that Treasure Workflows is based on.

The Digdag program you have is capable of running the full set of experimental functionality on your local machine.