Manually Installing TD Toolbelt Workflow Module When Downloads Are Blocked

Overview

This article explains how to manually install the Treasure Data (TD) Toolbelt workflow module when automatic downloads are blocked by corporate networks or firewalls. This is a common issue in environments with strict security policies that prevent the TD Toolbelt from automatically downloading the workflow module.

Problem Description

When attempting to use workflow commands such as td wf or td workflow, the TD Toolbelt tries to automatically download the workflow module (digdag) from Treasure Data's servers. If your corporate network blocks this download, you'll encounter errors similar to:

Workflow module not yet installed, download now? [Y/n]
Y
Error: An error occurred when fetching from 'https://toolbelt.treasure-data.com/digdag' (Net::HTTPBadGateway: Bad Gateway).
    

You might also see SSL certificate verification failures or proxy-related errors.

Prerequisites

• TD Toolbelt already installed
• Access to download files from the Treasure Data website
• Basic knowledge of file system navigation

Solution: Manual Installation Process

Step 1: Verify TD Toolbelt is working correctly

First, verify that your TD Toolbelt installation is working correctly for non-workflow operations:

td db:list

If this command works, proceed to the next step. If it fails, you may need to configure your TD endpoint:

td --endpoint https://api.treasuredata.com

Step 2: Download the digdag JAR file manually

1. Open your web browser and navigate to: https://toolbelt.treasure-data.com/digdag
2. This should prompt you to download a JAR file (typically named something like digdag-0.10.5.1.jar)
3. Save this file to a location you can easily find

Step 3: Locate your TD Toolbelt configuration directory

The TD Toolbelt configuration is stored in a hidden .td directory in your home folder:

• Windows: C:\Users\{username}\.td\
• macOS/Linux: ~/.td/

Step 4: Create the digdag directory (if it doesn't exist)

1. Navigate to your .td folder
2. Check if a digdag directory already exists
3. If it doesn't exist, create it:
   • Windows: mkdir digdag
   • macOS/Linux: mkdir -p ~/.td/digdag

Step 5: Copy and rename the digdag JAR file

1. Copy the downloaded JAR file to the digdag directory
2. Rename the file to just digdag (no file extension on macOS/Linux) or digdag (Windows may keep the .jar extension)

Windows Example:

copy C:\path\to\downloaded\digdag-0.10.5.1.jar C:\Users\{username}\.td\digdag\digdag

macOS/Linux Example:

cp ~/Downloads/digdag-0.10.5.1.jar ~/.td/digdag/digdag

Step 6: Test the workflow module

After placing the file in the correct location, try using the workflow command again:

td workflow

Or:

td wf

If successful, you should now be able to use workflow commands without downloading the module again.

Troubleshooting

Still getting download errors?

• Ensure the JAR file is properly renamed to digdag (not digdag.jar)
• Check that the file is in the correct location
• Try restarting your terminal/command prompt
• Verify permissions on the file and directory

SSL/Certificate errors

If you're encountering SSL certificate errors, you can try:

td workflow --disable-cert-validation

Note this is less secure and should only be used in controlled environments.

Related Topics

• Installing TD Toolbelt
• Configuring TD Toolbelt with proxies
• Working with Treasure Workflow

Need More Help?

If you continue to experience issues, please contact Treasure Data Support with:

• The exact error message you're receiving
• Your operating system details
• Your network environment (proxy settings, etc.)