This article explains how to use the Treasure Data JDBC with Informatica Cloud through the Informatica’s Secure Agent and setup a ‘Data Synchronization’ task that pulls records from a Treasure Data table into a different target destination of your choice.
Create the Informatica Cloud Account
First of all, please create an Informatica Cloud account here.
Set up Informatica Cloud Secure Agent
Second, please set up the Secure Agent on your computer.
Here’s relevant documentation.
Set up the Treasure Data JDBC Connection
Third, let’s install and configure the Treasure Data’s JDBC driver in Informatica Cloud.
Download JDBC Driver
Please download Treasure Data’s JDBC Driver.
Set up JDBC Driver
Please navigate to
Configuration -> Connectors, and click the
New button. Please configure the fields as follows.
- Type: JDBC
- Username: Your account email
- Password: Your account password
- Connection URL: jdbc:td://api.treasuredata.com/< YOUR_DATABASE_NAME >;useSSL=true;type=presto
- Schema: “public”
- JdbcDriver: com.treasuredata.jdbc.TreasureDataDriver
- JdbcDriverFolder: /path/to/download/directory/
Add a Synchronization Task
Finally, let’s create a data synchronization task using Treasure Data. Please navigate to
Apps > Data Synchronization and create a new Task. Then, please fill out the
Task Name and
Operation fields and click the
Let’s establish a connection so that Informatica Cloud can extract data from Treasure Data – this sets up Treasure Data as a ‘Source’ through the our JDBC driver.
To do this, please select the connection established in the previous steps. Then Informatica Cloud shows a list of tables under your database as ‘Source’ objects.
Once you select the table name, Informatica Cloud shows a
Data Preview, which show a few records from the target table.
Next, please setup a target for the data synchronization. This can be any of the supported Connections.
|Since the Treasure Data JDBC driver does not support INSERT statements it cannot be used to write data into Treasure Data - that is it cannot be used as a 'Target' of a 'Data Synchronization' task/schedule. This functionality is not supported.|
In the ‘Data Filters’ phase, you can specify how many records you want to process.
Also, data can be filtered by specifying filter conditions via the Web UI.
Finally, please specify the ‘Field Mapping’ between Treasure Data and the target.
If you want the selected Treasure Data table to synchronize periodically, please specify a schedule in the ‘Schedule’ tab.