The hash filter plugin for Arm Treasure Data's Data Connectors allows you to specify the hashing algorithm on certain columns.
Options
This plugin contains the following option:
Option | Description |
---|---|
column_options | a key-value pairs. Key is a column name and Value is for column options. |
Child Elements | Description |
---|---|
algorithm | The algorithm to digest. Can be: MD5, SHA-1, or SHA-256 (string, required) |
salt | The salt value. When present, "salt value + original string" is digested (string, optional) |
salt_column | The column that stores the salt value. When present, "salt column's value + original string" is digested (string, optional) |
rename_to | Used to change the column name (string, optional) |
charset_to_encode_strings | The character set encoding name. Used to encode strings in the column that your Java Runtime supports (string, default: UTF-8). |
Configuration
Add the filter
section, including the type, to your load.yml
. In the following example, the type is digest
:
in: ... filters: - type: digest column_options: id: algorithm: MD5 name: algorithm: SHA-1 rename_to: name_digest email: algorithm: SHA-256 salt: salt_value phone: algorithm: SHA-266 salt_column: col1 out: ...
Comments
0 comments
Please sign in to leave a comment.