Configuring Detokenization Parameters
The detokenization configuration is a section in detokenization.properties file. It contains all the necessary information required for the detokenization of tokenized input data. For example, the name of the token vault wherein plaintext corresponding to tokens of column is stored and the token format that will be used to detokenize a column.
A hidden parameter PreserveSpace has been introduced for File-to-File migration. If this parameter is enabled, the spaces in the tokens during detokenization are preserved. This parameter is not applicable for any of the flavors of bulk masking.
Note
To preserve spaces in the plaintext values at the time of detokenization, set PreserveSpace=true in the detokenization.properties file.
If the PreserveSpace parameter is enabled, spaces are preserved in the following scenarios:
If the tokens contain spaces at leading or trailing positions, the spaces are preserved in the output plaintext values.
For example:
Tokens Plaintext Value ----184326---- ----356789---- If the tokens only contains spaces, the spaces are preserved in the output plaintext values.
For example:
Tokens Plaintext Values ---------------- ---------------- Note
In the above examples, - represents space.
Below is a sample of the Detokenization Configuration section of detokenization.properties file:
###########################################
# DeTokenization Configuration
# DeTokenizer.Column0.TokenVault
# DeTokenizer.Column0.TokenFormat
# ...
# DeTokenizer.ColumnN.TokenVault
# DeTokenizer.ColumnN.TokenFormat
############################################
#
#DeTokenizer.ColumnN.TokenVault
#
#Specifies the name of the token vault wherein plain text corresponding to tokens of
# this column is stored. If the column does not need to be DeTokenized, do not specify
# this parameter. If this parameter is specified, all other DeTokenization
# parameters for the same column must also be specified. Token vault
# specified in this parameter must exist before running bulk migration.
#
DeTokenizer.Column5.TokenVault = BTM
DeTokenizer.Column6.TokenVault = BTM_2
#
#DeTokenizer.ColumnN.TokenFormat
#
#Specifies token format that will be used to DeTokenize this column. If the
# column does not need to be DeTokenized, do not specify this parameter. If
# this parameter is specified, all other tokenization parameters for the
# same column must also be specified.
#
#Valid values
# <number>
# 0 for plain Text
# 6 for Masked Token
#
DeTokenizer.Column5.TokenFormat = 0
DeTokenizer.Column6.TokenFormat = 0
