Managing Data Sources
A data source contains the details of input and output data sources that are part of the transformation process. The data source can be database or file.
Note
All the database objects and column names (for files) are case sensitive.
In this article, you will learn how to:
Creating Data Source
Log on to the CipherTrust Manager GUI as administrator.
Open Application Data Protection.
In the left pane, click Data Sources. The Add Data Source wizard is displayed. Follow the steps to complete the setup.
General Info
(Mandatory.) Enter a friendly name for the data source.
(Mandatory.) Select the data source type from the drop-down list. The data source type can be either databases or file.
Supported Databases Supported File Types IBM Db2 CSV File Oracle Fixed Length File Microsoft SQL Server MySQL SAP HANA PostgreSQL (Optional) Enter Description for the data source.
Click Next to go to the Connection Info screen.
Connection Info
The Connection Info screen will vary based on the type of data source selected in the General Info step.
On the Connection Info screen, enter the following details.
Field Description Default Required Connection URL Database connection URL. Following are the JDBC URLs:
— IBM db2:jdbc:db2://<dbhost>:<port>/<dbname>
— Oracle:jdbc:oracle:thin:@<dbhost>:<port>:<sid>
— Microsoft SQL Server:jdbc:mysql://<dbhost>:<dbport>/<dbname>?useSSL=<false>
— MYSQL:jdbc:sqlserver://<dbhost>:<dbport>;databaseName=<dbname>
— SAP HANA:jdbc:sap://<dbhost>:<dbport>
— PostgreSQL:jdbc:postgresql://<dbhost>:<dbport><dbname>Mandatory Username Database username. Mandatory Password Database password. Mandatory Click Next to go to the Confirmation screen.
The file type can be CSV File or Fixed Length File. Click the desired tab for details.
On the Connection Info screen, enter the following details.
Field Description Default Required Delimiter The character that is used to divide one column from the next in the input file. Any printable ASCII character except for backslash (\) can be used as a delimiter, in addition to space ( ), tab, and Ctrl-A. Not mandatory in destination if it is same as source.
The default delimiter is ,Note
The delimiter and qualifier characters cannot be the same.
, (comma) Optional Qualifier A character used to enclose fields that contain a delimiter or a qualifier character itself. Any printable ASCII character except a backslash ("\") can be used as a qualifier. To identify which qualifier character is used for the input/output file, either go to the properties of your CSV editor or open the input file in any text editor and check which character is used as a qualifier to enclose that data. 
In the above example, (") is the qualifier character.Note
— The delimiter and qualifier characters cannot be the same.
— If data includes delimiter characters, qualifier characters, or both, it is recommended to specify the qualifier character, otherwise the output may be ambiguous." (double quote) Optional File Path Complete path including the file name. The file path should be absolute and same as the one used in volume mapping during deployment. Mandatory Encoding Sets encoding for input file. The output and failed record files must use the same encoding as specified in the input file. ExamplesNote
Encoding is mandatory only for the Extended Binary Coded Decimal Interchange Code (EBCDIC)-encoded files.
— To protect EBCDIC file, specify encoding asibm500.
— To protect ASCII file, specify encoding asASCII.
For the list of standard encodings, click here and refer to Canonical Name for java.io API and java.lang API column.UTF8 Optional Column Count Number of columns in the input file. Mandatory when this datasource is configured as the source in the job configuration. Has Header Row If selected, BDT will treat the first row as a header row. Values of the first row will be treated as column names. The same column names should be mentioned in the transformation action. If the check-box is not selected, BDT will treat all the rows as data to be transformed. Selected Not configurable Note
For file-to-file (CSV) transformation, if the delimiter or qualifier is not configured for destination, the delimiter or qualifier configured in the source will be considered.
Click Next to go to the Confirmation screen.
On the Connection Info screen, enter the following details.
Field Description Default Required File Path Complete file path including the file name. The file path must be absolute and same as the one used in volume mapping during deployment. Mandatory Encoding Sets encoding for input file. The output and failed record files must use the same encoding as specified in the input file. ExamplesNote
Encoding is mandatory only for the Extended Binary Coded Decimal Interchange Code (EBCDIC)-encoded files.
— To protect EBCDIC file, specify encoding asibm500.
— To protect ASCII file, specify encoding asASCII.
For the list of standard encodings, click here and refer to Canonical Name for java.io API and java.lang API column.UTF-8 Optional Column Count Number of columns in the input file. Mandatory when this datasource is configured as the source in the job configuration. Record Length Length of the record. Mandatory when this datasource is configured as the source in the job configuration. Column Position Info Column positioning. It consists of the following values:
— start
— end
— columnMandatory when this datasource is configured as the source in the job configuration. Has Header Row If selected, BDT will treat the first row as a header row. Values of the first row will be treated as column names. The same column names should be mentioned in the transformation action. If the check-box is not selected, BDT will treat all the rows as data to be transformed. Selected Not configurable Line Separator If selected, the record is separated with a line separator. Mandatory when this datasource is configured as the source in the job configuration. Click Next to go to the Confirmation screen.
Confirmation
On the Confirmation screen, verify the data source details. This screen displays general information and connection details.
Click Edit to update the details.
Click Add Data Source.
Click Close to exit the wizard.
Viewing/Editing Data Sources
Viewing details of data source
Log on to the CipherTrust Manager GUI as administrator.
Open Application Data Protection.
In the left pane, click Data Sources. The Data Source page displays the following details.
Column Description Name Name of the data source. Type Type of the data source. Creation Date and time when the data source was created. Last Modified Time when the data source was last modified. Note
You can also filter data source by its type.
Editing data source
Note
The data source type can't be switched between database and files.
The CSV data source type can't be changed to Fixed Length File and vice-versa.
Log on to the CipherTrust Manager GUI as administrator.
Open Application Data Protection.
In the left pane, click Data Sources. The Data Source page displays the list of available data sources.
Click the Name of the data source to be modified. The mini detail view shows the details of data source. This view varies between different data source type. On this page, you can modify the following fields:
Type Description Connection URL Username Password Description Delimiter Qualifier File Path Encoding Column Count Has Header Row Description File Path Encoding Column Count Record Length Column Position Info Has Header Row Line Separator Click Update.
Deleting Data Sources
Log on to the CipherTrust Manager GUI as administrator.
Open Application Data Protection.
In the left pane, click Data Sources. The Data Source page displays the list of available data sources.
Click the overflow icon (
) corresponding to the job configuration that you want to delete.Click Delete. A message box appears prompting to confirm the job configuration deletion.
Deleting a data source is permanent and cannot be undone.
Click Delete. The data source is deleted.
