Skip to main content

User Guide

Managing General Settings

The Settings interface allows a Superuser to control various internal values and settings that the Privitar platform uses during operation.

To access the Settings page, click Settings on the Superuser Navigation sidebar.

To change a Setting:

  1. Select Settings from the Superuser navigation sidebar.

  2. Click on Edit in the Actions column alongside the name of the Setting.

    The Setting dialog box is displayed.

  3. Edit the details for the Setting.

  4. Click on Save to update the details for the Setting.

Settings description

The following table describes each of the Settings shown in the Settings page.

Setting

Description

CSV Delimiter

Default CSV delimiter character for new Schemas.

May be overridden in individual Schema configurations. Unicode characters can be used. For example, \u0009 for tabs.

CSV Escape Char

Default CSV escape character for new Schemas.

May be overridden in individual Schema configurations. Unicode characters can be used. For example, \u0002 for STX.

CSV Quote Char

Default CSV quote character for new Schemas.

May be overridden in individual Schema configurations. Unicode characters can be used. For example, \u0003 for ETX.

Default CSV Date Format

Default CSV Date Format for defining Date type columns in Schemas.

May be overridden in individual Schema configurations. For more information about the date format, see Date and Timestamp formats.

Default CSV Timestamp Format

Default CSV Timestamp Format for defining Timestamp type columns in Schemas.

May be overridden in individual Schema configurations. For more information about the timestamp format, see Date and Timestamp formats.

Default Job Output Type

Default HDFS Batch Job output type.

The available options are:

  • OVERWRITE : If any existing files are encountered when running the Batch Job, the files will be overwritten. (This is the default option used for this setting.)

  • STOP: If any existing files are encountered when running the Batch Job, the files will not be overwritten. Instead, the Job Fails completely and an error message will be issued.

This setting can be overridden on a per-Job basis by editing the Overwriting Behavior setting for an individual HDFS Batch Job.

Default NULL Value

Default NULL text for new Schemas.

May be overridden in individual Schema configurations.

Event Broker Location

The location (URL) of the Event Broker.

This location should be specified by a system administrator.

Hive default job output type

This setting determines the default behavior for Hive table creation when running Hive Batch Jobs. The available options are:

  • INSERT : create the table if it does not exist.

  • FAIL : Attempt to create the table, and fail if it already exists.

  • TRUNCATE : Truncate (erase) the table before inserting into it, or create it if it does not exist.

This setting can be overridden on a per-Job basis by editing an individual Hive Batch Job.

Instance ID

This ID is used internally by Privitar when creating names for various objects (such as filenames and YARN queues) to disambiguate these objects from similar objects created by other instances of Privitar that may be sharing the same cluster.

Processor Root

The location of the Privitar installation on the local filesystem.

This location should be specified by a system administrator.

Spark Jar File

The location of the Spark Jar installation on the local filesystem.

This location should be specified by a system administrator.

Watermark Digits Length

The number of digits used when generating Watermark signatures.

The default value is 3. It is not recommended to change this setting without consulting Privitar.

In this section: