Skip to main content

User Guide

AWS Glue Environment Configuration

The AWS Glue Environment tab is only available when Privitar AWS has been deployed.

AWS Glue Settings

The following settings can be used to customize the AWS Glue Environment:

Setting

Description

Maximum number of Glue executors

The maximum number of Spark executors that AWS Glue Batch Jobs will request to run a Batch job. This option can be overridden for each Job run.

Note

Increasing this number will increase the cost of running this job in AWS. Contact your system administrator if you are in any doubt.

Configured cloud native region

The region that Privitar is going to use to:

  • Import AWS Glue Data Catalog schemas

  • Run AWS Glue ETL Jobs

  • Store DynamoDB tables.

The default region is the region that was specified when Privitar AWS was deployed.

AWS Glue Environment constraints

AWS Glue Environments have the following constraints:

  • They are not able to reference Hadoop Clusters.

  • The only supported Token Vault type is AWS DynamoDB.

Please choose Custom instead of AWS Glue when creating a new Environment to configure an Hadoop Cluster or use a different Token Vault type.