Mass Ingestion

Back Next

Configuring the source

You can configure the source on the

Source

page of the

application ingestion

task wizard.

Before you configure the source, ensure that the connection to the source is created in Administrator for the runtime environment that your organization uses.

From the

Connection

list, select the connection configured for the source application.

The list includes only the connections that are valid for the load type that you selected on the

Definition

page.

After you deploy the ingestion task, you cannot change the connection without undeploying the associated ingestion job. After you change the connection, you must deploy the task again.

Select the source objects that you want to replicate on the target and specify the advanced and custom properties for the source.

The fields and options that appear on the

Source

tab of the task wizard vary based on the type of source connection that you select. For more information about the steps to complete the configuration of your source, see the following topics:

Configuring a Salesforce source.

From the

Context

list, select the context containing the source objects that you want to replicate on the target.

The

Context

drop-down list appears only for SAP ECC sources.

In the

Object Selection Rules

section, create object selection rules to select the source objects that you want to load to the target.

By default, an Include
rule configured to select all objects on the source is defined in the task. If you do not want to load all the source objects to the target, you can define Include
rules and Exclude
rules to select the specific objects that you want to load.

Perform the following steps to create an object selection rule:

Select

Object Selection

as the rule type.

From the adjacent list, select

Include

Exclude

as the action that you want the rule to perform.

In the condition field, enter an object name or an object-name mask to specify the source objects to include in or exclude from the list of selected objects.

A mask can contain the asterisk (*) wildcard character to represent one or more characters, the question mark (?) wildcard character to represent a single character, or both types of wildcard characters. You can use a wildcard character multiple times in an object-name mask.

Object names are case sensitive. When you define the object selection rules, you must specify the object names or masks in the case in which they are defined on the source.

If an object name contains delimiters, such as quotation marks or brackets, do not include them when you specify the object name for the rule.

If an object name includes special characters, such as backslash (\), asterisk(*), dollar sign ($), caret (^), or question mark (?), replace each special character in the name with a backslash (\) when you specify the object name for the rule.

Click

Add Rule

The object selection rules are processed in the order in which they are listed in the

Object Rules

list. The rule at the top of the list is processed first. You can use the arrow icons to change the order in which the rules are listed. For an example of using multiple rules, see Examples of rules selecting source objects.

After you create the rules, you can optionally click

Object Count

to display the number of source objects that match each rule in the

Object Affected

column and the total number of objects selected based on all the selection rules in the

Total Objects

field.

In the

Object Selection Rules

section, create data field action rules to perform actions on the data fields of the selected objects.

Perform the following steps to create a data field action rule:

Select

Data Field Action

as the rule type.

From the adjacent list, select one of the following action types:

LTRIM

. Trims spaces to the left of character data field values.

RTRIM

. Trims spaces to the right of character data field values.

TRIM

. Trims spaces to the left of and to the right of character data field values.

In the condition field, enter a data field name or a data field-name mask. The value that you enter is matched against data fields of the selected source objects to identify the data fields to which the action applies.

Click Add Rule
.

The data field action rules are processed in the order in which they are listed in the

Data Field Actions

list. The rule at the top of the list is processed first. You can use the arrow icons to change the order in which the rules are listed.

Perform the following steps to download a list of source objects that match the selection rules:

From the

List Objects

list, select the type of selection rule for which you want to download the list of source objects.

If you want to include the fields in the list, select

Include Fields

Click the Download icon.

The list of source objects that match the selection rules is downloaded to your local drive.

The information in the downloaded list is in the following format:

status,object_name,object_type,field_name,comment

The following table describes the information in the downloaded file:

Field	Description
status	Indicates whether Mass Ingestion Applications includes or excludes the source object from processing. The possible values are: E . The object is excluded from processing by an Exclude rule. I . The object is included for processing. X . The object is excluded from processing because its data type is not supported by Mass Ingestion Applications .
object_name	Name of the source object.
object_type	Type of the source object. The possible values are: O : Object. F : Field.
field_name	Name of the source field. This information appears only if you selected Include Fields before downloading the list.
comment	Reason why a source object is excluded from processing even though it matches the selection rules.

In the

Fetch Size

field of the

Advanced

section, perform one of the following steps based on the source that you want to configure:

For Salesforce sources, enter the number of records that the

application ingestion

job associated with the task must read at a time from the source. The default value for initial load operations is 50000 and the default value for incremental load operations is 2000.

For SAP ECC sources, enter the size of data that the

application ingestion

job associated with the task must read at a time from the source. The value must be in megabytes (MB). Default value is 8.

For Microsoft Dynamics 365 sources,

application ingestion

jobs read 5000 records at a time from the source irrespective of the value that you enter in the

Fetch Size

field.

For incremental load tasks and combined initial and incremental load tasks, perform the following steps in the

Advanced

section:

In the

Restart Point for Incremental Load

field, specify the point in the source data stream from which the ingestion job associated with the

application ingestion

task starts extracting source change records.

For incremental load tasks with Microsoft Dynamics 365 or Salesforce sources, you must specify a date and time as the restart point. The ingestion job retrieves the changes that were made after the specified date and time, and then loads them to the target. For Microsoft Dynamics 365 sources, you must specify the date and time in Coordinated Universal Time (UTC) and for Salesforce sources, you must specify it in Greenwich Mean Time (GMT).

For SAP ECC sources and for combined initial and incremental load tasks with Microsoft Dynamics 365 or Salesforce sources,

Mass Ingestion Applications

retrieves the change records from the latest available position in the data stream.

In the

CDC Interval

field, specify the time interval in which the

application ingestion

job must run to retrieve the change records for incremental load. Default value is 5 minutes.

For SAP ECC sources, the CDC interval must be less than the data retention period configured in the SAP system for the Operational Delta Queue (ODQ).

In the

Custom Properties

section, you can specify custom properties that Informatica provides for special cases. To add a property, click the

Add Property

icon, and then add the property name and value.

The custom properties are configured to address unique environments and special use cases.

Specify the custom properties only at the direction of Informatica Global Customer Support.

Click

Configuring application ingestion tasks

Example of rules for selecting source objects

Download Guide

Watch

Comments

Communities

Knowledge Base

Success Portal

0 COMMENTS

We’d like to hear from you! Log in to comment.

Rename Saved Search

Table of Contents

Mass Ingestion

Mass Ingestion

Configuring the source

Configuring the source