Configuring the data ingestion process
This content applies only to Pega Cloud environments
Ensure that the customer data in your Pega Customer Decision Hub application is always current. Propagate the changes in your customer data from an external system to Pega Customer Decision Hub through a process known as data ingestion, or import.
The following process shows the configuration of the manifest file and the rules for loading customer data from CSV files onto a Pega Cloud SFTP server into the Account, Subscriber, and Product Holding classes. Use this example to understand which types of rules you need in order to configure your system for data ingestion and plan your own configuration.
| Rule type | Rule name | Ruleset |
| Data set | UPlusImportAccount | UPlusCDH-Rules:01-01-01 |
| Data set | UPlusImportSubscription | UPlusCDH-Rules:01-01-01 |
| Data set | UPlusImportHolding | UPlusCDH-Rules:01-01-01 |
| Data flow | UPlusImportAccount | UPlusCDH-Rules:01-01-01 |
| Data flow | UPlusImportSubscription | UPlusCDH-Rules:01-01-01 |
| Data flow | UPlusImportHolding | UPlusCDH-Rules:01-01-01 |
| Case type | Ingestion | UPlusCDH-Rules:01-01-01 |
| Flow | UploadToXCAR | UPlusCDH-Rules:01-01-01 |
| Property | processType | UPlusCDH-Rules:01-01-01 |
| Property | DataFlowClassName | UPlusCDH-Rules:01-01-01 |
| Property | DataFlowName | UPlusCDH-Rules:01-01-01 |
| Property | ManifestDetails | UPlusCDH-Rules:01-01-01 |
| Decision table | UPlusIngestionProcessType | UPlusCDH-Rules:01-01-01 |
| Activity | ExecuteIngestionDF | UPlusCDH-Rules:01-01-01 |
| Parse XML | UPlusManifestParser | UPlusCDH-Rules:01-01-01 |
| Service package | UPlusIngestionFileProcessing | UPlusCDH-Rules |
| Service file | UPlusProcessManifestFile | UPlusCDH-Rules:01-01-01 |
| File listener | UPlusAccountFileListener | UPlusCDH-Rules |
| File listener | UPlusSubscriptionFileListener | UPlusCDH-Rules |
| File listener | UPlusHoldingFileListener | UPlusCDH-Rules |
- Creating a manifest file to ingest customer data
- Configuring a repository to ingest customer data
- Creating data sets to ingest customer data
- Creating data flows to ingest customer data
- Creating a case type to ingest customer data
- Creating properties to ingest customer data
- Creating a decision table to ingest customer data
- Creating an activity to ingest customer data
- Creating a Parse XML rule to ingest customer data
- Creating a service package to ingest customer data
- Creating a service file to ingest customer data
- Creating file listeners to ingest customer data
- Starting file listeners to ingest customer data
Previous topic Best practices for data ingestion Next topic Creating a manifest file to ingest customer data