Dedupe Functions
For each of the types of deduplication that are briefly described below, there are the following three options:
Deduplication within a file/table: Here, the program looks for duplicate addresses or records within a single file/table.
Deduplication between two files/tables: Here, one file/table is compared with another, e.g. in the case of new customer recruitment, to delete existing customers from a promotions list, or alternatively, to take addresses from a black list in consideration during an advertising campaign. The two tables involved in the comparison can have different structures and/or different file formats.
- Blacklists: Blacklists are lists of people who do not want to be contacted or who should not be contacted for a specific reason. These are used to delete the contact details of the people in question from a second table. The blacklist can also contain entries to delete entire groups of contacts, for example, email addresses with a specific domain.
Multiple deduplication: Here, several files/tables can be deduplicated at the same time. In doing so, you can determine if a table should be treated as if it were read-only. It would then only be used to search for records in the other tables that appear in both tables. You may also determine if a table should be treated as if it were delete-only. It would then NOT be used to search for records in the other tables. And you can decide whether this table should also be deduplicated (internal matching). Furthermore, with the sequence of the tables, you can determin in which of the two tables the duplicates should be deleted during the deduplication process. Duplicates are always deleted in the table of lower priority. With universal matching, the multiple deduplication function is not available.
The following types of deduplication are available: