Set up bulk duplicate search

Bulk duplicate search is a third-party service for bulk deduplication of Creatio section records.

Attention

Set up the global search service in ElasticSearch to ensure correct operation of the bulk duplicate search. More information about global search setup is available in the “Setting up the global search service (version 2.0)” article.
Basic knowledge of Docker software and Linux OS administration is required to set up the service.

The bulk duplicate search service uses version control functionality. This instruction is universal for all service versions. Versions 1.0–1.5 are compatible with any Creation versions that use the bulk duplicate search functionality. Version 2.0 is compatible with Creatio 7.15.4 and up.

Recommended system requirements

Components of the bulk duplicate search service

Prerequisites:

1.Global search components. The list is available in the “Setting up the global search service (version 2.0)” article.

2.Components of the bulk duplicate search service. The list of components is available below.

Components to deploy on server 1:

Mongodb – document-oriented DBMS.

Components to deploy on server 2:

dd-web-api – web service for communicating in Creatio.

dd-data-service – internal service for communication with mongdb.

dd-duplicates-search-worker – duplicate search component.

dd-duplicates-deletion-worker – duplicate deletion component.

dd-duplicates-confirmation-worker – component that performs grouping and filtering of the detected duplicates taking into account their uniqueness.

dd-duplicates-cleaner – component for clearing the duplicates.

dd-deduplication-task-worker – component for setting the deduplication task.

dd-deduplication-preparation-worker – component for preparing the deduplication process, it generates queries for duplicate search according to the rules.

To set up the components, download the source files, using the following link: download files.

Contents

•Bulk duplicate search service setup procedure