Is it possible to check duplication of documents into a search engine system?

Yes, it is possible to check duplication of documents into the search system while indexing.

Kindly refer to DeDuplication (rchilli.com)

If you have any questions, you can contact us at support@rchilli.com