OnDemand User Group

Support Forums => Other => Topic started by: Mark@M on December 17, 2019, 11:23:59 AM

Title: Identifying Duplicate Reports
Post by: Mark@M on December 17, 2019, 11:23:59 AM

I'm new to using CMOD and have a basic question.   Is it possible to identify duplicate reports in CMOD based off of the posting_date thru DB2 queries ?  For example, if you have 2 reports with the same posting_date, is there a value in one of the tables to compare.

I see a compression field and not sure if I can use that as sort of a HASH value ?   (Our company isn't  on the CMOD version that produces HASH values.) 

Our company is in the process of migrating reports over to CMOD and at times have duplicated reports for particular days.  Just trying to see if there is an easy way to go about this.

thanks !

Title: Re: Identifying Duplicate Reports
Post by: Stephen McNulty on December 18, 2019, 05:59:01 AM

in some scenarios 2 reports with the same posting date is valid.

We originally used information from the system Log, then once available started to use the System Load facility.   
There are a number of fields that we use to determine if a load is duplicated (ie  doc Begin date, row count, total pages, input size, output size, input file name)

Title: Re: Identifying Duplicate Reports
Post by: Justin Derrick on December 18, 2019, 10:04:06 AM

If the problem is not an epidemic, it's probably best to migrate the data into a test/staging server with a document hash field defined, then identify the duplicates by comparing hashes.  Then either delete the duplicates with arsdoc delete, or re-extract them without the extra copies.

-JD.