OnDemand User Group

Support Forums => MP Server => Topic started by: tjspencer2 on November 20, 2020, 04:36:52 AM

Title: CMOD Load Threshold Metrics - MP 9.5 on AIX with DB2 and PDF Indexer
Post by: tjspencer2 on November 20, 2020, 04:36:52 AM
Has anyone ever seen when loading PDF files with many contiguous statements where you can cross loading thresholds such that you have to keep file sizes below a certain size to get them to load in a reasonable amount of time?

I have an example where a 200 MB PDF file loads in 4.4 hours but when I try to load one that is 340+MB it takes 11.5 hours to load?  Scratching my head  :-\ 

I originally thought the dropping unnecessary indexes from the AG was the issue, but the problem is clearly larger than just indexes. 

Note: I have other AGs that can load PDF files that are 500MB in minutes and not hours.
Title: Re: CMOD Load Threshold Metrics - MP 9.5 on AIX with DB2 and PDF Indexer
Post by: Justin Derrick on December 01, 2020, 12:59:59 PM
Yeah, those load times are insane.  Most CMOD PDF Indexing is done on Windows -- simply because the libraries for PDF on the Windows platforms are the most heavily used, so get the most development time/effort.

There are other tricks, like disabling PDF's internal compression to let CMOD work its own magic under the covers.

You can test it out by running the loads manually from a PC with the CMOD server software installed locally.  If the performance is way better, then consider adding that into your architecture. 

-JD.