Author Topic: CMOD Load Threshold Metrics - MP 9.5 on AIX with DB2 and PDF Indexer  (Read 1127 times)

tjspencer2

  • Jr. Member
  • **
  • Posts: 80
    • View Profile
Has anyone ever seen when loading PDF files with many contiguous statements where you can cross loading thresholds such that you have to keep file sizes below a certain size to get them to load in a reasonable amount of time?

I have an example where a 200 MB PDF file loads in 4.4 hours but when I try to load one that is 340+MB it takes 11.5 hours to load?  Scratching my head  :-\ 

I originally thought the dropping unnecessary indexes from the AG was the issue, but the problem is clearly larger than just indexes. 

Note: I have other AGs that can load PDF files that are 500MB in minutes and not hours.

Justin Derrick

  • IBM Content Manager OnDemand Consultant
  • Administrator
  • Hero Member
  • *****
  • Posts: 2228
  • CMOD Guru for hire...
    • View Profile
    • Tenacious Consulting
Re: CMOD Load Threshold Metrics - MP 9.5 on AIX with DB2 and PDF Indexer
« Reply #1 on: December 01, 2020, 12:59:59 PM »
Yeah, those load times are insane.  Most CMOD PDF Indexing is done on Windows -- simply because the libraries for PDF on the Windows platforms are the most heavily used, so get the most development time/effort.

There are other tricks, like disabling PDF's internal compression to let CMOD work its own magic under the covers.

You can test it out by running the loads manually from a PC with the CMOD server software installed locally.  If the performance is way better, then consider adding that into your architecture. 

-JD.
IBM CMOD Professional Services: http://TenaciousConsulting.com
Call:  +1-866-533-7742  or  eMail:  jd@justinderrick.com
IBM CMOD Wiki:  https://CMOD.wiki/
FREE IBM CMOD Education & Webinars:  https://CMOD.Training/

Interests: #AIX #Linux #Multiplatforms #DB2 #TSM #SP #Performance #Security #Audits #Customizing #Availability #HA #DR