Issue in loading huge size PDF (1gb)

[azkhan]

Hi All,

I am facing issue in loading huge size pdf using generic indexer in windows env. The loading fails due to huge object size.
Please can anyone suggest a way to load this pdf.

[Justin Derrick]

Hi Azkhan.

When you post a question like this, you need to give us enough information -- to help us to help you.  Platform / Version info, the full command(s) you ran, error messages, and any steps you've taken to try to resolve the issue are all things that we need to be able to help!

Recommended reading:  http://www.catb.org/esr/faqs/smart-questions.html#beprecise

-JD.

[azkhan]

Hi JD,

It was my bad.
I want to load a pdf as one single load, don't want to split the pdf on the bases of bookmarks to add additional indexes.
Currently we are using CMOD Version 9.

Trying to load a pdf document using generic indexer. But the loading fails with the below error msg.

ARS4335I Server Version <9.0.0.6>  Operating System <z/OS> <04.24.00>  Database <DB2> <10.01.0005>
ARS4312I 07/25/16 07:05:22 -- Loading started, --UNKNOWN-- bytes to process
ARS1408W Warning:  A document of size >698078007< bytes was processed.  It is not recommended to store documents in OnDemand greater than 50MB in size.
ARS1144I OnDemand Load Id = >6867-15-0-7FAA-0-0-6868<
ARS1107E An error occurred.  Contact your system administrator and/or consult the System Log.  File=arsadmp.c, Line=1463
ARS1157E Unable to store the object >7FAAA<.  Object size 324062493
ARS1146I Loaded 0 rows into the database
ARS4311E 07/25/16 07:09:02 Loading failed

Please suggest how do I proceed.

[Greg Ira]

You're probably getting an error message from z/OS from this.  Check the SDSF log during the same time this error occurred.  If you're storing to OAM my guess is you're hitting the maximum object size limit.  If not the error message should point you to the issue.

[Ed_Arnold]

*only if you're on z/OS*

Adding to what Greg says - issue the following command on the system console:

F OAM,D,OAM

Near the bottom you'll see something like the following:

CBROAM:                                 
OAM1 Parms: TIME=GMT  MSG=EM  UPD=N  QB=Y
            MOS= 256  OTIS=N  LOB=N  DP=N

Please paste your results in here.

Ed

[Justin Derrick]

You'll want to explore using the PDF indexer instead -- most large shops use the PDF Indexer on a Windows server, then point it at the CMOD server.  Loading the file as a single 300MB object is not really reasonable -- that's a lot of data to download to get a single document back. 

-JD.